2023-11-16T02:12:05.483 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-16T02:12:05.483 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} --verbose --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-15_23:07:34-fs-wip-yuri-testing-2023-11-14-0743-reef-distro-default-smithi/7459949 --name yuriw-2023-11-15_23:07:34-fs-wip-yuri-testing-2023-11-14-0743-reef-distro-default-smithi -- /home/teuthworker/archive/yuriw-2023-11-15_23:07:34-fs-wip-yuri-testing-2023-11-14-0743-reef-distro-default-smithi/7459949/orig.config.yaml 2023-11-16T02:12:05.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T02:12:05.614 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-11-15_23:07:34-fs-wip-yuri-testing-2023-11-14-0743-reef-distro-default-smithi/7459949 branch: wip-yuri-testing-2023-11-14-0743-reef description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} email: yweinste@redhat.com first_in_suite: false job_id: '7459949' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-11-15_23:07:34-fs-wip-yuri-testing-2023-11-14-0743-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuri-testing-2023-11-14-0743-reef ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: cb2179fff8710af9ff3936b02b8bc8cd99900af3 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: cb2179fff8710af9ff3936b02b8bc8cd99900af3 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-11-14-0743-reef sha1: cb2179fff8710af9ff3936b02b8bc8cd99900af3 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 seed: 3105 sha1: cb2179fff8710af9ff3936b02b8bc8cd99900af3 sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: wip-yuri-testing-2023-11-14-0743-reef suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_cb2179fff8710af9ff3936b02b8bc8cd99900af3/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: cb2179fff8710af9ff3936b02b8bc8cd99900af3 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi028.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOPCTl5rGC0ntQL8s7g6vBSIuOVUO0Apo/2vtzgVKjspwX/XByy+QAJuPIuFpLS1Up2tdfeVOQ/TSE982TadPR0= smithi070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGpiA81trjG0Gg0d58ydwBrok6P5E1cNPHYyJhG91X9nHUd0zWJrtbv2Rz2GUJ+SraMjWOR0EemoLRj1AnXaI9E= smithi204.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKmIkAxtpvJP9ai86HXRi0rJ+KIQNzeFNcEDdo1u6evxYeDlC8m63Xtq2BNF/kUxiSEg7p38TRMccrz/IH/s3UE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_fscrypt teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 6899cd26fceddb2fec83dc1a1349394b28c8998e timestamp: 2023-11-15_23:07:34 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1224587 2023-11-16T02:12:05.614 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_cb2179fff8710af9ff3936b02b8bc8cd99900af3/qa; will attempt to use it 2023-11-16T02:12:05.615 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_cb2179fff8710af9ff3936b02b8bc8cd99900af3/qa/tasks 2023-11-16T02:12:05.615 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-16T02:12:05.617 INFO:teuthology.task.internal:Checking packages... 2023-11-16T02:12:05.639 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'cb2179fff8710af9ff3936b02b8bc8cd99900af3' 2023-11-16T02:12:05.639 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-16T02:12:05.639 INFO:teuthology.packaging:ref: None 2023-11-16T02:12:05.640 INFO:teuthology.packaging:tag: None 2023-11-16T02:12:05.640 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-11-14-0743-reef 2023-11-16T02:12:05.640 INFO:teuthology.packaging:sha1: cb2179fff8710af9ff3936b02b8bc8cd99900af3 2023-11-16T02:12:05.640 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuri-testing-2023-11-14-0743-reef 2023-11-16T02:12:05.785 INFO:teuthology.task.internal:Found packages for ceph version 18.2.0-1240-gcb2179ff-1jammy 2023-11-16T02:12:05.785 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-16T02:12:05.793 INFO:teuthology.task.internal:no buildpackages task found 2023-11-16T02:12:05.794 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-16T02:12:05.808 INFO:teuthology.task.internal:Saving configuration 2023-11-16T02:12:05.827 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-16T02:12:05.833 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-16T02:12:05.857 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi028.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-15_23:07:34-fs-wip-yuri-testing-2023-11-14-0743-reef-distro-default-smithi/7459949', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-16 02:06:15.768931', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEXBN/9+jw7ma0J3YFA6lIF7/FBloWWyuQuN26TD3Uc/'} 2023-11-16T02:12:05.880 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-15_23:07:34-fs-wip-yuri-testing-2023-11-14-0743-reef-distro-default-smithi/7459949', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-16 02:06:15.766199', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKc/aiqs4kn/owA88teHvFTO6nVbHTAd2rHe0q5Qx27S'} 2023-11-16T02:12:05.904 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi204.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-15_23:07:34-fs-wip-yuri-testing-2023-11-14-0743-reef-distro-default-smithi/7459949', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-16 02:06:15.767733', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHXa7/MrmM6PzYRcS1aH0/mJenOBxPa7LEiuJ9yR3s6l'} 2023-11-16T02:12:05.904 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-16T02:12:05.910 INFO:teuthology.task.internal:roles: ubuntu@smithi028.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-11-16T02:12:05.910 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-11-16T02:12:05.910 INFO:teuthology.task.internal:roles: ubuntu@smithi204.front.sepia.ceph.com - ['client.0'] 2023-11-16T02:12:05.910 INFO:teuthology.run_tasks:Running task console_log... 2023-11-16T02:12:06.022 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f44a8a1bb80>, signals=[15]) 2023-11-16T02:12:06.023 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-16T02:12:06.032 INFO:teuthology.task.internal:Opening connections... 2023-11-16T02:12:06.032 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi028.front.sepia.ceph.com 2023-11-16T02:12:06.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T02:12:06.108 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi070.front.sepia.ceph.com 2023-11-16T02:12:06.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T02:12:06.183 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi204.front.sepia.ceph.com 2023-11-16T02:12:06.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T02:12:06.254 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-16T02:12:06.259 DEBUG:teuthology.orchestra.run.smithi028:> uname -m 2023-11-16T02:12:06.265 INFO:teuthology.orchestra.run.smithi028.stdout:x86_64 2023-11-16T02:12:06.265 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release 2023-11-16T02:12:06.311 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-16T02:12:06.311 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="Ubuntu" 2023-11-16T02:12:06.311 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="22.04" 2023-11-16T02:12:06.311 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-16T02:12:06.311 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_CODENAME=jammy 2023-11-16T02:12:06.311 INFO:teuthology.orchestra.run.smithi028.stdout:ID=ubuntu 2023-11-16T02:12:06.312 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE=debian 2023-11-16T02:12:06.312 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-16T02:12:06.312 INFO:teuthology.orchestra.run.smithi028.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-16T02:12:06.312 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-16T02:12:06.312 INFO:teuthology.orchestra.run.smithi028.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-16T02:12:06.312 INFO:teuthology.orchestra.run.smithi028.stdout:UBUNTU_CODENAME=jammy 2023-11-16T02:12:06.313 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server 2023-11-16T02:12:06.337 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2023-11-16T02:12:06.342 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2023-11-16T02:12:06.342 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2023-11-16T02:12:06.392 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-16T02:12:06.392 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="Ubuntu" 2023-11-16T02:12:06.393 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="22.04" 2023-11-16T02:12:06.393 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-16T02:12:06.393 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_CODENAME=jammy 2023-11-16T02:12:06.394 INFO:teuthology.orchestra.run.smithi070.stdout:ID=ubuntu 2023-11-16T02:12:06.394 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE=debian 2023-11-16T02:12:06.394 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-16T02:12:06.394 INFO:teuthology.orchestra.run.smithi070.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-16T02:12:06.394 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-16T02:12:06.394 INFO:teuthology.orchestra.run.smithi070.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-16T02:12:06.394 INFO:teuthology.orchestra.run.smithi070.stdout:UBUNTU_CODENAME=jammy 2023-11-16T02:12:06.394 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2023-11-16T02:12:06.414 DEBUG:teuthology.orchestra.run.smithi204:> uname -m 2023-11-16T02:12:06.419 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2023-11-16T02:12:06.420 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2023-11-16T02:12:06.467 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-16T02:12:06.467 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="Ubuntu" 2023-11-16T02:12:06.467 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="22.04" 2023-11-16T02:12:06.467 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-16T02:12:06.467 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_CODENAME=jammy 2023-11-16T02:12:06.467 INFO:teuthology.orchestra.run.smithi204.stdout:ID=ubuntu 2023-11-16T02:12:06.467 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE=debian 2023-11-16T02:12:06.467 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-16T02:12:06.467 INFO:teuthology.orchestra.run.smithi204.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-16T02:12:06.467 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-16T02:12:06.467 INFO:teuthology.orchestra.run.smithi204.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-16T02:12:06.468 INFO:teuthology.orchestra.run.smithi204.stdout:UBUNTU_CODENAME=jammy 2023-11-16T02:12:06.468 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2023-11-16T02:12:06.487 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-16T02:12:06.495 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-16T02:12:06.503 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-16T02:12:06.503 DEBUG:teuthology.orchestra.run.smithi028:> test '!' -e /home/ubuntu/cephtest 2023-11-16T02:12:06.505 DEBUG:teuthology.orchestra.run.smithi070:> test '!' -e /home/ubuntu/cephtest 2023-11-16T02:12:06.507 DEBUG:teuthology.orchestra.run.smithi204:> test '!' -e /home/ubuntu/cephtest 2023-11-16T02:12:06.515 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-16T02:12:06.522 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-16T02:12:06.522 DEBUG:teuthology.orchestra.run.smithi028:> test -z $(ls -A /var/lib/ceph) 2023-11-16T02:12:06.552 DEBUG:teuthology.orchestra.run.smithi070:> test -z $(ls -A /var/lib/ceph) 2023-11-16T02:12:06.555 DEBUG:teuthology.orchestra.run.smithi204:> test -z $(ls -A /var/lib/ceph) 2023-11-16T02:12:06.568 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-16T02:12:06.641 INFO:teuthology.run_tasks:Running task kernel... 2023-11-16T02:12:06.655 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-11-16T02:12:06.655 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-11-16T02:12:06.655 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-11-16T02:12:06.655 DEBUG:teuthology.orchestra.run.smithi204:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-16T02:12:06.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-16T02:12:06.660 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-11-16T02:12:06.871 DEBUG:teuthology.task.kernel:sha1 for client.0 is 3b796cfe2969fb2f2d017e8146dccc1ef582e837 2023-11-16T02:12:06.872 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "3b796cfe2969fb2f2d017e8146dccc1ef582e837"... 2023-11-16T02:12:06.872 DEBUG:teuthology.orchestra.run.smithi204:> uname -r 2023-11-16T02:12:06.877 INFO:teuthology.orchestra.run.smithi204.stdout:5.15.0-56-generic 2023-11-16T02:12:06.878 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 3b796cfe2969fb2f2d017e8146dccc1ef582e837 2023-11-16T02:12:06.878 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-16T02:12:06.878 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-11-16T02:12:06.879 DEBUG:teuthology.orchestra.run.smithi204:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-16T02:12:06.936 INFO:teuthology.orchestra.run.smithi204.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-16T02:12:07.057 INFO:teuthology.orchestra.run.smithi204.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-16T02:12:07.057 INFO:teuthology.orchestra.run.smithi204.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-16T02:12:07.057 INFO:teuthology.orchestra.run.smithi204.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-16T02:12:07.057 INFO:teuthology.orchestra.run.smithi204.stderr:hint: 2023-11-16T02:12:07.057 INFO:teuthology.orchestra.run.smithi204.stderr:hint: git config --global init.defaultBranch 2023-11-16T02:12:07.057 INFO:teuthology.orchestra.run.smithi204.stderr:hint: 2023-11-16T02:12:07.057 INFO:teuthology.orchestra.run.smithi204.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-16T02:12:07.057 INFO:teuthology.orchestra.run.smithi204.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-16T02:12:07.057 INFO:teuthology.orchestra.run.smithi204.stderr:hint: 2023-11-16T02:12:07.057 INFO:teuthology.orchestra.run.smithi204.stderr:hint: git branch -m 2023-11-16T02:12:07.061 INFO:teuthology.orchestra.run.smithi204.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-16T02:12:07.061 DEBUG:teuthology.orchestra.run.smithi204:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-16T02:12:07.129 DEBUG:teuthology.orchestra.run.smithi204:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-16T02:12:07.182 DEBUG:teuthology.orchestra.run.smithi204:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-16T02:13:40.099 INFO:teuthology.orchestra.run.smithi204.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-16T02:13:40.099 INFO:teuthology.orchestra.run.smithi204.stderr: * [new branch] main -> origin/main 2023-11-16T02:13:40.130 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20190312 -> 20190312 2023-11-16T02:13:40.130 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20190416 -> 20190416 2023-11-16T02:13:40.131 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20190514 -> 20190514 2023-11-16T02:13:40.131 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20190618 -> 20190618 2023-11-16T02:13:40.131 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20190717 -> 20190717 2023-11-16T02:13:40.132 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20190815 -> 20190815 2023-11-16T02:13:40.132 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20190923 -> 20190923 2023-11-16T02:13:40.132 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20191022 -> 20191022 2023-11-16T02:13:40.132 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20191215 -> 20191215 2023-11-16T02:13:40.132 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20200122 -> 20200122 2023-11-16T02:13:40.132 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20200316 -> 20200316 2023-11-16T02:13:40.133 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20200421 -> 20200421 2023-11-16T02:13:40.133 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20200519 -> 20200519 2023-11-16T02:13:40.133 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20200619 -> 20200619 2023-11-16T02:13:40.133 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20200721 -> 20200721 2023-11-16T02:13:40.133 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20200817 -> 20200817 2023-11-16T02:13:40.134 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20200918 -> 20200918 2023-11-16T02:13:40.134 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20201022 -> 20201022 2023-11-16T02:13:40.134 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20201118 -> 20201118 2023-11-16T02:13:40.135 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20201218 -> 20201218 2023-11-16T02:13:40.135 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20210208 -> 20210208 2023-11-16T02:13:40.135 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20210315 -> 20210315 2023-11-16T02:13:40.135 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20210511 -> 20210511 2023-11-16T02:13:40.135 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20210716 -> 20210716 2023-11-16T02:13:40.135 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20210818 -> 20210818 2023-11-16T02:13:40.135 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20210919 -> 20210919 2023-11-16T02:13:40.135 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20211027 -> 20211027 2023-11-16T02:13:40.135 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20211216 -> 20211216 2023-11-16T02:13:40.136 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20220209 -> 20220209 2023-11-16T02:13:40.137 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20220310 -> 20220310 2023-11-16T02:13:40.137 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20220411 -> 20220411 2023-11-16T02:13:40.137 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20220509 -> 20220509 2023-11-16T02:13:40.137 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20220610 -> 20220610 2023-11-16T02:13:40.137 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20220708 -> 20220708 2023-11-16T02:13:40.137 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20220815 -> 20220815 2023-11-16T02:13:40.137 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20220913 -> 20220913 2023-11-16T02:13:40.137 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20221012 -> 20221012 2023-11-16T02:13:40.138 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20221109 -> 20221109 2023-11-16T02:13:40.138 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20221214 -> 20221214 2023-11-16T02:13:40.138 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20230117 -> 20230117 2023-11-16T02:13:40.139 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20230210 -> 20230210 2023-11-16T02:13:40.139 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20230310 -> 20230310 2023-11-16T02:13:40.139 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20230404 -> 20230404 2023-11-16T02:13:40.139 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20230515 -> 20230515 2023-11-16T02:13:40.139 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20230625 -> 20230625 2023-11-16T02:13:40.139 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20230804 -> 20230804 2023-11-16T02:13:40.140 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20230919 -> 20230919 2023-11-16T02:13:40.140 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20231030 -> 20231030 2023-11-16T02:13:40.140 INFO:teuthology.orchestra.run.smithi204.stderr: * [new tag] 20231111 -> 20231111 2023-11-16T02:13:44.075 INFO:teuthology.orchestra.run.smithi204.stderr:Updating files: 51% (1642/3206) Updating files: 52% (1668/3206) Updating files: 53% (1700/3206) Updating files: 54% (1732/3206) Updating files: 55% (1764/3206) Updating files: 56% (1796/3206) Updating files: 57% (1828/3206) Updating files: 58% (1860/3206) Updating files: 59% (1892/3206) Updating files: 60% (1924/3206) Updating files: 61% (1956/3206) Updating files: 62% (1988/3206) Updating files: 63% (2020/3206) Updating files: 64% (2052/3206) Updating files: 65% (2084/3206) Updating files: 66% (2116/3206) Updating files: 66% (2127/3206) Updating files: 67% (2149/3206) Updating files: 68% (2181/3206) Updating files: 69% (2213/3206) Updating files: 70% (2245/3206) Updating files: 71% (2277/3206) Updating files: 72% (2309/3206) Updating files: 73% (2341/3206) Updating files: 74% (2373/3206) Updating files: 75% (2405/3206) Updating files: 76% (2437/3206) Updating files: 77% (2469/3206) Updating files: 78% (2501/3206) Updating files: 79% (2533/3206) Updating files: 80% (2565/3206) Updating files: 81% (2597/3206) Updating files: 81% (2611/3206) Updating files: 82% (2629/3206) Updating files: 83% (2661/3206) Updating files: 84% (2694/3206) Updating files: 85% (2726/3206) Updating files: 86% (2758/3206) Updating files: 87% (2790/3206) Updating files: 88% (2822/3206) Updating files: 89% (2854/3206) Updating files: 90% (2886/3206) Updating files: 91% (2918/3206) Updating files: 92% (2950/3206) Updating files: 93% (2982/3206) Updating files: 94% (3014/3206) Updating files: 95% (3046/3206) Updating files: 96% (3078/3206) Updating files: 97% (3110/3206) Updating files: 98% (3142/3206) Updating files: 99% (3174/3206) Updating files: 100% (3206/3206) Updating files: 100% (3206/3206), done. 2023-11-16T02:13:44.079 INFO:teuthology.orchestra.run.smithi204.stdout:HEAD is now at 124b6639 Merge branch 'robot/pr-0-1700068965' into 'main' 2023-11-16T02:13:44.100 INFO:teuthology.task.kernel:Downloading kernel 3b796cfe2969fb2f2d017e8146dccc1ef582e837 on client.0... 2023-11-16T02:13:44.101 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3b796cfe2969fb2f2d017e8146dccc1ef582e837 2023-11-16T02:13:44.326 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/3b796cfe2969fb2f2d017e8146dccc1ef582e837/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-rc5-g3b796cfe2969/ 2023-11-16T02:13:44.327 DEBUG:teuthology.orchestra.run.smithi204:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-rc5-g3b796cfe2969_6.6.0-rc5-g3b796cfe2969-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/3b796cfe2969fb2f2d017e8146dccc1ef582e837/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-rc5-g3b796cfe2969/ --input-file=- 2023-11-16T02:13:44.329 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi204.front.sepia.ceph.com to complete... 2023-11-16T02:13:46.031 INFO:teuthology.orchestra.run.smithi204.stderr:2023-11-16 02:13:45 URL:https://3.chacra.ceph.com/r/kernel/testing/3b796cfe2969fb2f2d017e8146dccc1ef582e837/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-rc5-g3b796cfe2969/linux-image-6.6.0-rc5-g3b796cfe2969_6.6.0-rc5-g3b796cfe2969-1_amd64.deb [38913244/38913244] -> "/tmp/linux-image.deb" [1] 2023-11-16T02:13:46.031 INFO:teuthology.orchestra.run.smithi204.stderr:FINISHED --2023-11-16 02:13:45-- 2023-11-16T02:13:46.031 INFO:teuthology.orchestra.run.smithi204.stderr:Total wall clock time: 1.7s 2023-11-16T02:13:46.031 INFO:teuthology.orchestra.run.smithi204.stderr:Downloaded: 1 files, 37M in 1.5s (25.1 MB/s) 2023-11-16T02:13:46.031 INFO:teuthology.task.kernel:Installing kernel 3b796cfe2969fb2f2d017e8146dccc1ef582e837 on client.0... 2023-11-16T02:13:46.032 DEBUG:teuthology.orchestra.run.smithi204:> sudo dpkg -i /tmp/linux-image.deb 2023-11-16T02:13:46.247 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package linux-image-6.6.0-rc5-g3b796cfe2969. 2023-11-16T02:13:48.234 INFO:teuthology.orchestra.run.smithi204.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-16T02:13:48.238 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-16T02:13:48.325 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-image-6.6.0-rc5-g3b796cfe2969 (6.6.0-rc5-g3b796cfe2969-1) ... 2023-11-16T02:13:51.540 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-image-6.6.0-rc5-g3b796cfe2969 (6.6.0-rc5-g3b796cfe2969-1) ... 2023-11-16T02:13:51.653 INFO:teuthology.orchestra.run.smithi204.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-rc5-g3b796cfe2969 2023-11-16T02:14:12.129 INFO:teuthology.orchestra.run.smithi204.stderr:Sourcing file `/etc/default/grub' 2023-11-16T02:14:12.143 INFO:teuthology.orchestra.run.smithi204.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-16T02:14:12.159 INFO:teuthology.orchestra.run.smithi204.stderr:Generating grub configuration file ... 2023-11-16T02:14:12.468 INFO:teuthology.orchestra.run.smithi204.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g3b796cfe2969 2023-11-16T02:14:12.485 INFO:teuthology.orchestra.run.smithi204.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g3b796cfe2969 2023-11-16T02:14:12.780 INFO:teuthology.orchestra.run.smithi204.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-16T02:14:12.791 INFO:teuthology.orchestra.run.smithi204.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-16T02:14:12.860 INFO:teuthology.orchestra.run.smithi204.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-16T02:14:12.867 INFO:teuthology.orchestra.run.smithi204.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-16T02:14:13.037 INFO:teuthology.orchestra.run.smithi204.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-16T02:14:13.038 INFO:teuthology.orchestra.run.smithi204.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-16T02:14:13.038 INFO:teuthology.orchestra.run.smithi204.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-16T02:14:13.082 INFO:teuthology.orchestra.run.smithi204.stderr:done 2023-11-16T02:14:13.265 DEBUG:teuthology.orchestra.run.smithi204:> dpkg-deb -c /tmp/linux-image.deb 2023-11-16T02:14:13.273 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./ 2023-11-16T02:14:13.273 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./boot/ 2023-11-16T02:14:13.274 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 4415097 2023-11-07 03:18 ./boot/System.map-6.6.0-rc5-g3b796cfe2969 2023-11-16T02:14:13.286 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 169233 2023-11-07 03:18 ./boot/config-6.6.0-rc5-g3b796cfe2969 2023-11-16T02:14:13.286 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11352928 2023-11-07 03:18 ./boot/vmlinuz-6.6.0-rc5-g3b796cfe2969 2023-11-16T02:14:13.305 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./etc/ 2023-11-16T02:14:13.305 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./etc/kernel/ 2023-11-16T02:14:13.305 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./etc/kernel/postinst.d/ 2023-11-16T02:14:13.306 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./etc/kernel/postrm.d/ 2023-11-16T02:14:13.306 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./etc/kernel/preinst.d/ 2023-11-16T02:14:13.306 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./etc/kernel/prerm.d/ 2023-11-16T02:14:13.306 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/ 2023-11-16T02:14:13.306 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/ 2023-11-16T02:14:13.307 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/ 2023-11-16T02:14:13.307 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/ 2023-11-16T02:14:13.307 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/ 2023-11-16T02:14:13.307 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/ 2023-11-16T02:14:13.308 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/ 2023-11-16T02:14:13.308 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 490233 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-16T02:14:13.308 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 25329 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-16T02:14:13.308 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 29529 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-16T02:14:13.309 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 30313 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-16T02:14:13.309 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 93113 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-16T02:14:13.309 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 106729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-16T02:14:13.309 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 152241 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-16T02:14:13.311 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12553 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-16T02:14:13.311 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13777 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-16T02:14:13.312 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 83889 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-16T02:14:13.312 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18625 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-16T02:14:13.312 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 47225 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-16T02:14:13.313 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 47209 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-16T02:14:13.313 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 51801 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-16T02:14:13.313 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 38937 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-16T02:14:13.313 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 40529 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-16T02:14:13.313 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 58585 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-16T02:14:13.314 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 50497 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-16T02:14:13.314 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 32065 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-16T02:14:13.314 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13625 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-16T02:14:13.314 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kernel/ 2023-11-16T02:14:13.314 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kernel/cpu/ 2023-11-16T02:14:13.314 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kernel/cpu/mce/ 2023-11-16T02:14:13.315 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 40113 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-16T02:14:13.315 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13353 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kernel/cpuid.ko 2023-11-16T02:14:13.315 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17937 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kernel/msr.ko 2023-11-16T02:14:13.315 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kvm/ 2023-11-16T02:14:13.315 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 353761 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-16T02:14:13.316 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 881713 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-16T02:14:13.316 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 2276817 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/arch/x86/kvm/kvm.ko 2023-11-16T02:14:13.330 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/ 2023-11-16T02:14:13.330 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 53761 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/af_alg.ko 2023-11-16T02:14:13.331 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23097 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/algif_hash.ko 2023-11-16T02:14:13.331 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20049 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/algif_skcipher.ko 2023-11-16T02:14:13.331 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17209 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/ansi_cprng.ko 2023-11-16T02:14:13.331 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19641 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/anubis.ko 2023-11-16T02:14:13.331 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10145 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/arc4.ko 2023-11-16T02:14:13.331 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/asymmetric_keys/ 2023-11-16T02:14:13.331 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10185 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-16T02:14:13.331 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/async_tx/ 2023-11-16T02:14:13.331 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11249 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/async_tx/async_memcpy.ko 2023-11-16T02:14:13.331 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19473 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/async_tx/async_pq.ko 2023-11-16T02:14:13.331 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21561 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-16T02:14:13.332 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13825 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/async_tx/async_tx.ko 2023-11-16T02:14:13.332 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17745 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/async_tx/async_xor.ko 2023-11-16T02:14:13.332 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17921 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/async_tx/raid6test.ko 2023-11-16T02:14:13.332 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20489 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/authenc.ko 2023-11-16T02:14:13.332 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22641 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/authencesn.ko 2023-11-16T02:14:13.332 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21817 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/blake2b_generic.ko 2023-11-16T02:14:13.332 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/blowfish_common.ko 2023-11-16T02:14:13.332 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10537 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/blowfish_generic.ko 2023-11-16T02:14:13.332 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 38873 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/camellia_generic.ko 2023-11-16T02:14:13.332 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 27321 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/cast5_generic.ko 2023-11-16T02:14:13.332 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17745 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/cast6_generic.ko 2023-11-16T02:14:13.332 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10537 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/cast_common.ko 2023-11-16T02:14:13.332 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 35097 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/ccm.ko 2023-11-16T02:14:13.333 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14769 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/cmac.ko 2023-11-16T02:14:13.333 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9585 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/crc32_generic.ko 2023-11-16T02:14:13.333 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 47505 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/cryptd.ko 2023-11-16T02:14:13.333 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 39505 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/crypto_engine.ko 2023-11-16T02:14:13.333 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26953 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/crypto_simd.ko 2023-11-16T02:14:13.333 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24737 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/crypto_user.ko 2023-11-16T02:14:13.333 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/cts.ko 2023-11-16T02:14:13.333 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10913 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/des_generic.ko 2023-11-16T02:14:13.333 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15681 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/dh_generic.ko 2023-11-16T02:14:13.334 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11001 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/echainiv.ko 2023-11-16T02:14:13.334 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 25321 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/essiv.ko 2023-11-16T02:14:13.334 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17993 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/fcrypt.ko 2023-11-16T02:14:13.334 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26897 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/khazad.ko 2023-11-16T02:14:13.334 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15649 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/lrw.ko 2023-11-16T02:14:13.334 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11513 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/lz4.ko 2023-11-16T02:14:13.334 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11529 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/lz4hc.ko 2023-11-16T02:14:13.334 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11761 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/md4.ko 2023-11-16T02:14:13.334 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/michael_mic.ko 2023-11-16T02:14:13.334 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10673 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/pcbc.ko 2023-11-16T02:14:13.334 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18745 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/pcrypt.ko 2023-11-16T02:14:13.334 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16049 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/rmd160.ko 2023-11-16T02:14:13.335 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 29393 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/seed.ko 2023-11-16T02:14:13.335 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 27081 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/serpent_generic.ko 2023-11-16T02:14:13.335 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 149193 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/tcrypt.ko 2023-11-16T02:14:13.335 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10881 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/tea.ko 2023-11-16T02:14:13.335 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28777 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/twofish_common.ko 2023-11-16T02:14:13.335 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13233 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/twofish_generic.ko 2023-11-16T02:14:13.335 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17401 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/vmac.ko 2023-11-16T02:14:13.335 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 36185 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/wp512.ko 2023-11-16T02:14:13.335 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14105 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/xcbc.ko 2023-11-16T02:14:13.335 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26665 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/xor.ko 2023-11-16T02:14:13.335 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18713 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/xts.ko 2023-11-16T02:14:13.335 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9481 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/crypto/xxhash_generic.ko 2023-11-16T02:14:13.335 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ 2023-11-16T02:14:13.336 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/ 2023-11-16T02:14:13.336 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18249 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/acpi_extlog.ko 2023-11-16T02:14:13.336 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26985 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-16T02:14:13.336 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28793 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/acpi_pad.ko 2023-11-16T02:14:13.336 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/apei/ 2023-11-16T02:14:13.336 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 31241 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/apei/einj.ko 2023-11-16T02:14:13.336 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12801 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/ec_sys.ko 2023-11-16T02:14:13.336 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14937 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/platform_profile.ko 2023-11-16T02:14:13.336 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24401 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/sbs.ko 2023-11-16T02:14:13.336 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19521 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/sbshc.ko 2023-11-16T02:14:13.336 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 103025 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/acpi/video.ko 2023-11-16T02:14:13.336 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/ 2023-11-16T02:14:13.337 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21601 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/acard-ahci.ko 2023-11-16T02:14:13.337 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 88865 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/ahci.ko 2023-11-16T02:14:13.337 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/ahci_platform.ko 2023-11-16T02:14:13.337 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 88289 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/libahci.ko 2023-11-16T02:14:13.337 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 34985 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/libahci_platform.ko 2023-11-16T02:14:13.337 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17137 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_acpi.ko 2023-11-16T02:14:13.337 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 30497 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_ali.ko 2023-11-16T02:14:13.337 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 33569 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_amd.ko 2023-11-16T02:14:13.337 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21265 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_artop.ko 2023-11-16T02:14:13.337 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21121 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_atiixp.ko 2023-11-16T02:14:13.337 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24945 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_atp867x.ko 2023-11-16T02:14:13.337 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17721 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_cmd640.ko 2023-11-16T02:14:13.338 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 25249 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_cmd64x.ko 2023-11-16T02:14:13.338 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15049 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_cypress.ko 2023-11-16T02:14:13.338 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17849 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_efar.ko 2023-11-16T02:14:13.338 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21945 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_hpt366.ko 2023-11-16T02:14:13.338 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 33977 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_hpt37x.ko 2023-11-16T02:14:13.338 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23129 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-16T02:14:13.338 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16921 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-16T02:14:13.338 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16993 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_it8213.ko 2023-11-16T02:14:13.338 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 35273 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_it821x.ko 2023-11-16T02:14:13.338 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12889 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_jmicron.ko 2023-11-16T02:14:13.338 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 51481 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_legacy.ko 2023-11-16T02:14:13.338 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15185 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_marvell.ko 2023-11-16T02:14:13.339 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16281 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_mpiix.ko 2023-11-16T02:14:13.339 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12833 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_netcell.ko 2023-11-16T02:14:13.339 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16817 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_ninja32.ko 2023-11-16T02:14:13.339 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15105 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_ns87410.ko 2023-11-16T02:14:13.339 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17361 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_ns87415.ko 2023-11-16T02:14:13.339 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16569 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_oldpiix.ko 2023-11-16T02:14:13.339 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15377 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_opti.ko 2023-11-16T02:14:13.339 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20681 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_optidma.ko 2023-11-16T02:14:13.339 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 32585 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_pcmcia.ko 2023-11-16T02:14:13.339 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 37793 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-16T02:14:13.339 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20561 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-16T02:14:13.339 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14225 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_piccolo.ko 2023-11-16T02:14:13.339 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15449 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_radisys.ko 2023-11-16T02:14:13.340 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19521 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_rdc.ko 2023-11-16T02:14:13.340 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15329 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_rz1000.ko 2023-11-16T02:14:13.340 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13937 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_sch.ko 2023-11-16T02:14:13.340 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23097 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_serverworks.ko 2023-11-16T02:14:13.340 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23457 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_sil680.ko 2023-11-16T02:14:13.340 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19697 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_sl82c105.ko 2023-11-16T02:14:13.340 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16009 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_triflex.ko 2023-11-16T02:14:13.340 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 30497 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pata_via.ko 2023-11-16T02:14:13.340 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22793 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/pdc_adma.ko 2023-11-16T02:14:13.340 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 29121 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_inic162x.ko 2023-11-16T02:14:13.340 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 83345 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_mv.ko 2023-11-16T02:14:13.340 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 70393 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_nv.ko 2023-11-16T02:14:13.341 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 37377 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_promise.ko 2023-11-16T02:14:13.341 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23041 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_qstor.ko 2023-11-16T02:14:13.341 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 29273 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_sil.ko 2023-11-16T02:14:13.341 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 38337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_sil24.ko 2023-11-16T02:14:13.341 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17945 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_sis.ko 2023-11-16T02:14:13.341 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20441 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_svw.ko 2023-11-16T02:14:13.341 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 44793 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_sx4.ko 2023-11-16T02:14:13.341 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15601 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_uli.ko 2023-11-16T02:14:13.341 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 35065 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_via.ko 2023-11-16T02:14:13.341 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20065 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ata/sata_vsc.ko 2023-11-16T02:14:13.341 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/auxdisplay/ 2023-11-16T02:14:13.341 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16289 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/auxdisplay/ks0108.ko 2023-11-16T02:14:13.341 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/bcma/ 2023-11-16T02:14:13.342 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 124473 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/bcma/bcma.ko 2023-11-16T02:14:13.342 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/ 2023-11-16T02:14:13.342 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/aoe/ 2023-11-16T02:14:13.342 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 113665 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/aoe/aoe.ko 2023-11-16T02:14:13.342 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/drbd/ 2023-11-16T02:14:13.342 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 965585 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/drbd/drbd.ko 2023-11-16T02:14:13.342 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 173225 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/floppy.ko 2023-11-16T02:14:13.342 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/mtip32xx/ 2023-11-16T02:14:13.342 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 94297 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-16T02:14:13.342 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 115793 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/nbd.ko 2023-11-16T02:14:13.342 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/null_blk/ 2023-11-16T02:14:13.342 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 110449 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/null_blk/null_blk.ko 2023-11-16T02:14:13.343 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 98193 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/pktcdvd.ko 2023-11-16T02:14:13.343 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 263769 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/rbd.ko 2023-11-16T02:14:13.343 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/xen-blkback/ 2023-11-16T02:14:13.343 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 98145 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-16T02:14:13.343 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/zram/ 2023-11-16T02:14:13.343 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 60217 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/block/zram/zram.ko 2023-11-16T02:14:13.343 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ 2023-11-16T02:14:13.343 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 30705 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/applicom.ko 2023-11-16T02:14:13.343 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12009 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/hangcheck-timer.ko 2023-11-16T02:14:13.343 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/hw_random/ 2023-11-16T02:14:13.343 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13889 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-16T02:14:13.343 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18809 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-16T02:14:13.344 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13169 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-16T02:14:13.344 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10673 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/hw_random/via-rng.ko 2023-11-16T02:14:13.344 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15633 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-16T02:14:13.344 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ipmi/ 2023-11-16T02:14:13.344 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 30713 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-16T02:14:13.344 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 148601 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-16T02:14:13.344 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26569 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-16T02:14:13.344 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 139313 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-16T02:14:13.344 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 70921 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-16T02:14:13.344 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 53513 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-16T02:14:13.344 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 36321 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/lp.ko 2023-11-16T02:14:13.344 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/mwave/ 2023-11-16T02:14:13.344 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 84097 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/mwave/mwave.ko 2023-11-16T02:14:13.345 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 25873 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/nvram.ko 2023-11-16T02:14:13.345 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 32169 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/ppdev.ko 2023-11-16T02:14:13.345 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 51113 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tlclk.ko 2023-11-16T02:14:13.345 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tpm/ 2023-11-16T02:14:13.345 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16401 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-16T02:14:13.345 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15881 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-16T02:14:13.345 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23473 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-16T02:14:13.345 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 32985 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-16T02:14:13.345 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 30121 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-16T02:14:13.346 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22697 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-16T02:14:13.346 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23561 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-16T02:14:13.346 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/xillybus/ 2023-11-16T02:14:13.346 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17001 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-16T02:14:13.346 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 50945 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-16T02:14:13.346 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12393 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-16T02:14:13.346 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/clk/ 2023-11-16T02:14:13.346 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12489 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/clk/clk-palmas.ko 2023-11-16T02:14:13.346 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 47849 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/clk/clk-si5351.ko 2023-11-16T02:14:13.346 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11457 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/clk/clk-twl6040.ko 2023-11-16T02:14:13.346 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19313 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/clk/clk-wm831x.ko 2023-11-16T02:14:13.346 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/cpufreq/ 2023-11-16T02:14:13.347 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10097 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-16T02:14:13.347 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16833 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-16T02:14:13.347 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 25297 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-16T02:14:13.347 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/ 2023-11-16T02:14:13.347 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/ccp/ 2023-11-16T02:14:13.347 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 70801 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-16T02:14:13.347 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 243025 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/ccp/ccp.ko 2023-11-16T02:14:13.347 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/intel/ 2023-11-16T02:14:13.347 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/intel/qat/ 2023-11-16T02:14:13.347 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-16T02:14:13.347 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 438761 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-16T02:14:13.347 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-16T02:14:13.347 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24081 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-16T02:14:13.348 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19937 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/padlock-aes.ko 2023-11-16T02:14:13.348 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21537 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/padlock-sha.ko 2023-11-16T02:14:13.348 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/virtio/ 2023-11-16T02:14:13.348 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 68857 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-16T02:14:13.348 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/dca/ 2023-11-16T02:14:13.348 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 29785 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/dca/dca.ko 2023-11-16T02:14:13.348 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/dma/ 2023-11-16T02:14:13.348 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/dma/dw/ 2023-11-16T02:14:13.348 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15857 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-16T02:14:13.348 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/dma/ioat/ 2023-11-16T02:14:13.348 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 122569 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-16T02:14:13.348 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/ 2023-11-16T02:14:13.349 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 79953 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/amd64_edac.ko 2023-11-16T02:14:13.396 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 35769 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/e752x_edac.ko 2023-11-16T02:14:13.397 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 63617 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/edac_mce_amd.ko 2023-11-16T02:14:13.397 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18105 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/i3000_edac.ko 2023-11-16T02:14:13.397 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18065 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/i3200_edac.ko 2023-11-16T02:14:13.397 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22537 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/i5100_edac.ko 2023-11-16T02:14:13.397 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 25657 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/i5400_edac.ko 2023-11-16T02:14:13.397 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24913 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/i7300_edac.ko 2023-11-16T02:14:13.397 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 52041 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/i7core_edac.ko 2023-11-16T02:14:13.397 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18433 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/i82975x_edac.ko 2023-11-16T02:14:13.397 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20017 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/ie31200_edac.ko 2023-11-16T02:14:13.397 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 56825 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/sb_edac.ko 2023-11-16T02:14:13.398 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17529 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/edac/x38_edac.ko 2023-11-16T02:14:13.398 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/extcon/ 2023-11-16T02:14:13.398 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12673 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/extcon/extcon-gpio.ko 2023-11-16T02:14:13.398 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 27185 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/extcon/extcon-max14577.ko 2023-11-16T02:14:13.398 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 29569 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/extcon/extcon-max77693.ko 2023-11-16T02:14:13.398 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24745 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/extcon/extcon-max8997.ko 2023-11-16T02:14:13.398 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26537 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/extcon/extcon-palmas.ko 2023-11-16T02:14:13.398 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23713 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-16T02:14:13.398 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 27785 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-16T02:14:13.398 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/firmware/ 2023-11-16T02:14:13.398 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 34977 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-16T02:14:13.398 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/firmware/efi/ 2023-11-16T02:14:13.399 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15521 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-16T02:14:13.399 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-16T02:14:13.399 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/ 2023-11-16T02:14:13.399 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12305 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-16T02:14:13.399 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20153 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-16T02:14:13.399 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14993 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-arizona.ko 2023-11-16T02:14:13.399 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13841 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-da9052.ko 2023-11-16T02:14:13.399 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11921 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-da9055.ko 2023-11-16T02:14:13.399 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22065 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-dln2.ko 2023-11-16T02:14:13.399 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 77849 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-16T02:14:13.399 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28937 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-generic.ko 2023-11-16T02:14:13.399 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19569 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-ich.ko 2023-11-16T02:14:13.400 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11969 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-16T02:14:13.400 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14113 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-kempld.ko 2023-11-16T02:14:13.400 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12537 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-16T02:14:13.400 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9505 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-max7300.ko 2023-11-16T02:14:13.400 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11969 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-max730x.ko 2023-11-16T02:14:13.400 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22073 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-max732x.ko 2023-11-16T02:14:13.400 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 25145 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-16T02:14:13.400 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 47073 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-16T02:14:13.400 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26825 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-16T02:14:13.400 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14377 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-16T02:14:13.400 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20593 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-sch.ko 2023-11-16T02:14:13.400 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19505 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-16T02:14:13.400 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12145 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-16T02:14:13.401 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21057 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-16T02:14:13.401 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11425 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-16T02:14:13.401 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20601 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-16T02:14:13.401 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15377 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-vx855.ko 2023-11-16T02:14:13.401 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16281 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-16T02:14:13.401 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11617 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-16T02:14:13.401 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16753 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-16T02:14:13.401 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/ 2023-11-16T02:14:13.401 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11577 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-a4tech.ko 2023-11-16T02:14:13.401 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 39169 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-apple.ko 2023-11-16T02:14:13.401 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14481 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-appleir.ko 2023-11-16T02:14:13.401 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8353 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-aureal.ko 2023-11-16T02:14:13.401 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15169 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-axff.ko 2023-11-16T02:14:13.402 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11049 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-belkin.ko 2023-11-16T02:14:13.402 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10313 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-cherry.ko 2023-11-16T02:14:13.402 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16041 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-chicony.ko 2023-11-16T02:14:13.402 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 60649 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-cp2112.ko 2023-11-16T02:14:13.402 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11049 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-cypress.ko 2023-11-16T02:14:13.402 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16385 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-dr.ko 2023-11-16T02:14:13.402 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10697 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-elecom.ko 2023-11-16T02:14:13.402 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17665 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-elo.ko 2023-11-16T02:14:13.402 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13457 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-emsff.ko 2023-11-16T02:14:13.402 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10105 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-ezkey.ko 2023-11-16T02:14:13.402 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14305 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-gaff.ko 2023-11-16T02:14:13.403 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9225 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-generic.ko 2023-11-16T02:14:13.403 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17129 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-gt683r.ko 2023-11-16T02:14:13.403 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12681 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-gyration.ko 2023-11-16T02:14:13.403 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10225 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-16T02:14:13.403 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10457 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-16T02:14:13.403 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14449 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-holtekff.ko 2023-11-16T02:14:13.403 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19105 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-hyperv.ko 2023-11-16T02:14:13.403 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10489 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-icade.ko 2023-11-16T02:14:13.403 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9241 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-kensington.ko 2023-11-16T02:14:13.403 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8545 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-keytouch.ko 2023-11-16T02:14:13.403 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17201 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-kye.ko 2023-11-16T02:14:13.403 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10809 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-lcpower.ko 2023-11-16T02:14:13.404 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20497 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-led.ko 2023-11-16T02:14:13.404 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 42361 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-lenovo.ko 2023-11-16T02:14:13.404 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 30761 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-lg-g15.ko 2023-11-16T02:14:13.404 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 58185 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-16T02:14:13.404 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 101369 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-16T02:14:13.404 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 80993 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-logitech.ko 2023-11-16T02:14:13.404 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 30801 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-magicmouse.ko 2023-11-16T02:14:13.404 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21969 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-microsoft.ko 2023-11-16T02:14:13.404 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10361 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-monterey.ko 2023-11-16T02:14:13.404 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 50161 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-multitouch.ko 2023-11-16T02:14:13.404 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 32593 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-ntrig.ko 2023-11-16T02:14:13.404 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8857 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-ortek.ko 2023-11-16T02:14:13.404 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9121 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-penmount.ko 2023-11-16T02:14:13.405 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12289 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-petalynx.ko 2023-11-16T02:14:13.405 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 72937 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-picolcd.ko 2023-11-16T02:14:13.405 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14225 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-pl.ko 2023-11-16T02:14:13.405 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15105 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-plantronics.ko 2023-11-16T02:14:13.405 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8417 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-primax.ko 2023-11-16T02:14:13.405 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 35457 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-rmi.ko 2023-11-16T02:14:13.405 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20833 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-16T02:14:13.405 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14065 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-common.ko 2023-11-16T02:14:13.405 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 31425 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-16T02:14:13.405 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 29729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-16T02:14:13.405 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 31129 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-16T02:14:13.405 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21137 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-16T02:14:13.405 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 29489 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-16T02:14:13.406 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13305 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-16T02:14:13.406 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 29313 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-16T02:14:13.406 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 27937 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-16T02:14:13.406 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19521 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-16T02:14:13.406 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-roccat.ko 2023-11-16T02:14:13.406 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13681 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-saitek.ko 2023-11-16T02:14:13.406 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15193 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-samsung.ko 2023-11-16T02:14:13.406 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 36817 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-16T02:14:13.406 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13601 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-sjoy.ko 2023-11-16T02:14:13.406 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 51249 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-sony.ko 2023-11-16T02:14:13.406 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8313 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-speedlink.ko 2023-11-16T02:14:13.406 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 25297 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-steelseries.ko 2023-11-16T02:14:13.406 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9817 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-sunplus.ko 2023-11-16T02:14:13.407 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16993 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-16T02:14:13.407 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10537 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-tivo.ko 2023-11-16T02:14:13.407 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15089 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-tmff.ko 2023-11-16T02:14:13.407 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14385 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-topseed.ko 2023-11-16T02:14:13.407 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16473 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-twinhan.ko 2023-11-16T02:14:13.407 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 71073 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-uclogic.ko 2023-11-16T02:14:13.407 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10921 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-waltop.ko 2023-11-16T02:14:13.407 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 143473 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-wiimote.ko 2023-11-16T02:14:13.407 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8153 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-xinmo.ko 2023-11-16T02:14:13.407 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13321 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-zpff.ko 2023-11-16T02:14:13.407 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16665 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid-zydacron.ko 2023-11-16T02:14:13.407 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 267825 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/hid.ko 2023-11-16T02:14:13.408 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 32321 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/uhid.ko 2023-11-16T02:14:13.408 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/usbhid/ 2023-11-16T02:14:13.408 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 125721 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-16T02:14:13.408 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19137 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-16T02:14:13.408 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14953 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-16T02:14:13.408 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 217873 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hid/wacom.ko 2023-11-16T02:14:13.408 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hv/ 2023-11-16T02:14:13.408 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 64201 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hv/hv_balloon.ko 2023-11-16T02:14:13.408 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 89625 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hv/hv_utils.ko 2023-11-16T02:14:13.408 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 305465 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hv/hv_vmbus.ko 2023-11-16T02:14:13.408 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ 2023-11-16T02:14:13.408 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 66521 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/abituguru.ko 2023-11-16T02:14:13.408 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 61393 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/abituguru3.ko 2023-11-16T02:14:13.409 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 34745 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-16T02:14:13.409 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17505 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ad7414.ko 2023-11-16T02:14:13.409 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19313 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ad7418.ko 2023-11-16T02:14:13.409 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 25257 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adc128d818.ko 2023-11-16T02:14:13.409 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 31729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adm1025.ko 2023-11-16T02:14:13.409 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 97977 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adm1026.ko 2023-11-16T02:14:13.409 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19745 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adm1029.ko 2023-11-16T02:14:13.409 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 45553 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adm1031.ko 2023-11-16T02:14:13.409 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26289 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adm9240.ko 2023-11-16T02:14:13.409 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14769 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ads7828.ko 2023-11-16T02:14:13.409 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10769 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adt7410.ko 2023-11-16T02:14:13.409 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22049 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adt7411.ko 2023-11-16T02:14:13.409 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 74433 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adt7462.ko 2023-11-16T02:14:13.410 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 39585 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adt7470.ko 2023-11-16T02:14:13.410 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 67929 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adt7475.ko 2023-11-16T02:14:13.410 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19625 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/adt7x10.ko 2023-11-16T02:14:13.410 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 39073 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/amc6821.ko 2023-11-16T02:14:13.410 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 55265 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/applesmc.ko 2023-11-16T02:14:13.410 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 49913 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/asb100.ko 2023-11-16T02:14:13.410 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 58617 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/asc7621.ko 2023-11-16T02:14:13.410 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 40889 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-16T02:14:13.410 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17225 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/atxp1.ko 2023-11-16T02:14:13.410 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28281 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/coretemp.ko 2023-11-16T02:14:13.410 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24657 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-16T02:14:13.410 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17265 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-16T02:14:13.411 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 44465 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-16T02:14:13.411 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 99601 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/dme1737.ko 2023-11-16T02:14:13.411 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19489 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ds1621.ko 2023-11-16T02:14:13.411 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15321 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ds620.ko 2023-11-16T02:14:13.411 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 29777 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/emc1403.ko 2023-11-16T02:14:13.411 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 33185 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/emc2103.ko 2023-11-16T02:14:13.411 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 30321 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/emc6w201.ko 2023-11-16T02:14:13.411 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 66985 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/f71805f.ko 2023-11-16T02:14:13.411 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 94457 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/f71882fg.ko 2023-11-16T02:14:13.411 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 41401 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/f75375s.ko 2023-11-16T02:14:13.411 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21305 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/fam15h_power.ko 2023-11-16T02:14:13.411 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 55449 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/fschmd.ko 2023-11-16T02:14:13.411 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14481 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/g760a.ko 2023-11-16T02:14:13.412 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24017 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/g762.ko 2023-11-16T02:14:13.412 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 46801 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/gl518sm.ko 2023-11-16T02:14:13.412 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 45529 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/gl520sm.ko 2023-11-16T02:14:13.412 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13273 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/hih6130.ko 2023-11-16T02:14:13.412 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9745 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-16T02:14:13.412 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11553 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/i5500_temp.ko 2023-11-16T02:14:13.412 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22601 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/i5k_amb.ko 2023-11-16T02:14:13.412 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 34529 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ibmaem.ko 2023-11-16T02:14:13.412 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21321 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ibmpex.ko 2023-11-16T02:14:13.412 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24873 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ina209.ko 2023-11-16T02:14:13.412 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13401 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ina2xx.ko 2023-11-16T02:14:13.412 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 130449 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/it87.ko 2023-11-16T02:14:13.412 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18841 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/jc42.ko 2023-11-16T02:14:13.413 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24329 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/k10temp.ko 2023-11-16T02:14:13.413 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13553 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/k8temp.ko 2023-11-16T02:14:13.413 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18929 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lineage-pem.ko 2023-11-16T02:14:13.413 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 48601 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm63.ko 2023-11-16T02:14:13.413 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16761 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm73.ko 2023-11-16T02:14:13.413 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 36777 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm75.ko 2023-11-16T02:14:13.413 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19537 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm77.ko 2023-11-16T02:14:13.413 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 34657 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm78.ko 2023-11-16T02:14:13.413 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 31745 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm80.ko 2023-11-16T02:14:13.413 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16889 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm83.ko 2023-11-16T02:14:13.413 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 72833 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm85.ko 2023-11-16T02:14:13.413 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 46153 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm87.ko 2023-11-16T02:14:13.414 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 37913 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm90.ko 2023-11-16T02:14:13.414 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19745 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm92.ko 2023-11-16T02:14:13.414 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 108841 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm93.ko 2023-11-16T02:14:13.414 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 33393 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm95234.ko 2023-11-16T02:14:13.414 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16265 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm95241.ko 2023-11-16T02:14:13.414 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18113 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/lm95245.ko 2023-11-16T02:14:13.414 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24017 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ltc2945.ko 2023-11-16T02:14:13.414 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13793 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ltc4151.ko 2023-11-16T02:14:13.414 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15193 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ltc4215.ko 2023-11-16T02:14:13.414 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14953 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ltc4222.ko 2023-11-16T02:14:13.414 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14825 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ltc4245.ko 2023-11-16T02:14:13.414 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13249 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ltc4260.ko 2023-11-16T02:14:13.414 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14993 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/ltc4261.ko 2023-11-16T02:14:13.415 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 33489 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/max16065.ko 2023-11-16T02:14:13.415 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18433 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/max1619.ko 2023-11-16T02:14:13.415 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24353 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/max1668.ko 2023-11-16T02:14:13.415 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19969 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/max197.ko 2023-11-16T02:14:13.415 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 27129 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/max6639.ko 2023-11-16T02:14:13.415 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23321 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/max6650.ko 2023-11-16T02:14:13.415 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 35777 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/max6697.ko 2023-11-16T02:14:13.415 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18585 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-16T02:14:13.415 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10585 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/mcp3021.ko 2023-11-16T02:14:13.415 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15937 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-16T02:14:13.415 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 44129 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/nct6683.ko 2023-11-16T02:14:13.415 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 119817 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/nct6775-core.ko 2023-11-16T02:14:13.416 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 60705 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/nct6775.ko 2023-11-16T02:14:13.416 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 59737 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/nct7802.ko 2023-11-16T02:14:13.416 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 82337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pc87360.ko 2023-11-16T02:14:13.416 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 54433 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pc87427.ko 2023-11-16T02:14:13.416 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18473 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pcf8591.ko 2023-11-16T02:14:13.416 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/ 2023-11-16T02:14:13.416 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21353 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-16T02:14:13.416 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17065 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-16T02:14:13.416 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28329 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-16T02:14:13.416 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9577 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-16T02:14:13.416 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17657 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-16T02:14:13.416 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10169 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-16T02:14:13.416 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15505 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-16T02:14:13.417 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 82577 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-16T02:14:13.417 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-16T02:14:13.417 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 30729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-16T02:14:13.417 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15073 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-16T02:14:13.417 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20681 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-16T02:14:13.417 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13017 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/powr1220.ko 2023-11-16T02:14:13.417 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18705 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/sch5627.ko 2023-11-16T02:14:13.417 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28817 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/sch5636.ko 2023-11-16T02:14:13.417 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 27145 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-16T02:14:13.417 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 32137 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/sht15.ko 2023-11-16T02:14:13.417 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13505 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/sht21.ko 2023-11-16T02:14:13.417 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16833 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/shtc1.ko 2023-11-16T02:14:13.418 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 40105 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/sis5595.ko 2023-11-16T02:14:13.418 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19577 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/smsc47b397.ko 2023-11-16T02:14:13.418 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 39193 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/smsc47m1.ko 2023-11-16T02:14:13.418 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 37385 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/smsc47m192.ko 2023-11-16T02:14:13.418 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26553 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/thmc50.ko 2023-11-16T02:14:13.418 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17057 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/tmp102.ko 2023-11-16T02:14:13.418 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14097 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/tmp103.ko 2023-11-16T02:14:13.418 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21257 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/tmp401.ko 2023-11-16T02:14:13.418 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19537 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/tmp421.ko 2023-11-16T02:14:13.418 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19721 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/via-cputemp.ko 2023-11-16T02:14:13.418 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 41945 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/via686a.ko 2023-11-16T02:14:13.418 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 52457 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/vt1211.ko 2023-11-16T02:14:13.419 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 51545 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/vt8231.ko 2023-11-16T02:14:13.419 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 57513 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83627ehf.ko 2023-11-16T02:14:13.419 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 78873 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83627hf.ko 2023-11-16T02:14:13.419 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 71345 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83781d.ko 2023-11-16T02:14:13.419 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 63289 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83791d.ko 2023-11-16T02:14:13.419 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 71321 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83792d.ko 2023-11-16T02:14:13.419 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 101473 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83793.ko 2023-11-16T02:14:13.419 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 119505 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83795.ko 2023-11-16T02:14:13.419 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17313 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83l785ts.ko 2023-11-16T02:14:13.419 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 35625 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/w83l786ng.ko 2023-11-16T02:14:13.419 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13825 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-16T02:14:13.419 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10625 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-16T02:14:13.419 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/ 2023-11-16T02:14:13.420 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/algos/ 2023-11-16T02:14:13.420 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20049 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-16T02:14:13.420 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19345 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-16T02:14:13.420 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/ 2023-11-16T02:14:13.420 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 27969 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-16T02:14:13.420 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28801 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-16T02:14:13.420 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 27777 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-16T02:14:13.420 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17937 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-16T02:14:13.420 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26193 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-16T02:14:13.420 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16201 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-16T02:14:13.421 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15153 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-16T02:14:13.421 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 6929 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-16T02:14:13.421 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13961 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-16T02:14:13.421 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 50201 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-16T02:14:13.421 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23905 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-16T02:14:13.421 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20001 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-16T02:14:13.421 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-16T02:14:13.421 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12497 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-16T02:14:13.421 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17585 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-16T02:14:13.421 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 62817 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-16T02:14:13.421 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22433 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-16T02:14:13.421 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 47889 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-16T02:14:13.422 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17721 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-16T02:14:13.422 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17881 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-16T02:14:13.422 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-16T02:14:13.422 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26329 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-16T02:14:13.422 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 25145 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-16T02:14:13.422 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16497 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-16T02:14:13.422 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 47241 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-16T02:14:13.422 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15289 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-16T02:14:13.422 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18649 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-16T02:14:13.422 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11809 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-16T02:14:13.422 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22313 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-16T02:14:13.423 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 29361 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-16T02:14:13.423 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20329 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-16T02:14:13.423 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19241 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-16T02:14:13.423 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19809 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-16T02:14:13.423 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13801 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-16T02:14:13.423 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26081 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-16T02:14:13.423 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19041 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-16T02:14:13.423 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 47657 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-16T02:14:13.423 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22449 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/i2c-mux.ko 2023-11-16T02:14:13.423 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18825 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/i2c-smbus.ko 2023-11-16T02:14:13.423 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 27073 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/i2c-stub.ko 2023-11-16T02:14:13.423 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/muxes/ 2023-11-16T02:14:13.423 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14921 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-16T02:14:13.424 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13457 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-16T02:14:13.424 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 29801 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-16T02:14:13.424 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ 2023-11-16T02:14:13.424 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/core/ 2023-11-16T02:14:13.424 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 273609 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-16T02:14:13.424 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 879969 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/core/ib_core.ko 2023-11-16T02:14:13.424 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 69337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-16T02:14:13.424 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 324217 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-16T02:14:13.424 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 97985 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-16T02:14:13.424 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 282273 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-16T02:14:13.424 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 66201 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-16T02:14:13.424 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/ 2023-11-16T02:14:13.425 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-16T02:14:13.425 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 493073 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-16T02:14:13.425 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/mlx4/ 2023-11-16T02:14:13.425 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 419737 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-16T02:14:13.425 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/mlx5/ 2023-11-16T02:14:13.425 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 739025 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-16T02:14:13.425 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/mthca/ 2023-11-16T02:14:13.425 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 296625 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-16T02:14:13.425 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-16T02:14:13.425 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 153697 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-16T02:14:13.425 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/usnic/ 2023-11-16T02:14:13.425 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 168969 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-16T02:14:13.425 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/ 2023-11-16T02:14:13.426 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-16T02:14:13.426 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 263081 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-16T02:14:13.426 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/iser/ 2023-11-16T02:14:13.426 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 100241 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-16T02:14:13.426 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/isert/ 2023-11-16T02:14:13.426 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 111425 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-16T02:14:13.426 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/srp/ 2023-11-16T02:14:13.426 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 128753 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-16T02:14:13.426 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/srpt/ 2023-11-16T02:14:13.426 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 129529 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-16T02:14:13.426 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/ 2023-11-16T02:14:13.426 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10745 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/evbug.ko 2023-11-16T02:14:13.427 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24129 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/ff-memless.ko 2023-11-16T02:14:13.427 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/gameport/ 2023-11-16T02:14:13.427 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11881 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-16T02:14:13.427 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12145 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-16T02:14:13.427 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 41241 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/gameport/gameport.ko 2023-11-16T02:14:13.427 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 41801 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/joydev.ko 2023-11-16T02:14:13.427 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/ 2023-11-16T02:14:13.427 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13313 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-16T02:14:13.427 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12801 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-16T02:14:13.427 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26905 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-16T02:14:13.427 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24761 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-16T02:14:13.427 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 36665 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-16T02:14:13.427 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18625 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-16T02:14:13.428 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21257 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-16T02:14:13.428 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26473 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/lm8323.ko 2023-11-16T02:14:13.428 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14409 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/lm8333.ko 2023-11-16T02:14:13.428 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24265 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-16T02:14:13.428 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18217 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-16T02:14:13.428 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15929 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-16T02:14:13.428 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16489 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-16T02:14:13.428 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11585 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-16T02:14:13.428 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10673 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-16T02:14:13.428 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14161 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/qt1070.ko 2023-11-16T02:14:13.428 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17929 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/qt2160.ko 2023-11-16T02:14:13.428 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23817 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-16T02:14:13.428 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11481 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/stowaway.ko 2023-11-16T02:14:13.429 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18289 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-16T02:14:13.429 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17489 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-16T02:14:13.429 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16177 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-16T02:14:13.429 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16801 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-16T02:14:13.429 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11753 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-16T02:14:13.429 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11465 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/matrix-keymap.ko 2023-11-16T02:14:13.429 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/ 2023-11-16T02:14:13.429 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 34329 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/appletouch.ko 2023-11-16T02:14:13.429 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 34177 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/bcm5974.ko 2023-11-16T02:14:13.429 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 123681 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/cyapatp.ko 2023-11-16T02:14:13.429 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 89449 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-16T02:14:13.429 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14025 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-16T02:14:13.430 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 335977 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/psmouse.ko 2023-11-16T02:14:13.430 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14681 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/sermouse.ko 2023-11-16T02:14:13.430 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23881 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-16T02:14:13.430 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22569 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-16T02:14:13.430 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15665 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-16T02:14:13.430 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/rmi4/ 2023-11-16T02:14:13.430 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 109873 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-16T02:14:13.430 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/ 2023-11-16T02:14:13.430 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11665 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/altera_ps2.ko 2023-11-16T02:14:13.430 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16289 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/arc_ps2.ko 2023-11-16T02:14:13.430 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16425 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/ct82c710.ko 2023-11-16T02:14:13.430 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16953 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-16T02:14:13.431 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15833 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/parkbd.ko 2023-11-16T02:14:13.431 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13225 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/pcips2.ko 2023-11-16T02:14:13.431 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20153 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/ps2mult.ko 2023-11-16T02:14:13.431 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24153 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/serio_raw.ko 2023-11-16T02:14:13.431 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17977 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/serio/serport.ko 2023-11-16T02:14:13.431 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/input/sparse-keymap.ko 2023-11-16T02:14:13.431 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/iommu/ 2023-11-16T02:14:13.431 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/iommu/amd/ 2023-11-16T02:14:13.431 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 39289 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-16T02:14:13.431 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/ 2023-11-16T02:14:13.431 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13817 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-88pm860x.ko 2023-11-16T02:14:13.431 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11385 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-adp5520.ko 2023-11-16T02:14:13.431 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 59753 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-bd2802.ko 2023-11-16T02:14:13.432 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24785 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-blinkm.ko 2023-11-16T02:14:13.432 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10473 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-da903x.ko 2023-11-16T02:14:13.432 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12241 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-da9052.ko 2023-11-16T02:14:13.432 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16561 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-gpio.ko 2023-11-16T02:14:13.432 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15793 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-lm3530.ko 2023-11-16T02:14:13.432 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 30505 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-lm3533.ko 2023-11-16T02:14:13.432 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19353 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-lm355x.ko 2023-11-16T02:14:13.432 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19961 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-lm3642.ko 2023-11-16T02:14:13.432 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16241 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-lp3944.ko 2023-11-16T02:14:13.432 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11233 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-lp8788.ko 2023-11-16T02:14:13.432 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14929 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-max8997.ko 2023-11-16T02:14:13.432 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12609 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-mc13783.ko 2023-11-16T02:14:13.432 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13385 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-16T02:14:13.433 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20721 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-pca9532.ko 2023-11-16T02:14:13.433 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20481 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-pca955x.ko 2023-11-16T02:14:13.433 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17857 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-pca963x.ko 2023-11-16T02:14:13.433 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 34433 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-ss4200.ko 2023-11-16T02:14:13.433 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24865 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-tca6507.ko 2023-11-16T02:14:13.433 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15665 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-16T02:14:13.433 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11841 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/leds-wm8350.ko 2023-11-16T02:14:13.433 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ 2023-11-16T02:14:13.433 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10049 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-16T02:14:13.433 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10873 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-16T02:14:13.433 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9089 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-16T02:14:13.433 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7617 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-16T02:14:13.433 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14249 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-16T02:14:13.434 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14073 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-16T02:14:13.434 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11889 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-16T02:14:13.434 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14073 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-16T02:14:13.434 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/ 2023-11-16T02:14:13.434 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/bcache/ 2023-11-16T02:14:13.434 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 654969 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/bcache/bcache.ko 2023-11-16T02:14:13.434 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 40577 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-bio-prison.ko 2023-11-16T02:14:13.434 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 89601 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-bufio.ko 2023-11-16T02:14:13.434 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 47529 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-cache-smq.ko 2023-11-16T02:14:13.434 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 156009 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-cache.ko 2023-11-16T02:14:13.434 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 106897 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-crypt.ko 2023-11-16T02:14:13.434 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21545 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-delay.ko 2023-11-16T02:14:13.434 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 53857 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-era.ko 2023-11-16T02:14:13.435 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28465 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-flakey.ko 2023-11-16T02:14:13.435 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 41593 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-log-userspace.ko 2023-11-16T02:14:13.435 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 32737 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-log.ko 2023-11-16T02:14:13.435 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 49545 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-mirror.ko 2023-11-16T02:14:13.435 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 78033 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-multipath.ko 2023-11-16T02:14:13.435 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16473 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-queue-length.ko 2023-11-16T02:14:13.435 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 70825 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-raid.ko 2023-11-16T02:14:13.435 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 36297 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-region-hash.ko 2023-11-16T02:14:13.435 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15873 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-round-robin.ko 2023-11-16T02:14:13.435 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16801 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-service-time.ko 2023-11-16T02:14:13.435 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 109593 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-snapshot.ko 2023-11-16T02:14:13.435 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19361 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-switch.ko 2023-11-16T02:14:13.436 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 181865 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-thin-pool.ko 2023-11-16T02:14:13.436 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 51737 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-verity.ko 2023-11-16T02:14:13.436 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8561 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/dm-zero.ko 2023-11-16T02:14:13.436 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15345 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/faulty.ko 2023-11-16T02:14:13.436 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19625 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/linear.ko 2023-11-16T02:14:13.436 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 32417 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/multipath.ko 2023-11-16T02:14:13.436 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/persistent-data/ 2023-11-16T02:14:13.436 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 199937 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-16T02:14:13.436 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 37337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/raid0.ko 2023-11-16T02:14:13.436 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 113073 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/raid1.ko 2023-11-16T02:14:13.436 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 158681 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/raid10.ko 2023-11-16T02:14:13.436 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 395721 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/md/raid456.ko 2023-11-16T02:14:13.436 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/ 2023-11-16T02:14:13.437 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/fusion/ 2023-11-16T02:14:13.437 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 178137 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/fusion/mptbase.ko 2023-11-16T02:14:13.437 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 63385 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/fusion/mptctl.ko 2023-11-16T02:14:13.437 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 44665 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/fusion/mptfc.ko 2023-11-16T02:14:13.437 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 37225 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/fusion/mptlan.ko 2023-11-16T02:14:13.437 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 123321 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/fusion/mptsas.ko 2023-11-16T02:14:13.437 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 79041 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/fusion/mptscsih.ko 2023-11-16T02:14:13.437 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 53081 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/message/fusion/mptspi.ko 2023-11-16T02:14:13.437 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/ 2023-11-16T02:14:13.437 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17305 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/88pm800.ko 2023-11-16T02:14:13.437 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12761 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/88pm805.ko 2023-11-16T02:14:13.437 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11193 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/88pm80x.ko 2023-11-16T02:14:13.437 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11865 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/arizona-i2c.ko 2023-11-16T02:14:13.438 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 123721 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/arizona.ko 2023-11-16T02:14:13.438 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11961 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/bcm590xx.ko 2023-11-16T02:14:13.438 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17465 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-16T02:14:13.438 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 34961 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/dln2.ko 2023-11-16T02:14:13.438 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16689 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/janz-cmodio.ko 2023-11-16T02:14:13.438 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 53585 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/kempld-core.ko 2023-11-16T02:14:13.438 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 27529 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/lm3533-core.ko 2023-11-16T02:14:13.438 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14993 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-16T02:14:13.438 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13009 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/lp3943.ko 2023-11-16T02:14:13.438 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 54569 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/lpc_ich.ko 2023-11-16T02:14:13.438 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12113 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/lpc_sch.ko 2023-11-16T02:14:13.438 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17409 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/max8907.ko 2023-11-16T02:14:13.439 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 29857 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-16T02:14:13.439 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11801 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-16T02:14:13.439 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11593 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/menf21bmc.ko 2023-11-16T02:14:13.439 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17329 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-16T02:14:13.439 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9153 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-16T02:14:13.439 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 34873 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/pcf50633.ko 2023-11-16T02:14:13.439 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10105 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-16T02:14:13.439 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20289 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/retu-mfd.ko 2023-11-16T02:14:13.440 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 80425 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/si476x-core.ko 2023-11-16T02:14:13.440 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 48457 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/sm501.ko 2023-11-16T02:14:13.440 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19825 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-16T02:14:13.440 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 51137 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/tps65010.ko 2023-11-16T02:14:13.440 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10417 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/tps6507x.ko 2023-11-16T02:14:13.440 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13329 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/viperboard.ko 2023-11-16T02:14:13.440 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10537 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/vx855.ko 2023-11-16T02:14:13.440 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17953 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/wl1273-core.ko 2023-11-16T02:14:13.440 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 44345 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/mfd/wm8994.ko 2023-11-16T02:14:13.440 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ 2023-11-16T02:14:13.441 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13833 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-16T02:14:13.441 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 48489 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ad525x_dpot.ko 2023-11-16T02:14:13.441 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/altera-stapl/ 2023-11-16T02:14:13.441 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 46585 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-16T02:14:13.441 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18393 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/apds9802als.ko 2023-11-16T02:14:13.441 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 36729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/apds990x.ko 2023-11-16T02:14:13.441 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 45593 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/bh1770glc.ko 2023-11-16T02:14:13.441 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/c2port/ 2023-11-16T02:14:13.441 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11145 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-16T02:14:13.441 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 35281 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/c2port/core.ko 2023-11-16T02:14:13.441 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/cb710/ 2023-11-16T02:14:13.442 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 25161 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/cb710/cb710.ko 2023-11-16T02:14:13.442 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17801 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ds1682.ko 2023-11-16T02:14:13.442 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8897 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/dummy-irq.ko 2023-11-16T02:14:13.442 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/echo/ 2023-11-16T02:14:13.442 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13657 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/echo/echo.ko 2023-11-16T02:14:13.442 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/eeprom/ 2023-11-16T02:14:13.442 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 37849 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/eeprom/at24.ko 2023-11-16T02:14:13.442 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14321 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-16T02:14:13.442 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14769 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-16T02:14:13.442 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13537 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/eeprom/max6875.ko 2023-11-16T02:14:13.442 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 33009 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/enclosure.ko 2023-11-16T02:14:13.442 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/genwqe/ 2023-11-16T02:14:13.442 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 152201 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-16T02:14:13.443 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14129 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/hmc6352.ko 2023-11-16T02:14:13.443 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 31321 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/hpilo.ko 2023-11-16T02:14:13.443 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ibmasm/ 2023-11-16T02:14:13.443 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 72129 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-16T02:14:13.443 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19785 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ics932s401.ko 2023-11-16T02:14:13.443 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21681 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/isl29003.ko 2023-11-16T02:14:13.443 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15753 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/isl29020.ko 2023-11-16T02:14:13.443 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/lis3lv02d/ 2023-11-16T02:14:13.443 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 42513 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-16T02:14:13.443 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13857 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-16T02:14:13.443 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/mei/ 2023-11-16T02:14:13.443 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 125209 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/mei/mei-me.ko 2023-11-16T02:14:13.444 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 56521 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/mei/mei-txe.ko 2023-11-16T02:14:13.444 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 310113 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/mei/mei.ko 2023-11-16T02:14:13.444 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 31329 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/phantom.ko 2023-11-16T02:14:13.444 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ti-st/ 2023-11-16T02:14:13.444 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 74265 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-16T02:14:13.444 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24305 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/tifm_7xx1.ko 2023-11-16T02:14:13.444 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28849 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/tifm_core.ko 2023-11-16T02:14:13.444 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/tsl2550.ko 2023-11-16T02:14:13.444 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 48697 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/vmw_balloon.ko 2023-11-16T02:14:13.444 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/vmw_vmci/ 2023-11-16T02:14:13.444 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 183609 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-16T02:14:13.444 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ 2023-11-16T02:14:13.444 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/bonding/ 2023-11-16T02:14:13.445 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 490129 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/bonding/bonding.ko 2023-11-16T02:14:13.445 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/dsa/ 2023-11-16T02:14:13.445 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/dsa/b53/ 2023-11-16T02:14:13.445 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 106033 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-16T02:14:13.445 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 40297 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-16T02:14:13.445 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16041 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-16T02:14:13.445 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-16T02:14:13.445 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 453737 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-16T02:14:13.445 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16929 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/dummy.ko 2023-11-16T02:14:13.445 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17961 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/eql.ko 2023-11-16T02:14:13.445 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/ 2023-11-16T02:14:13.445 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/3com/ 2023-11-16T02:14:13.446 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 45785 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-16T02:14:13.446 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 42105 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-16T02:14:13.446 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 130553 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-16T02:14:13.446 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 68849 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-16T02:14:13.446 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/8390/ 2023-11-16T02:14:13.446 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 37649 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-16T02:14:13.446 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 59689 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-16T02:14:13.446 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 27201 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-16T02:14:13.446 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 99113 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-16T02:14:13.446 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/adaptec/ 2023-11-16T02:14:13.447 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 54521 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-16T02:14:13.447 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/agere/ 2023-11-16T02:14:13.447 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 69201 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-16T02:14:13.447 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/alteon/ 2023-11-16T02:14:13.447 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 59585 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-16T02:14:13.447 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/altera/ 2023-11-16T02:14:13.447 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 41409 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-16T02:14:13.447 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/amd/ 2023-11-16T02:14:13.447 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 54609 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-16T02:14:13.447 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 49289 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-16T02:14:13.447 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 87297 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-16T02:14:13.447 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/ 2023-11-16T02:14:13.447 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-16T02:14:13.448 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 97337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-16T02:14:13.448 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-16T02:14:13.448 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 104673 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-16T02:14:13.448 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-16T02:14:13.448 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 90257 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-16T02:14:13.448 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-16T02:14:13.448 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 81569 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-16T02:14:13.448 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 69729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-16T02:14:13.448 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/ 2023-11-16T02:14:13.448 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 78401 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-16T02:14:13.448 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 176761 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-16T02:14:13.448 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-16T02:14:13.448 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 1421497 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-16T02:14:13.449 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 128569 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-16T02:14:13.449 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-16T02:14:13.449 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 132089 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-16T02:14:13.449 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 312081 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-16T02:14:13.449 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/brocade/ 2023-11-16T02:14:13.449 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-16T02:14:13.449 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 323513 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-16T02:14:13.449 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/ 2023-11-16T02:14:13.449 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-16T02:14:13.449 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 193497 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-16T02:14:13.449 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-16T02:14:13.449 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 347417 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-16T02:14:13.449 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-16T02:14:13.450 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 1044433 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-16T02:14:13.450 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-16T02:14:13.450 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 166193 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-16T02:14:13.450 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-16T02:14:13.450 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 34881 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-16T02:14:13.450 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/cisco/ 2023-11-16T02:14:13.450 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-16T02:14:13.450 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 204345 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-16T02:14:13.450 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dec/ 2023-11-16T02:14:13.450 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-16T02:14:13.450 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 69449 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-16T02:14:13.450 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 61489 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-16T02:14:13.450 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 141225 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-16T02:14:13.451 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 51497 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-16T02:14:13.451 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 62817 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-16T02:14:13.451 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 31369 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-16T02:14:13.451 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dlink/ 2023-11-16T02:14:13.451 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 60873 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-16T02:14:13.451 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 62833 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-16T02:14:13.451 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 45721 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/dnet.ko 2023-11-16T02:14:13.451 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 25185 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-16T02:14:13.451 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/emulex/ 2023-11-16T02:14:13.451 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-16T02:14:13.451 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 281137 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-16T02:14:13.451 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 49457 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/ethoc.ko 2023-11-16T02:14:13.452 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 51737 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/fealnx.ko 2023-11-16T02:14:13.452 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/fujitsu/ 2023-11-16T02:14:13.452 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 45345 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-16T02:14:13.452 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/ 2023-11-16T02:14:13.452 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 90465 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-16T02:14:13.452 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-16T02:14:13.452 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 295577 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-16T02:14:13.452 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-16T02:14:13.452 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 584497 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-16T02:14:13.452 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-16T02:14:13.452 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 246209 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-16T02:14:13.452 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-16T02:14:13.452 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 925697 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-16T02:14:13.452 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-16T02:14:13.453 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 302849 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-16T02:14:13.453 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/igb/ 2023-11-16T02:14:13.453 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 514681 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-16T02:14:13.536 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-16T02:14:13.536 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 93593 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-16T02:14:13.536 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-16T02:14:13.536 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 734305 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-16T02:14:13.537 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-16T02:14:13.537 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 151769 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-16T02:14:13.537 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 86921 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/jme.ko 2023-11-16T02:14:13.537 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/marvell/ 2023-11-16T02:14:13.538 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20977 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-16T02:14:13.538 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 102289 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-16T02:14:13.538 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 122649 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-16T02:14:13.538 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/mellanox/ 2023-11-16T02:14:13.538 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-16T02:14:13.538 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 727601 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-16T02:14:13.538 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 278937 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-16T02:14:13.538 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-16T02:14:13.538 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-16T02:14:13.539 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 1113993 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-16T02:14:13.539 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/micrel/ 2023-11-16T02:14:13.539 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 53105 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-16T02:14:13.539 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 40993 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-16T02:14:13.539 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19489 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-16T02:14:13.539 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 95665 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-16T02:14:13.539 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/myricom/ 2023-11-16T02:14:13.539 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-16T02:14:13.539 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 108649 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-16T02:14:13.539 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/natsemi/ 2023-11-16T02:14:13.539 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 73441 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-16T02:14:13.539 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 47777 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-16T02:14:13.540 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/neterion/ 2023-11-16T02:14:13.540 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 150905 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-16T02:14:13.540 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/nvidia/ 2023-11-16T02:14:13.540 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 136721 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-16T02:14:13.540 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/packetengines/ 2023-11-16T02:14:13.540 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 50481 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-16T02:14:13.540 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 43145 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-16T02:14:13.540 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/qlogic/ 2023-11-16T02:14:13.540 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-16T02:14:13.540 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 227897 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-16T02:14:13.540 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 87081 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-16T02:14:13.540 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-16T02:14:13.541 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 672049 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-16T02:14:13.541 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/rdc/ 2023-11-16T02:14:13.541 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 43017 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-16T02:14:13.541 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/realtek/ 2023-11-16T02:14:13.541 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 67385 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-16T02:14:13.541 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 83985 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-16T02:14:13.541 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 29321 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-16T02:14:13.541 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 189801 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-16T02:14:13.541 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/samsung/ 2023-11-16T02:14:13.541 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-16T02:14:13.541 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 104241 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-16T02:14:13.542 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sfc/ 2023-11-16T02:14:13.542 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 1053921 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-16T02:14:13.542 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/silan/ 2023-11-16T02:14:13.542 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 47097 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-16T02:14:13.542 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sis/ 2023-11-16T02:14:13.542 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 54817 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-16T02:14:13.542 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 63337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-16T02:14:13.542 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/smsc/ 2023-11-16T02:14:13.542 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 61601 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-16T02:14:13.542 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 67193 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-16T02:14:13.542 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 73409 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-16T02:14:13.542 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 68177 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-16T02:14:13.543 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/stmicro/ 2023-11-16T02:14:13.543 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-16T02:14:13.543 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13441 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-16T02:14:13.543 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 39905 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-16T02:14:13.543 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20657 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-16T02:14:13.543 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 486961 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-16T02:14:13.543 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sun/ 2023-11-16T02:14:13.543 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 103337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-16T02:14:13.543 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 166161 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-16T02:14:13.543 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 66329 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-16T02:14:13.543 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 78801 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-16T02:14:13.543 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/tehuti/ 2023-11-16T02:14:13.543 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 50057 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-16T02:14:13.544 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/ti/ 2023-11-16T02:14:13.544 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 86529 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-16T02:14:13.544 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/via/ 2023-11-16T02:14:13.544 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 80273 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-16T02:14:13.544 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 83633 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-16T02:14:13.544 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/wiznet/ 2023-11-16T02:14:13.544 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 46241 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-16T02:14:13.544 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 30849 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-16T02:14:13.544 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/xircom/ 2023-11-16T02:14:13.544 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 60057 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-16T02:14:13.544 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/fddi/ 2023-11-16T02:14:13.545 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 41065 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/fddi/defxx.ko 2023-11-16T02:14:13.545 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/fddi/skfp/ 2023-11-16T02:14:13.545 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 216985 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-16T02:14:13.545 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 77345 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/geneve.ko 2023-11-16T02:14:13.545 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/hyperv/ 2023-11-16T02:14:13.545 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 235521 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-16T02:14:13.545 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ieee802154/ 2023-11-16T02:14:13.545 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18273 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-16T02:14:13.545 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 25065 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ifb.ko 2023-11-16T02:14:13.545 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ipvlan/ 2023-11-16T02:14:13.545 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 83769 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-16T02:14:13.545 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 62209 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/macvlan.ko 2023-11-16T02:14:13.545 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15865 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/macvtap.ko 2023-11-16T02:14:13.546 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/mdio/ 2023-11-16T02:14:13.546 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20569 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-16T02:14:13.546 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14185 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-16T02:14:13.546 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13745 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-16T02:14:13.546 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8825 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-16T02:14:13.546 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16025 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/mdio.ko 2023-11-16T02:14:13.546 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20513 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/mii.ko 2023-11-16T02:14:13.546 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 43953 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/netconsole.ko 2023-11-16T02:14:13.546 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13145 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/nlmon.ko 2023-11-16T02:14:13.546 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/pcs/ 2023-11-16T02:14:13.546 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17985 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-16T02:14:13.546 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 38977 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-16T02:14:13.547 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/ 2023-11-16T02:14:13.547 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9737 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/amd.ko 2023-11-16T02:14:13.547 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 50097 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-16T02:14:13.547 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 44505 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-16T02:14:13.547 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11521 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/bcm87xx.ko 2023-11-16T02:14:13.547 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 42241 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/broadcom.ko 2023-11-16T02:14:13.548 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10625 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/cicada.ko 2023-11-16T02:14:13.548 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13025 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/davicom.ko 2023-11-16T02:14:13.548 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9449 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/et1011c.ko 2023-11-16T02:14:13.548 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24969 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/icplus.ko 2023-11-16T02:14:13.548 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15849 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/lxt.ko 2023-11-16T02:14:13.548 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 82049 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/marvell.ko 2023-11-16T02:14:13.548 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 76177 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/micrel.ko 2023-11-16T02:14:13.549 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12033 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/national.ko 2023-11-16T02:14:13.549 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 97857 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/phylink.ko 2023-11-16T02:14:13.549 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10065 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/qsemi.ko 2023-11-16T02:14:13.549 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 50065 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/realtek.ko 2023-11-16T02:14:13.549 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 29985 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/smsc.ko 2023-11-16T02:14:13.549 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10857 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/ste10Xp.ko 2023-11-16T02:14:13.549 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24289 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/phy/vitesse.ko 2023-11-16T02:14:13.549 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/plip/ 2023-11-16T02:14:13.549 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 43569 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/plip/plip.ko 2023-11-16T02:14:13.549 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/ 2023-11-16T02:14:13.549 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15857 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-16T02:14:13.550 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 29713 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/ppp_async.ko 2023-11-16T02:14:13.550 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17665 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-16T02:14:13.550 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18625 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-16T02:14:13.550 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-16T02:14:13.550 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 42545 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/pppoe.ko 2023-11-16T02:14:13.550 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13441 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/pppox.ko 2023-11-16T02:14:13.550 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 32689 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/ppp/pptp.ko 2023-11-16T02:14:13.550 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28289 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/sb1000.ko 2023-11-16T02:14:13.550 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/slip/ 2023-11-16T02:14:13.550 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 42465 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/slip/slip.ko 2023-11-16T02:14:13.550 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26929 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/sungem_phy.ko 2023-11-16T02:14:13.550 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 64385 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/tap.ko 2023-11-16T02:14:13.550 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/team/ 2023-11-16T02:14:13.551 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 106169 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/team/team.ko 2023-11-16T02:14:13.551 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13497 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-16T02:14:13.551 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10209 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-16T02:14:13.551 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28881 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-16T02:14:13.551 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9641 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/team/team_mode_random.ko 2023-11-16T02:14:13.551 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9321 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-16T02:14:13.551 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 87017 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/veth.ko 2023-11-16T02:14:13.551 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/vmxnet3/ 2023-11-16T02:14:13.551 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 144297 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-16T02:14:13.551 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/vxlan/ 2023-11-16T02:14:13.551 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 297329 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/vxlan/vxlan.ko 2023-11-16T02:14:13.551 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/xen-netback/ 2023-11-16T02:14:13.551 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 144649 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-16T02:14:13.552 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ntb/ 2023-11-16T02:14:13.552 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20969 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ntb/ntb.ko 2023-11-16T02:14:13.552 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/nvme/ 2023-11-16T02:14:13.552 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/nvme/host/ 2023-11-16T02:14:13.552 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 264937 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/nvme/host/nvme-core.ko 2023-11-16T02:14:13.552 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 102209 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/nvme/host/nvme.ko 2023-11-16T02:14:13.552 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/parport/ 2023-11-16T02:14:13.552 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 133841 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/parport/parport.ko 2023-11-16T02:14:13.553 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14561 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/parport/parport_cs.ko 2023-11-16T02:14:13.553 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 84465 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/parport/parport_pc.ko 2023-11-16T02:14:13.553 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26121 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/parport/parport_serial.ko 2023-11-16T02:14:13.553 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pci/ 2023-11-16T02:14:13.553 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pci/hotplug/ 2023-11-16T02:14:13.553 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 25009 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-16T02:14:13.553 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17849 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-16T02:14:13.553 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20137 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-16T02:14:13.554 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11857 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pci/pci-stub.ko 2023-11-16T02:14:13.554 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 46529 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pci/xen-pcifront.ko 2023-11-16T02:14:13.554 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pcmcia/ 2023-11-16T02:14:13.554 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26793 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pcmcia/i82092.ko 2023-11-16T02:14:13.554 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 145809 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pcmcia/pcmcia.ko 2023-11-16T02:14:13.554 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 62137 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-16T02:14:13.554 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 34345 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-16T02:14:13.554 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 34265 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pcmcia/pd6729.ko 2023-11-16T02:14:13.554 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 112889 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-16T02:14:13.555 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/phy/ 2023-11-16T02:14:13.555 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/phy/broadcom/ 2023-11-16T02:14:13.555 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10841 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-16T02:14:13.555 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/phy/samsung/ 2023-11-16T02:14:13.555 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8441 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-16T02:14:13.555 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pinctrl/ 2023-11-16T02:14:13.555 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pinctrl/intel/ 2023-11-16T02:14:13.555 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 70153 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-16T02:14:13.556 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/ 2023-11-16T02:14:13.556 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/chrome/ 2023-11-16T02:14:13.556 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 50889 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-16T02:14:13.556 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20849 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-16T02:14:13.556 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21449 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-16T02:14:13.556 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 25417 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-16T02:14:13.556 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26201 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-16T02:14:13.556 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18201 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-16T02:14:13.557 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17425 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-16T02:14:13.557 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/ 2023-11-16T02:14:13.557 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 67097 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-16T02:14:13.557 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 39145 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/acerhdf.ko 2023-11-16T02:14:13.557 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 36913 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-16T02:14:13.557 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 59665 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-16T02:14:13.557 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 31097 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-16T02:14:13.557 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 127569 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-16T02:14:13.557 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 36913 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-16T02:14:13.558 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 49121 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-16T02:14:13.558 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13961 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-16T02:14:13.558 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 40265 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-16T02:14:13.558 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22521 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-16T02:14:13.559 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 36657 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/hdaps.ko 2023-11-16T02:14:13.559 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19449 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-16T02:14:13.559 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/intel/ 2023-11-16T02:14:13.559 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12073 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-16T02:14:13.559 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8985 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-16T02:14:13.559 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 43497 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/intel_ips.ko 2023-11-16T02:14:13.559 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20273 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-16T02:14:13.559 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10377 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-16T02:14:13.559 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 34801 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-16T02:14:13.560 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 42329 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-16T02:14:13.560 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14169 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-16T02:14:13.560 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17321 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-16T02:14:13.560 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13721 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-16T02:14:13.560 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17081 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-16T02:14:13.560 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10129 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-16T02:14:13.561 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 57569 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/platform/x86/wmi.ko 2023-11-16T02:14:13.561 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/ 2023-11-16T02:14:13.561 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/ 2023-11-16T02:14:13.561 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 30345 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-16T02:14:13.561 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 33985 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-16T02:14:13.561 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 55057 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-16T02:14:13.561 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 54081 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-16T02:14:13.561 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21553 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-16T02:14:13.561 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-16T02:14:13.562 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19609 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/da9030_battery.ko 2023-11-16T02:14:13.562 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19841 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/da9052-battery.ko 2023-11-16T02:14:13.562 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 29281 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-16T02:14:13.562 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23217 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-16T02:14:13.562 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23353 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-16T02:14:13.562 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23649 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-16T02:14:13.562 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20353 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/gpio-charger.ko 2023-11-16T02:14:13.562 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18041 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-16T02:14:13.562 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20273 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-16T02:14:13.563 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12577 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/max14577_charger.ko 2023-11-16T02:14:13.563 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 25897 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/max17040_battery.ko 2023-11-16T02:14:13.563 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 30289 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/max17042_battery.ko 2023-11-16T02:14:13.563 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18585 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/max8903_charger.ko 2023-11-16T02:14:13.563 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/max8925_power.ko 2023-11-16T02:14:13.563 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21657 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-16T02:14:13.563 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 38009 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/sbs-battery.ko 2023-11-16T02:14:13.563 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28385 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/test_power.ko 2023-11-16T02:14:13.563 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18865 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-16T02:14:13.563 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11969 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-16T02:14:13.564 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24521 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/wm831x_power.ko 2023-11-16T02:14:13.564 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22417 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/power/supply/wm8350_power.ko 2023-11-16T02:14:13.564 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/powercap/ 2023-11-16T02:14:13.564 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 57729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-16T02:14:13.564 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17345 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-16T02:14:13.564 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pps/ 2023-11-16T02:14:13.564 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pps/clients/ 2023-11-16T02:14:13.564 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15521 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-16T02:14:13.564 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13249 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-16T02:14:13.564 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15913 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pps/clients/pps_parport.ko 2023-11-16T02:14:13.565 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 41873 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/pps/pps_core.ko 2023-11-16T02:14:13.565 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ptp/ 2023-11-16T02:14:13.565 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 66385 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ptp/ptp.ko 2023-11-16T02:14:13.565 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16449 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ptp/ptp_kvm.ko 2023-11-16T02:14:13.565 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/ 2023-11-16T02:14:13.565 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23497 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-16T02:14:13.565 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24521 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-16T02:14:13.565 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15393 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-16T02:14:13.566 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20105 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-da9052.ko 2023-11-16T02:14:13.566 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18505 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-da9055.ko 2023-11-16T02:14:13.566 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20425 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-da9063.ko 2023-11-16T02:14:13.566 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16457 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-16T02:14:13.566 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 68577 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-16T02:14:13.566 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20817 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-16T02:14:13.566 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18217 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-16T02:14:13.566 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16737 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-16T02:14:13.566 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13953 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-16T02:14:13.567 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13369 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-16T02:14:13.567 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14697 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-16T02:14:13.567 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23705 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-16T02:14:13.567 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11081 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-em3027.ko 2023-11-16T02:14:13.567 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24329 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-16T02:14:13.567 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-16T02:14:13.567 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 35969 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-16T02:14:13.567 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14673 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-16T02:14:13.567 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 38097 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-16T02:14:13.567 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12089 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-16T02:14:13.568 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 25945 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-16T02:14:13.568 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14841 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-16T02:14:13.568 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11633 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-max6900.ko 2023-11-16T02:14:13.568 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14737 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-max8907.ko 2023-11-16T02:14:13.568 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15409 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-max8925.ko 2023-11-16T02:14:13.569 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 25809 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-max8997.ko 2023-11-16T02:14:13.569 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16681 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-max8998.ko 2023-11-16T02:14:13.569 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18513 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-16T02:14:13.569 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11409 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-16T02:14:13.569 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19625 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-palmas.ko 2023-11-16T02:14:13.569 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 46633 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-16T02:14:13.569 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17977 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-16T02:14:13.569 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26993 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-16T02:14:13.569 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21825 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-16T02:14:13.569 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 29881 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-16T02:14:13.569 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12441 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-16T02:14:13.569 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18033 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-16T02:14:13.569 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13049 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-16T02:14:13.570 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 33753 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-16T02:14:13.570 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 27833 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-16T02:14:13.570 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 25257 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-16T02:14:13.570 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20113 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-16T02:14:13.570 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21617 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-16T02:14:13.570 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16825 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-16T02:14:13.570 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17889 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-16T02:14:13.570 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-16T02:14:13.570 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20545 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-16T02:14:13.570 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21089 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-16T02:14:13.570 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 27873 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/rtc/rtc-x1205.ko 2023-11-16T02:14:13.570 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/ 2023-11-16T02:14:13.570 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 77617 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/3w-9xxx.ko 2023-11-16T02:14:13.570 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 57665 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/3w-sas.ko 2023-11-16T02:14:13.571 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 55169 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/3w-xxxx.ko 2023-11-16T02:14:13.571 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 135185 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/BusLogic.ko 2023-11-16T02:14:13.571 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26657 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/a100u2w.ko 2023-11-16T02:14:13.571 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/aacraid/ 2023-11-16T02:14:13.571 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 272305 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-16T02:14:13.571 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 100617 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/advansys.ko 2023-11-16T02:14:13.571 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/aic7xxx/ 2023-11-16T02:14:13.571 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 356265 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-16T02:14:13.571 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 295801 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-16T02:14:13.571 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/aic94xx/ 2023-11-16T02:14:13.571 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 189185 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-16T02:14:13.571 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24073 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/am53c974.ko 2023-11-16T02:14:13.571 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/arcmsr/ 2023-11-16T02:14:13.572 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 106881 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-16T02:14:13.572 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 38185 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/atp870u.ko 2023-11-16T02:14:13.572 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/be2iscsi/ 2023-11-16T02:14:13.572 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 246985 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-16T02:14:13.572 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/bfa/ 2023-11-16T02:14:13.572 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 1171945 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/bfa/bfa.ko 2023-11-16T02:14:13.572 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/bnx2fc/ 2023-11-16T02:14:13.572 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 237273 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-16T02:14:13.572 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/bnx2i/ 2023-11-16T02:14:13.572 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 115369 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-16T02:14:13.572 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 40585 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/ch.ko 2023-11-16T02:14:13.572 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/csiostor/ 2023-11-16T02:14:13.572 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 308921 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-16T02:14:13.572 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/cxgbi/ 2023-11-16T02:14:13.573 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-16T02:14:13.573 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 76145 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-16T02:14:13.573 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-16T02:14:13.573 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 101449 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-16T02:14:13.573 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 146689 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-16T02:14:13.573 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 75553 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/dc395x.ko 2023-11-16T02:14:13.573 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 38137 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/dmx3191d.ko 2023-11-16T02:14:13.573 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/esas2r/ 2023-11-16T02:14:13.573 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 212425 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-16T02:14:13.573 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 60505 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/esp_scsi.ko 2023-11-16T02:14:13.573 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/fcoe/ 2023-11-16T02:14:13.573 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 78209 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-16T02:14:13.573 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 158505 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-16T02:14:13.574 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18945 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/fdomain.ko 2023-11-16T02:14:13.574 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/fnic/ 2023-11-16T02:14:13.574 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 263489 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/fnic/fnic.ko 2023-11-16T02:14:13.574 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 201817 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/hpsa.ko 2023-11-16T02:14:13.574 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 51209 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/hptiop.ko 2023-11-16T02:14:13.574 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 49041 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/hv_storvsc.ko 2023-11-16T02:14:13.574 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 35337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/imm.ko 2023-11-16T02:14:13.574 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 44057 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/initio.ko 2023-11-16T02:14:13.574 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 266537 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/ipr.ko 2023-11-16T02:14:13.574 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 101881 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/ips.ko 2023-11-16T02:14:13.574 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/isci/ 2023-11-16T02:14:13.574 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 317153 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/isci/isci.ko 2023-11-16T02:14:13.574 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26385 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-16T02:14:13.575 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 52961 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-16T02:14:13.575 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/libfc/ 2023-11-16T02:14:13.575 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 314865 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/libfc/libfc.ko 2023-11-16T02:14:13.575 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 145585 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/libiscsi.ko 2023-11-16T02:14:13.575 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 53521 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-16T02:14:13.575 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/libsas/ 2023-11-16T02:14:13.575 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 216665 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/libsas/libsas.ko 2023-11-16T02:14:13.575 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/lpfc/ 2023-11-16T02:14:13.575 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 2197249 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-16T02:14:13.575 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/megaraid/ 2023-11-16T02:14:13.575 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 73569 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-16T02:14:13.575 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 33529 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-16T02:14:13.576 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 310617 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-16T02:14:13.576 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 84721 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/megaraid.ko 2023-11-16T02:14:13.576 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/mpt3sas/ 2023-11-16T02:14:13.576 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 659777 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-16T02:14:13.576 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/mvsas/ 2023-11-16T02:14:13.576 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 119561 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-16T02:14:13.576 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 78129 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/mvumi.ko 2023-11-16T02:14:13.576 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/pcmcia/ 2023-11-16T02:14:13.576 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 81625 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-16T02:14:13.576 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11713 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-16T02:14:13.576 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20865 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-16T02:14:13.576 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23857 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-16T02:14:13.576 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/pm8001/ 2023-11-16T02:14:13.577 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 364105 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-16T02:14:13.577 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 123617 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/pmcraid.ko 2023-11-16T02:14:13.577 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 34513 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/ppa.ko 2023-11-16T02:14:13.577 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 55361 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/qla1280.ko 2023-11-16T02:14:13.577 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/qla2xxx/ 2023-11-16T02:14:13.577 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 1876625 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-16T02:14:13.577 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 85289 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-16T02:14:13.577 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/qla4xxx/ 2023-11-16T02:14:13.577 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 559033 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-16T02:14:13.577 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19025 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/qlogicfas408.ko 2023-11-16T02:14:13.577 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15993 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/raid_class.ko 2023-11-16T02:14:13.577 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 238825 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/scsi_debug.ko 2023-11-16T02:14:13.577 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 173937 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-16T02:14:13.578 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 279313 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-16T02:14:13.578 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 97729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-16T02:14:13.578 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 73881 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-16T02:14:13.578 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 44993 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-16T02:14:13.578 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26249 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/ses.ko 2023-11-16T02:14:13.578 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 115889 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/st.ko 2023-11-16T02:14:13.578 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 46825 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/stex.ko 2023-11-16T02:14:13.578 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-16T02:14:13.578 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 162121 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-16T02:14:13.578 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 42297 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/virtio_scsi.ko 2023-11-16T02:14:13.578 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 50321 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-16T02:14:13.578 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 40025 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/wd719x.ko 2023-11-16T02:14:13.578 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 50025 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/scsi/xen-scsifront.ko 2023-11-16T02:14:13.579 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ssb/ 2023-11-16T02:14:13.579 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 129441 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ssb/ssb.ko 2023-11-16T02:14:13.579 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/ 2023-11-16T02:14:13.579 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/iscsi/ 2023-11-16T02:14:13.579 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 736601 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-16T02:14:13.579 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/loopback/ 2023-11-16T02:14:13.580 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 49985 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-16T02:14:13.580 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 39713 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/target_core_file.ko 2023-11-16T02:14:13.580 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 43025 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/target_core_iblock.ko 2023-11-16T02:14:13.580 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 930321 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/target_core_mod.ko 2023-11-16T02:14:13.580 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 44305 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/target_core_pscsi.ko 2023-11-16T02:14:13.580 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 122521 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/target_core_user.ko 2023-11-16T02:14:13.580 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/tcm_fc/ 2023-11-16T02:14:13.580 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 75593 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-16T02:14:13.580 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/ 2023-11-16T02:14:13.580 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/ 2023-11-16T02:14:13.580 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-16T02:14:13.580 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23481 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-16T02:14:13.580 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 29321 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-16T02:14:13.581 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9953 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-16T02:14:13.581 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10257 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-16T02:14:13.581 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15081 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-16T02:14:13.581 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16497 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-16T02:14:13.581 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26809 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-16T02:14:13.581 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20281 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-16T02:14:13.581 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14865 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-16T02:14:13.581 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14393 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-16T02:14:13.581 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13001 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-16T02:14:13.581 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 37065 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-16T02:14:13.581 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 30729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-16T02:14:13.581 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18937 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-16T02:14:13.581 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11521 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-16T02:14:13.582 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26489 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-16T02:14:13.582 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/ 2023-11-16T02:14:13.582 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/ipwireless/ 2023-11-16T02:14:13.582 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 78425 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-16T02:14:13.582 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 57865 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/moxa.ko 2023-11-16T02:14:13.582 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 50953 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/mxser.ko 2023-11-16T02:14:13.582 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 108601 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/n_gsm.ko 2023-11-16T02:14:13.582 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 31961 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/n_hdlc.ko 2023-11-16T02:14:13.582 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 67929 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/nozomi.ko 2023-11-16T02:14:13.582 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/ 2023-11-16T02:14:13.582 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/8250/ 2023-11-16T02:14:13.582 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 35753 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-16T02:14:13.582 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 59497 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-16T02:14:13.583 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18097 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-16T02:14:13.583 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22577 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/altera_uart.ko 2023-11-16T02:14:13.583 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9489 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/arc_uart.ko 2023-11-16T02:14:13.583 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 72425 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-16T02:14:13.583 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/jsm/ 2023-11-16T02:14:13.583 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 103073 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-16T02:14:13.583 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28785 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/rp2.ko 2023-11-16T02:14:13.583 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 52817 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-16T02:14:13.583 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ufs/ 2023-11-16T02:14:13.583 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ufs/core/ 2023-11-16T02:14:13.584 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 531265 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-16T02:14:13.584 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ufs/host/ 2023-11-16T02:14:13.584 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28481 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-16T02:14:13.584 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14601 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-16T02:14:13.584 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/ 2023-11-16T02:14:13.584 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 44513 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio.ko 2023-11-16T02:14:13.584 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12241 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio_aec.ko 2023-11-16T02:14:13.584 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11281 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio_cif.ko 2023-11-16T02:14:13.584 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18329 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-16T02:14:13.585 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13001 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio_mf624.ko 2023-11-16T02:14:13.585 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12177 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio_netx.ko 2023-11-16T02:14:13.585 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10601 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio_pci_generic.ko 2023-11-16T02:14:13.585 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16057 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-16T02:14:13.585 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13633 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/uio/uio_sercos3.ko 2023-11-16T02:14:13.585 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/ 2023-11-16T02:14:13.585 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/c67x00/ 2023-11-16T02:14:13.585 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 73297 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-16T02:14:13.585 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/chipidea/ 2023-11-16T02:14:13.586 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 144377 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-16T02:14:13.586 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18505 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-16T02:14:13.586 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12713 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-16T02:14:13.586 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13057 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-16T02:14:13.586 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/class/ 2023-11-16T02:14:13.586 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 87089 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/class/cdc-acm.ko 2023-11-16T02:14:13.586 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 51409 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-16T02:14:13.586 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 47369 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/class/usblp.ko 2023-11-16T02:14:13.586 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 89857 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/class/usbtmc.ko 2023-11-16T02:14:13.587 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/common/ 2023-11-16T02:14:13.587 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22953 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/common/ulpi.ko 2023-11-16T02:14:13.587 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/dwc2/ 2023-11-16T02:14:13.587 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11529 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-16T02:14:13.587 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/dwc3/ 2023-11-16T02:14:13.587 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12089 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-16T02:14:13.587 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 30041 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-16T02:14:13.588 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 444553 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-16T02:14:13.588 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/ 2023-11-16T02:14:13.588 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/ 2023-11-16T02:14:13.588 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 60177 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-16T02:14:13.588 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 51881 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-16T02:14:13.588 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28841 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-16T02:14:13.589 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 42449 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-16T02:14:13.589 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 27953 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-16T02:14:13.589 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 36513 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-16T02:14:13.589 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 92489 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-16T02:14:13.590 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 51049 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-16T02:14:13.590 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 122081 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-16T02:14:13.590 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 57617 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-16T02:14:13.590 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22185 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-16T02:14:13.590 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 31265 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-16T02:14:13.590 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 57729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-16T02:14:13.590 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 85609 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-16T02:14:13.591 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19273 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-16T02:14:13.591 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 58113 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-16T02:14:13.591 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 67337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-16T02:14:13.591 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/ 2023-11-16T02:14:13.591 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21265 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-16T02:14:13.591 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18057 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-16T02:14:13.591 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18465 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-16T02:14:13.591 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21657 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-16T02:14:13.591 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28401 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-16T02:14:13.592 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19009 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-16T02:14:13.592 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20409 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-16T02:14:13.592 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16977 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-16T02:14:13.592 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 32073 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-16T02:14:13.592 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16793 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-16T02:14:13.592 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19393 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-16T02:14:13.592 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 27201 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-16T02:14:13.592 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 62185 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-16T02:14:13.592 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15201 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-16T02:14:13.593 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 161225 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-16T02:14:13.593 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/ 2023-11-16T02:14:13.593 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17705 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-16T02:14:13.593 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-16T02:14:13.593 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 157681 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-16T02:14:13.593 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 36089 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-16T02:14:13.593 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 52721 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-16T02:14:13.593 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 69705 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-16T02:14:13.594 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 56033 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-16T02:14:13.594 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 76057 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-16T02:14:13.594 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 75073 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-16T02:14:13.594 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 73169 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-16T02:14:13.594 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 65809 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-16T02:14:13.594 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 66097 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-16T02:14:13.594 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 81505 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-16T02:14:13.594 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 156073 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-16T02:14:13.595 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/ 2023-11-16T02:14:13.595 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11585 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-16T02:14:13.595 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 80113 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-16T02:14:13.595 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 87353 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-16T02:14:13.595 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 78873 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-16T02:14:13.596 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 51329 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-16T02:14:13.596 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15593 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/sl811_cs.ko 2023-11-16T02:14:13.596 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13305 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-16T02:14:13.596 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 25945 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-16T02:14:13.596 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/image/ 2023-11-16T02:14:13.596 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 34585 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/image/mdc800.ko 2023-11-16T02:14:13.596 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21081 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/image/microtek.ko 2023-11-16T02:14:13.597 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/ 2023-11-16T02:14:13.597 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 41721 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/adutux.ko 2023-11-16T02:14:13.597 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20713 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/appledisplay.ko 2023-11-16T02:14:13.597 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17721 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-16T02:14:13.597 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23049 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/cytherm.ko 2023-11-16T02:14:13.597 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/ehset.ko 2023-11-16T02:14:13.597 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15057 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/emi26.ko 2023-11-16T02:14:13.598 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15985 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/emi62.ko 2023-11-16T02:14:13.598 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11433 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/ezusb.ko 2023-11-16T02:14:13.598 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19297 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/idmouse.ko 2023-11-16T02:14:13.598 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 36617 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/iowarrior.ko 2023-11-16T02:14:13.598 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11593 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-16T02:14:13.598 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 36529 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/ldusb.ko 2023-11-16T02:14:13.598 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 36265 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/legousbtower.ko 2023-11-16T02:14:13.598 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 27793 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/lvstest.ko 2023-11-16T02:14:13.598 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/sisusbvga/ 2023-11-16T02:14:13.599 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 64841 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-16T02:14:13.599 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13001 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-16T02:14:13.599 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20473 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/usb3503.ko 2023-11-16T02:14:13.599 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 25145 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/usblcd.ko 2023-11-16T02:14:13.599 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22753 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-16T02:14:13.599 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 70873 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/usbtest.ko 2023-11-16T02:14:13.599 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 41969 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/uss720.ko 2023-11-16T02:14:13.599 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 27617 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/misc/yurex.ko 2023-11-16T02:14:13.599 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/mon/ 2023-11-16T02:14:13.599 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 72953 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/mon/usbmon.ko 2023-11-16T02:14:13.599 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/musb/ 2023-11-16T02:14:13.600 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 301545 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-16T02:14:13.600 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/phy/ 2023-11-16T02:14:13.600 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21105 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/phy/phy-generic.ko 2023-11-16T02:14:13.600 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20177 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-16T02:14:13.600 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12257 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-16T02:14:13.600 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21745 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-16T02:14:13.600 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ 2023-11-16T02:14:13.600 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13209 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/aircable.ko 2023-11-16T02:14:13.601 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 33329 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ark3116.ko 2023-11-16T02:14:13.601 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26633 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-16T02:14:13.601 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 38105 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ch341.ko 2023-11-16T02:14:13.601 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 70257 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/cp210x.ko 2023-11-16T02:14:13.601 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 31057 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/cyberjack.ko 2023-11-16T02:14:13.601 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 58217 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-16T02:14:13.601 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 49817 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-16T02:14:13.601 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9617 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/empeg.ko 2023-11-16T02:14:13.601 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 44337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/f81232.ko 2023-11-16T02:14:13.601 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 175137 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-16T02:14:13.601 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 53113 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-16T02:14:13.601 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 137081 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-16T02:14:13.602 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 124833 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/io_ti.ko 2023-11-16T02:14:13.602 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 67769 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ipaq.ko 2023-11-16T02:14:13.602 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19161 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ipw.ko 2023-11-16T02:14:13.602 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26897 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ir-usb.ko 2023-11-16T02:14:13.602 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 58233 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-16T02:14:13.602 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 107521 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/keyspan.ko 2023-11-16T02:14:13.602 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 35617 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-16T02:14:13.602 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 25665 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-16T02:14:13.602 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 33689 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-16T02:14:13.602 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 32953 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/mct_u232.ko 2023-11-16T02:14:13.602 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22033 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/metro-usb.ko 2023-11-16T02:14:13.603 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 66449 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/mos7720.ko 2023-11-16T02:14:13.603 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 78217 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/mos7840.ko 2023-11-16T02:14:13.603 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 56337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/mxuport.ko 2023-11-16T02:14:13.603 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14089 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/navman.ko 2023-11-16T02:14:13.603 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12009 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/omninet.ko 2023-11-16T02:14:13.603 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24633 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/opticon.ko 2023-11-16T02:14:13.603 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 190633 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/option.ko 2023-11-16T02:14:13.603 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 39073 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/oti6858.ko 2023-11-16T02:14:13.603 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 54353 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/pl2303.ko 2023-11-16T02:14:13.603 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9801 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/qcaux.ko 2023-11-16T02:14:13.603 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 37825 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/qcserial.ko 2023-11-16T02:14:13.603 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 34321 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/quatech2.ko 2023-11-16T02:14:13.604 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15393 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/safe_serial.ko 2023-11-16T02:14:13.604 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 51625 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/sierra.ko 2023-11-16T02:14:13.604 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21673 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-16T02:14:13.604 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 29993 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ssu100.ko 2023-11-16T02:14:13.604 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17265 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/symbolserial.ko 2023-11-16T02:14:13.604 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 61489 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-16T02:14:13.604 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-16T02:14:13.604 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10241 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/usb_debug.ko 2023-11-16T02:14:13.604 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 33201 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-16T02:14:13.604 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 125609 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/usbserial.ko 2023-11-16T02:14:13.604 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28753 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/visor.ko 2023-11-16T02:14:13.604 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 37409 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/whiteheat.ko 2023-11-16T02:14:13.605 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10537 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-16T02:14:13.605 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9289 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-16T02:14:13.605 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ 2023-11-16T02:14:13.605 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 52913 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/uas.ko 2023-11-16T02:14:13.605 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26017 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-16T02:14:13.605 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13049 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-16T02:14:13.605 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22049 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-16T02:14:13.605 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 33497 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-16T02:14:13.605 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13745 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-16T02:14:13.605 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19769 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-16T02:14:13.605 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19361 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-16T02:14:13.605 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13713 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-karma.ko 2023-11-16T02:14:13.606 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17841 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-16T02:14:13.606 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28441 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-16T02:14:13.606 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28905 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-16T02:14:13.606 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19521 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-16T02:14:13.606 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 35337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-16T02:14:13.606 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 179969 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/storage/usb-storage.ko 2023-11-16T02:14:13.606 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/usbip/ 2023-11-16T02:14:13.606 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 67481 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-16T02:14:13.606 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 72177 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-16T02:14:13.606 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 107001 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-16T02:14:13.606 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vfio/ 2023-11-16T02:14:13.606 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vfio/pci/ 2023-11-16T02:14:13.606 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 154297 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-16T02:14:13.607 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 29537 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-16T02:14:13.607 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 108737 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vfio/vfio.ko 2023-11-16T02:14:13.607 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 77609 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-16T02:14:13.607 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vhost/ 2023-11-16T02:14:13.607 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 113873 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vhost/vhost.ko 2023-11-16T02:14:13.607 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17009 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-16T02:14:13.607 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 58089 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vhost/vhost_net.ko 2023-11-16T02:14:13.607 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 89249 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/vhost/vhost_scsi.ko 2023-11-16T02:14:13.607 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/ 2023-11-16T02:14:13.607 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/ 2023-11-16T02:14:13.608 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15417 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-16T02:14:13.608 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12393 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-16T02:14:13.608 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23305 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-16T02:14:13.608 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 32609 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-16T02:14:13.608 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 39993 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-16T02:14:13.608 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16921 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/apple_bl.ko 2023-11-16T02:14:13.608 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16777 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-16T02:14:13.608 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12097 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/bd6107.ko 2023-11-16T02:14:13.608 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11409 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-16T02:14:13.608 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11273 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-16T02:14:13.608 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11753 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-16T02:14:13.609 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14769 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-16T02:14:13.609 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22017 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/lcd.ko 2023-11-16T02:14:13.609 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23657 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-16T02:14:13.610 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-16T02:14:13.610 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11425 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-16T02:14:13.610 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14345 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-16T02:14:13.610 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11313 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-16T02:14:13.610 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10865 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-16T02:14:13.610 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10897 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-16T02:14:13.611 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12721 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-16T02:14:13.611 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/ 2023-11-16T02:14:13.611 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/masters/ 2023-11-16T02:14:13.611 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18785 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/masters/ds2482.ko 2023-11-16T02:14:13.612 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 38985 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/masters/ds2490.ko 2023-11-16T02:14:13.612 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11265 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-16T02:14:13.612 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12417 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-16T02:14:13.612 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/ 2023-11-16T02:14:13.612 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12041 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-16T02:14:13.612 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22809 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-16T02:14:13.613 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15113 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-16T02:14:13.613 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10825 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-16T02:14:13.613 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14153 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-16T02:14:13.613 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11929 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-16T02:14:13.613 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14113 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-16T02:14:13.613 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14049 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-16T02:14:13.613 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17921 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-16T02:14:13.613 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7385 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-16T02:14:13.613 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 56425 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-16T02:14:13.613 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 102673 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/w1/wire.ko 2023-11-16T02:14:13.613 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/ 2023-11-16T02:14:13.613 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18793 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/acquirewdt.ko 2023-11-16T02:14:13.614 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19977 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/advantechwdt.ko 2023-11-16T02:14:13.614 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18561 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-16T02:14:13.614 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22969 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-16T02:14:13.614 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19113 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-16T02:14:13.614 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13617 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-16T02:14:13.614 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12777 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-16T02:14:13.614 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17409 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-16T02:14:13.615 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20169 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/dw_wdt.ko 2023-11-16T02:14:13.615 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20265 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-16T02:14:13.615 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23865 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-16T02:14:13.616 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 27401 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/hpwdt.ko 2023-11-16T02:14:13.616 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15577 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/i6300esb.ko 2023-11-16T02:14:13.616 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10833 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-16T02:14:13.616 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21913 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-16T02:14:13.616 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19241 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/ib700wdt.ko 2023-11-16T02:14:13.616 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18689 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/ibmasr.ko 2023-11-16T02:14:13.617 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19713 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-16T02:14:13.617 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21225 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-16T02:14:13.617 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13841 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/it87_wdt.ko 2023-11-16T02:14:13.617 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21489 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-16T02:14:13.617 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18617 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/machzwd.ko 2023-11-16T02:14:13.617 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14721 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-16T02:14:13.617 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13217 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-16T02:14:13.617 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24673 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/nv_tco.ko 2023-11-16T02:14:13.617 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17737 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-16T02:14:13.618 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22265 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-16T02:14:13.618 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 38657 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-16T02:14:13.618 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 31825 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-16T02:14:13.618 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13129 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/retu_wdt.ko 2023-11-16T02:14:13.618 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20449 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-16T02:14:13.618 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14129 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-16T02:14:13.618 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17321 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-16T02:14:13.618 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23809 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-16T02:14:13.618 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23321 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-16T02:14:13.619 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21577 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-16T02:14:13.619 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17273 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/softdog.ko 2023-11-16T02:14:13.619 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22273 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-16T02:14:13.619 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12817 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-16T02:14:13.619 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17649 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/via_wdt.ko 2023-11-16T02:14:13.619 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19161 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-16T02:14:13.619 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20681 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-16T02:14:13.619 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 25409 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-16T02:14:13.620 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18497 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-16T02:14:13.620 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28089 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/wdt_pci.ko 2023-11-16T02:14:13.620 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16257 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-16T02:14:13.620 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13785 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-16T02:14:13.620 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15697 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/watchdog/xen_wdt.ko 2023-11-16T02:14:13.620 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/ 2023-11-16T02:14:13.620 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xen-evtchn.ko 2023-11-16T02:14:13.620 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26769 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xen-gntalloc.ko 2023-11-16T02:14:13.620 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 47865 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xen-gntdev.ko 2023-11-16T02:14:13.620 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xen-pciback/ 2023-11-16T02:14:13.621 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 176441 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-16T02:14:13.621 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 40121 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xen-privcmd.ko 2023-11-16T02:14:13.621 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 71249 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xen-scsiback.ko 2023-11-16T02:14:13.621 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xenfs/ 2023-11-16T02:14:13.621 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19425 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-16T02:14:13.621 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ 2023-11-16T02:14:13.621 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/9p/ 2023-11-16T02:14:13.621 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 166425 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/9p/9p.ko 2023-11-16T02:14:13.621 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/adfs/ 2023-11-16T02:14:13.621 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 61073 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/adfs/adfs.ko 2023-11-16T02:14:13.621 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/affs/ 2023-11-16T02:14:13.621 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 163593 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/affs/affs.ko 2023-11-16T02:14:13.621 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/afs/ 2023-11-16T02:14:13.622 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 932817 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/afs/kafs.ko 2023-11-16T02:14:13.622 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/autofs/ 2023-11-16T02:14:13.622 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 101057 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/autofs/autofs4.ko 2023-11-16T02:14:13.622 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/befs/ 2023-11-16T02:14:13.622 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 64545 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/befs/befs.ko 2023-11-16T02:14:13.622 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/bfs/ 2023-11-16T02:14:13.622 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 41257 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/bfs/bfs.ko 2023-11-16T02:14:13.622 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 34585 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/binfmt_misc.ko 2023-11-16T02:14:13.622 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/btrfs/ 2023-11-16T02:14:13.622 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 3402585 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/btrfs/btrfs.ko 2023-11-16T02:14:13.622 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/cachefiles/ 2023-11-16T02:14:13.622 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 306073 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/cachefiles/cachefiles.ko 2023-11-16T02:14:13.623 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ceph/ 2023-11-16T02:14:13.623 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 1323945 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ceph/ceph.ko 2023-11-16T02:14:13.623 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/coda/ 2023-11-16T02:14:13.623 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 100801 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/coda/coda.ko 2023-11-16T02:14:13.623 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/configfs/ 2023-11-16T02:14:13.623 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 108393 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/configfs/configfs.ko 2023-11-16T02:14:13.623 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/cramfs/ 2023-11-16T02:14:13.623 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 29625 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/cramfs/cramfs.ko 2023-11-16T02:14:13.623 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/dlm/ 2023-11-16T02:14:13.623 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 642577 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/dlm/dlm.ko 2023-11-16T02:14:13.624 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/efs/ 2023-11-16T02:14:13.624 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 36649 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/efs/efs.ko 2023-11-16T02:14:13.624 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/f2fs/ 2023-11-16T02:14:13.624 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 1505025 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/f2fs/f2fs.ko 2023-11-16T02:14:13.624 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/fat/ 2023-11-16T02:14:13.624 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 27929 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/fat/msdos.ko 2023-11-16T02:14:13.624 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/freevxfs/ 2023-11-16T02:14:13.624 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 42545 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/freevxfs/freevxfs.ko 2023-11-16T02:14:13.624 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/fscache/ 2023-11-16T02:14:13.625 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 226481 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/fscache/fscache.ko 2023-11-16T02:14:13.625 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/fuse/ 2023-11-16T02:14:13.625 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24489 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/fuse/cuse.ko 2023-11-16T02:14:13.625 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/gfs2/ 2023-11-16T02:14:13.625 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 1231529 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/gfs2/gfs2.ko 2023-11-16T02:14:13.625 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/hfs/ 2023-11-16T02:14:13.625 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 141209 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/hfs/hfs.ko 2023-11-16T02:14:13.625 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/hfsplus/ 2023-11-16T02:14:13.626 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 222817 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/hfsplus/hfsplus.ko 2023-11-16T02:14:13.626 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/hpfs/ 2023-11-16T02:14:13.626 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 192329 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/hpfs/hpfs.ko 2023-11-16T02:14:13.626 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/isofs/ 2023-11-16T02:14:13.626 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 74065 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/isofs/isofs.ko 2023-11-16T02:14:13.626 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/jfs/ 2023-11-16T02:14:13.626 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 419497 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/jfs/jfs.ko 2023-11-16T02:14:13.627 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/lockd/ 2023-11-16T02:14:13.627 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 280313 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/lockd/lockd.ko 2023-11-16T02:14:13.627 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/minix/ 2023-11-16T02:14:13.627 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 89193 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/minix/minix.ko 2023-11-16T02:14:13.627 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/netfs/ 2023-11-16T02:14:13.627 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 124649 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/netfs/netfs.ko 2023-11-16T02:14:13.627 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/ 2023-11-16T02:14:13.628 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/blocklayout/ 2023-11-16T02:14:13.628 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 81449 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-16T02:14:13.628 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/filelayout/ 2023-11-16T02:14:13.628 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 59449 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-16T02:14:13.628 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/flexfilelayout/ 2023-11-16T02:14:13.628 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 117513 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-16T02:14:13.628 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 1055649 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/nfs.ko 2023-11-16T02:14:13.628 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 66441 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/nfsv2.ko 2023-11-16T02:14:13.628 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 120177 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/nfsv3.ko 2023-11-16T02:14:13.629 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 2041689 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs/nfsv4.ko 2023-11-16T02:14:13.629 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs_common/ 2023-11-16T02:14:13.629 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16929 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs_common/grace.ko 2023-11-16T02:14:13.629 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16145 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfs_common/nfs_acl.ko 2023-11-16T02:14:13.629 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfsd/ 2023-11-16T02:14:13.629 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 1516809 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nfsd/nfsd.ko 2023-11-16T02:14:13.630 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nilfs2/ 2023-11-16T02:14:13.630 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 592833 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nilfs2/nilfs2.ko 2023-11-16T02:14:13.630 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/ 2023-11-16T02:14:13.630 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13793 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-celtic.ko 2023-11-16T02:14:13.630 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13169 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-centeuro.ko 2023-11-16T02:14:13.630 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13793 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-croatian.ko 2023-11-16T02:14:13.630 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12865 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-cyrillic.ko 2023-11-16T02:14:13.630 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13481 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-gaelic.ko 2023-11-16T02:14:13.631 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12857 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-greek.ko 2023-11-16T02:14:13.631 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13793 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-iceland.ko 2023-11-16T02:14:13.631 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13169 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-inuit.ko 2023-11-16T02:14:13.631 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14097 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-roman.ko 2023-11-16T02:14:13.631 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13793 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-romanian.ko 2023-11-16T02:14:13.631 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13793 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/mac-turkish.ko 2023-11-16T02:14:13.631 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11297 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_ascii.ko 2023-11-16T02:14:13.631 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12537 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp1250.ko 2023-11-16T02:14:13.631 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12233 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp1251.ko 2023-11-16T02:14:13.632 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12921 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp1255.ko 2023-11-16T02:14:13.632 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12537 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp737.ko 2023-11-16T02:14:13.632 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12537 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp775.ko 2023-11-16T02:14:13.632 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12225 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp850.ko 2023-11-16T02:14:13.632 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12225 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp852.ko 2023-11-16T02:14:13.632 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12225 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp855.ko 2023-11-16T02:14:13.632 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11913 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp857.ko 2023-11-16T02:14:13.632 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12849 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp860.ko 2023-11-16T02:14:13.632 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13161 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp861.ko 2023-11-16T02:14:13.633 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13473 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp862.ko 2023-11-16T02:14:13.633 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13161 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp863.ko 2023-11-16T02:14:13.633 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12849 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp864.ko 2023-11-16T02:14:13.633 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13161 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp865.ko 2023-11-16T02:14:13.633 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12537 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp866.ko 2023-11-16T02:14:13.633 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12225 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp869.ko 2023-11-16T02:14:13.634 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11985 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp874.ko 2023-11-16T02:14:13.634 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 94137 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp932.ko 2023-11-16T02:14:13.634 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 142673 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp936.ko 2023-11-16T02:14:13.634 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 165745 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp949.ko 2023-11-16T02:14:13.634 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 118121 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_cp950.ko 2023-11-16T02:14:13.634 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12457 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_euc-jp.ko 2023-11-16T02:14:13.634 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11305 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-1.ko 2023-11-16T02:14:13.634 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11929 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-13.ko 2023-11-16T02:14:13.635 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11929 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-14.ko 2023-11-16T02:14:13.635 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11929 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-15.ko 2023-11-16T02:14:13.635 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11921 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-2.ko 2023-11-16T02:14:13.635 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11921 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-3.ko 2023-11-16T02:14:13.635 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11921 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-4.ko 2023-11-16T02:14:13.635 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11921 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-5.ko 2023-11-16T02:14:13.635 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11617 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-6.ko 2023-11-16T02:14:13.636 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12233 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-7.ko 2023-11-16T02:14:13.636 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11617 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_iso8859-9.ko 2023-11-16T02:14:13.636 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12537 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_koi8-r.ko 2023-11-16T02:14:13.636 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8017 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_koi8-ru.ko 2023-11-16T02:14:13.636 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12537 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_koi8-u.ko 2023-11-16T02:14:13.636 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7569 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-16T02:14:13.636 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/nls/nls_utf8.ko 2023-11-16T02:14:13.637 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ntfs/ 2023-11-16T02:14:13.637 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 219417 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ntfs/ntfs.ko 2023-11-16T02:14:13.637 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/ 2023-11-16T02:14:13.637 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/cluster/ 2023-11-16T02:14:13.637 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 244409 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-16T02:14:13.637 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/dlm/ 2023-11-16T02:14:13.637 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 440737 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-16T02:14:13.637 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/dlmfs/ 2023-11-16T02:14:13.638 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 54049 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-16T02:14:13.639 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 2592433 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/ocfs2.ko 2023-11-16T02:14:13.639 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17905 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-16T02:14:13.639 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 31729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-16T02:14:13.639 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 35897 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-16T02:14:13.639 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/omfs/ 2023-11-16T02:14:13.639 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 53433 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/omfs/omfs.ko 2023-11-16T02:14:13.639 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/overlayfs/ 2023-11-16T02:14:13.639 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 352153 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/overlayfs/overlay.ko 2023-11-16T02:14:13.639 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/pstore/ 2023-11-16T02:14:13.640 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 54809 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/pstore/ramoops.ko 2023-11-16T02:14:13.640 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/qnx4/ 2023-11-16T02:14:13.640 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26865 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/qnx4/qnx4.ko 2023-11-16T02:14:13.640 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/qnx6/ 2023-11-16T02:14:13.640 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 46689 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/qnx6/qnx6.ko 2023-11-16T02:14:13.640 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/quota/ 2023-11-16T02:14:13.640 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 30881 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/quota/quota_tree.ko 2023-11-16T02:14:13.640 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14361 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/quota/quota_v1.ko 2023-11-16T02:14:13.640 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22017 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/quota/quota_v2.ko 2023-11-16T02:14:13.640 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/reiserfs/ 2023-11-16T02:14:13.640 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 532673 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/reiserfs/reiserfs.ko 2023-11-16T02:14:13.641 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/romfs/ 2023-11-16T02:14:13.641 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28641 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/romfs/romfs.ko 2023-11-16T02:14:13.641 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/smb/ 2023-11-16T02:14:13.641 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/smb/client/ 2023-11-16T02:14:13.641 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 2668121 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/smb/client/cifs.ko 2023-11-16T02:14:13.641 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/smb/common/ 2023-11-16T02:14:13.641 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7161 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/smb/common/cifs_arc4.ko 2023-11-16T02:14:13.641 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11257 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/smb/common/cifs_md4.ko 2023-11-16T02:14:13.641 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/squashfs/ 2023-11-16T02:14:13.641 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 134641 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/squashfs/squashfs.ko 2023-11-16T02:14:13.641 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/sysv/ 2023-11-16T02:14:13.641 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 90721 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/sysv/sysv.ko 2023-11-16T02:14:13.641 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/udf/ 2023-11-16T02:14:13.642 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 247737 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/udf/udf.ko 2023-11-16T02:14:13.642 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ufs/ 2023-11-16T02:14:13.642 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 162497 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/ufs/ufs.ko 2023-11-16T02:14:13.642 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/xfs/ 2023-11-16T02:14:13.642 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 4010729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/fs/xfs/xfs.ko 2023-11-16T02:14:13.690 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/kernel/ 2023-11-16T02:14:13.690 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/kernel/locking/ 2023-11-16T02:14:13.691 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 75489 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/kernel/locking/locktorture.ko 2023-11-16T02:14:13.691 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/kernel/time/ 2023-11-16T02:14:13.691 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13737 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/kernel/time/test_udelay.ko 2023-11-16T02:14:13.691 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 60553 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/kernel/torture.ko 2023-11-16T02:14:13.691 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/ 2023-11-16T02:14:13.691 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 6833 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/crc-itu-t.ko 2023-11-16T02:14:13.692 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 6529 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/crc7.ko 2023-11-16T02:14:13.692 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7025 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/crc8.ko 2023-11-16T02:14:13.692 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/crypto/ 2023-11-16T02:14:13.692 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7097 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/crypto/libarc4.ko 2023-11-16T02:14:13.692 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 37081 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/crypto/libdes.ko 2023-11-16T02:14:13.692 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13313 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/interval_tree_test.ko 2023-11-16T02:14:13.693 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8425 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/libcrc32c.ko 2023-11-16T02:14:13.693 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24953 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/lru_cache.ko 2023-11-16T02:14:13.693 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/lz4/ 2023-11-16T02:14:13.693 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 33801 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/lz4/lz4_compress.ko 2023-11-16T02:14:13.693 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22633 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/lz4/lz4hc_compress.ko 2023-11-16T02:14:13.693 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/math/ 2023-11-16T02:14:13.693 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 6617 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/math/cordic.ko 2023-11-16T02:14:13.693 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8233 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/memory-notifier-error-inject.ko 2023-11-16T02:14:13.694 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10929 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/notifier-error-inject.ko 2023-11-16T02:14:13.694 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14089 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/percpu_test.ko 2023-11-16T02:14:13.694 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8305 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/pm-notifier-error-inject.ko 2023-11-16T02:14:13.694 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/raid6/ 2023-11-16T02:14:13.694 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 143433 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/raid6/raid6_pq.ko 2023-11-16T02:14:13.694 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21105 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/rbtree_test.ko 2023-11-16T02:14:13.694 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/reed_solomon/ 2023-11-16T02:14:13.695 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18753 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-16T02:14:13.695 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 38841 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/test-kstrtox.ko 2023-11-16T02:14:13.695 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26321 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/test-string_helpers.ko 2023-11-16T02:14:13.695 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 4760425 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/test_bpf.ko 2023-11-16T02:14:13.695 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 49089 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/test_firmware.ko 2023-11-16T02:14:13.695 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 6369 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/test_module.ko 2023-11-16T02:14:13.695 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20801 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/test_user_copy.ko 2023-11-16T02:14:13.695 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9585 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/ts_bm.ko 2023-11-16T02:14:13.696 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11121 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/ts_fsm.ko 2023-11-16T02:14:13.696 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9689 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/ts_kmp.ko 2023-11-16T02:14:13.696 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/xz/ 2023-11-16T02:14:13.696 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13545 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/lib/xz/xz_dec_test.ko 2023-11-16T02:14:13.696 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/mm/ 2023-11-16T02:14:13.696 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15425 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/mm/hwpoison-inject.ko 2023-11-16T02:14:13.696 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ 2023-11-16T02:14:13.697 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/ 2023-11-16T02:14:13.697 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 55737 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/6lowpan.ko 2023-11-16T02:14:13.697 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7049 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/nhc_dest.ko 2023-11-16T02:14:13.697 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7065 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/nhc_fragment.ko 2023-11-16T02:14:13.697 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7049 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/nhc_hop.ko 2023-11-16T02:14:13.697 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 6985 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-16T02:14:13.697 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7065 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/nhc_mobility.ko 2023-11-16T02:14:13.698 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7065 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/nhc_routing.ko 2023-11-16T02:14:13.698 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15329 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/6lowpan/nhc_udp.ko 2023-11-16T02:14:13.698 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/802/ 2023-11-16T02:14:13.698 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 30385 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/802/garp.ko 2023-11-16T02:14:13.698 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 34809 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/802/mrp.ko 2023-11-16T02:14:13.698 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8545 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/802/p8022.ko 2023-11-16T02:14:13.698 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16345 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/802/psnap.ko 2023-11-16T02:14:13.699 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11537 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/802/stp.ko 2023-11-16T02:14:13.699 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/8021q/ 2023-11-16T02:14:13.699 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 81737 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/8021q/8021q.ko 2023-11-16T02:14:13.699 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/9p/ 2023-11-16T02:14:13.699 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 198337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/9p/9pnet.ko 2023-11-16T02:14:13.699 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 35977 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/9p/9pnet_fd.ko 2023-11-16T02:14:13.699 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26345 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/9p/9pnet_rdma.ko 2023-11-16T02:14:13.700 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 32337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/9p/9pnet_virtio.ko 2023-11-16T02:14:13.700 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/batman-adv/ 2023-11-16T02:14:13.700 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 649297 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/batman-adv/batman-adv.ko 2023-11-16T02:14:13.700 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/ 2023-11-16T02:14:13.700 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 63809 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/br_netfilter.ko 2023-11-16T02:14:13.700 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 777689 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/bridge.ko 2023-11-16T02:14:13.700 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ 2023-11-16T02:14:13.701 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7657 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-16T02:14:13.701 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12385 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-16T02:14:13.701 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9169 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-16T02:14:13.701 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9073 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-16T02:14:13.701 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9625 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-16T02:14:13.701 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8737 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-16T02:14:13.701 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9145 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-16T02:14:13.702 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9825 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-16T02:14:13.702 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13217 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-16T02:14:13.702 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7585 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-16T02:14:13.702 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7593 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-16T02:14:13.702 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8385 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-16T02:14:13.702 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7537 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-16T02:14:13.702 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9593 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-16T02:14:13.702 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8649 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-16T02:14:13.703 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8889 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-16T02:14:13.703 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12401 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-16T02:14:13.703 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11529 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-16T02:14:13.703 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9817 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-16T02:14:13.703 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9793 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-16T02:14:13.703 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 55929 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/ebtables.ko 2023-11-16T02:14:13.704 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14041 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-16T02:14:13.704 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13945 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-16T02:14:13.704 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ceph/ 2023-11-16T02:14:13.704 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 1046857 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ceph/libceph.ko 2023-11-16T02:14:13.704 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/core/ 2023-11-16T02:14:13.704 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 125697 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/core/pktgen.ko 2023-11-16T02:14:13.705 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dccp/ 2023-11-16T02:14:13.705 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 194209 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dccp/dccp.ko 2023-11-16T02:14:13.705 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8665 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dccp/dccp_diag.ko 2023-11-16T02:14:13.705 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 57881 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dccp/dccp_ipv4.ko 2023-11-16T02:14:13.705 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 60337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dccp/dccp_ipv6.ko 2023-11-16T02:14:13.705 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dsa/ 2023-11-16T02:14:13.705 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 390473 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dsa/dsa_core.ko 2023-11-16T02:14:13.705 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dsa/tag_brcm.ko 2023-11-16T02:14:13.706 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12577 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dsa/tag_dsa.ko 2023-11-16T02:14:13.706 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7721 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dsa/tag_none.ko 2023-11-16T02:14:13.706 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8953 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/dsa/tag_trailer.ko 2023-11-16T02:14:13.706 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/hsr/ 2023-11-16T02:14:13.706 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 99729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/hsr/hsr.ko 2023-11-16T02:14:13.706 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ieee802154/ 2023-11-16T02:14:13.707 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ieee802154/6lowpan/ 2023-11-16T02:14:13.707 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 45233 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-16T02:14:13.707 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 254625 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ieee802154/ieee802154.ko 2023-11-16T02:14:13.707 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 47289 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-16T02:14:13.707 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/ 2023-11-16T02:14:13.708 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/ah4.ko 2023-11-16T02:14:13.708 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 38905 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/esp4.ko 2023-11-16T02:14:13.708 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 48401 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/fou.ko 2023-11-16T02:14:13.708 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18121 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/gre.ko 2023-11-16T02:14:13.708 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 48657 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/inet_diag.ko 2023-11-16T02:14:13.708 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 60633 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/ip_gre.ko 2023-11-16T02:14:13.709 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 61225 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/ip_tunnel.ko 2023-11-16T02:14:13.709 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 34505 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/ip_vti.ko 2023-11-16T02:14:13.709 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14001 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/ipcomp.ko 2023-11-16T02:14:13.709 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28841 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/ipip.ko 2023-11-16T02:14:13.709 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/ 2023-11-16T02:14:13.709 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 37641 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-16T02:14:13.710 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8873 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-16T02:14:13.710 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10409 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-16T02:14:13.710 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 41673 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-16T02:14:13.710 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10057 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-16T02:14:13.710 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9681 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-16T02:14:13.711 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14121 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-16T02:14:13.711 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11177 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-16T02:14:13.711 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14881 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-16T02:14:13.711 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11305 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-16T02:14:13.711 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11649 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-16T02:14:13.711 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14905 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-16T02:14:13.712 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11545 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-16T02:14:13.712 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10409 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-16T02:14:13.712 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12489 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-16T02:14:13.712 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8817 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-16T02:14:13.712 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 27625 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-16T02:14:13.713 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18225 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-16T02:14:13.713 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-16T02:14:13.713 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20561 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-16T02:14:13.713 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9329 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-16T02:14:13.713 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15177 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-16T02:14:13.713 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9961 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-16T02:14:13.714 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17113 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-16T02:14:13.714 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9009 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-16T02:14:13.714 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13073 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_bic.ko 2023-11-16T02:14:13.714 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13737 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_dctcp.ko 2023-11-16T02:14:13.714 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15369 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_diag.ko 2023-11-16T02:14:13.715 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9537 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_highspeed.ko 2023-11-16T02:14:13.715 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12401 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_htcp.ko 2023-11-16T02:14:13.715 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10449 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_hybla.ko 2023-11-16T02:14:13.715 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11473 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_illinois.ko 2023-11-16T02:14:13.715 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10433 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_lp.ko 2023-11-16T02:14:13.715 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8329 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_scalable.ko 2023-11-16T02:14:13.716 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14425 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_vegas.ko 2023-11-16T02:14:13.716 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10089 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_veno.ko 2023-11-16T02:14:13.716 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10953 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_westwood.ko 2023-11-16T02:14:13.716 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10185 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tcp_yeah.ko 2023-11-16T02:14:13.716 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22601 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/tunnel4.ko 2023-11-16T02:14:13.716 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17097 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/udp_diag.ko 2023-11-16T02:14:13.717 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 41665 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/udp_tunnel.ko 2023-11-16T02:14:13.717 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11425 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-16T02:14:13.717 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/ 2023-11-16T02:14:13.717 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26441 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/ah6.ko 2023-11-16T02:14:13.717 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 39537 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/esp6.ko 2023-11-16T02:14:13.718 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14425 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/fou6.ko 2023-11-16T02:14:13.718 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 80897 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/ip6_gre.ko 2023-11-16T02:14:13.718 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 93577 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/ip6_tunnel.ko 2023-11-16T02:14:13.718 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10825 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-16T02:14:13.718 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 53273 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/ip6_vti.ko 2023-11-16T02:14:13.718 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13785 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/ipcomp6.ko 2023-11-16T02:14:13.719 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19017 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/mip6.ko 2023-11-16T02:14:13.719 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ 2023-11-16T02:14:13.719 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 42169 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-16T02:14:13.719 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11753 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-16T02:14:13.719 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9753 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-16T02:14:13.720 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14201 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-16T02:14:13.720 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-16T02:14:13.720 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7801 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-16T02:14:13.720 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16209 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-16T02:14:13.720 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16033 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-16T02:14:13.720 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8913 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-16T02:14:13.721 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9897 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-16T02:14:13.721 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10937 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-16T02:14:13.721 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10897 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-16T02:14:13.721 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11321 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-16T02:14:13.721 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11121 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-16T02:14:13.722 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15009 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-16T02:14:13.722 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11617 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-16T02:14:13.722 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10433 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-16T02:14:13.722 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 39113 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-16T02:14:13.722 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8449 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-16T02:14:13.722 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 25945 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-16T02:14:13.723 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9801 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-16T02:14:13.723 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15393 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-16T02:14:13.723 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9633 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-16T02:14:13.723 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16025 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-16T02:14:13.723 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9009 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-16T02:14:13.723 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 74073 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/sit.ko 2023-11-16T02:14:13.724 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24193 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/tunnel6.ko 2023-11-16T02:14:13.724 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23297 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-16T02:14:13.724 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/key/ 2023-11-16T02:14:13.724 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 82833 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/key/af_key.ko 2023-11-16T02:14:13.724 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/l2tp/ 2023-11-16T02:14:13.725 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 125281 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/l2tp/l2tp_core.ko 2023-11-16T02:14:13.725 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20177 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-16T02:14:13.725 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 25953 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/l2tp/l2tp_eth.ko 2023-11-16T02:14:13.725 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 35569 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/l2tp/l2tp_ip.ko 2023-11-16T02:14:13.725 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 36713 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/l2tp/l2tp_ip6.ko 2023-11-16T02:14:13.725 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 33001 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/l2tp/l2tp_netlink.ko 2023-11-16T02:14:13.726 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 53241 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/l2tp/l2tp_ppp.ko 2023-11-16T02:14:13.726 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/lapb/ 2023-11-16T02:14:13.726 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 47977 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/lapb/lapb.ko 2023-11-16T02:14:13.726 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/llc/ 2023-11-16T02:14:13.726 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23193 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/llc/llc.ko 2023-11-16T02:14:13.727 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 267777 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/llc/llc2.ko 2023-11-16T02:14:13.727 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/mac802154/ 2023-11-16T02:14:13.727 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 290417 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/mac802154/mac802154.ko 2023-11-16T02:14:13.727 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/mpls/ 2023-11-16T02:14:13.727 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9393 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/mpls/mpls_gso.ko 2023-11-16T02:14:13.727 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ 2023-11-16T02:14:13.728 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ 2023-11-16T02:14:13.728 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 119585 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set.ko 2023-11-16T02:14:13.728 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28353 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-16T02:14:13.728 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26913 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-16T02:14:13.728 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26369 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-16T02:14:13.729 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 100297 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-16T02:14:13.729 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 101441 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-16T02:14:13.729 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 102817 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-16T02:14:13.729 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 103481 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-16T02:14:13.729 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 112849 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-16T02:14:13.729 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 60329 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-16T02:14:13.730 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 109593 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-16T02:14:13.730 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 113129 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-16T02:14:13.730 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 112585 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-16T02:14:13.730 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 111585 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-16T02:14:13.730 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 114465 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-16T02:14:13.730 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 30025 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-16T02:14:13.731 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ 2023-11-16T02:14:13.731 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 411729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-16T02:14:13.731 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11961 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-16T02:14:13.731 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7625 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-16T02:14:13.731 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-16T02:14:13.732 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17905 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-16T02:14:13.732 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20737 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-16T02:14:13.732 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7689 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-16T02:14:13.732 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7689 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-16T02:14:13.732 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10681 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-16T02:14:13.732 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9233 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-16T02:14:13.733 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7697 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-16T02:14:13.733 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13521 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-16T02:14:13.733 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7697 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-16T02:14:13.733 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10993 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-16T02:14:13.733 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 49257 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conncount.ko 2023-11-16T02:14:13.734 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 408257 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack.ko 2023-11-16T02:14:13.734 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15985 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-16T02:14:13.734 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10177 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-16T02:14:13.734 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 33761 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-16T02:14:13.734 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 118145 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-16T02:14:13.734 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22185 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-16T02:14:13.735 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8817 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-16T02:14:13.735 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 107297 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-16T02:14:13.735 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 33633 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-16T02:14:13.735 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17401 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-16T02:14:13.735 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 66641 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-16T02:14:13.736 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11233 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-16T02:14:13.736 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19185 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-16T02:14:13.736 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10113 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-16T02:14:13.736 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 89473 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_flow_table.ko 2023-11-16T02:14:13.736 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9593 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-16T02:14:13.736 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 37129 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_log_syslog.ko 2023-11-16T02:14:13.737 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 95417 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_nat.ko 2023-11-16T02:14:13.737 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10129 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-16T02:14:13.737 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12625 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-16T02:14:13.737 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11857 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_nat_irc.ko 2023-11-16T02:14:13.737 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28929 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_nat_sip.ko 2023-11-16T02:14:13.738 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8809 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-16T02:14:13.738 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 44065 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-16T02:14:13.738 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 615313 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nf_tables.ko 2023-11-16T02:14:13.738 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 42561 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nfnetlink.ko 2023-11-16T02:14:13.738 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 30233 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-16T02:14:13.738 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 30569 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-16T02:14:13.739 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 39785 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nfnetlink_log.ko 2023-11-16T02:14:13.739 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22921 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-16T02:14:13.739 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 49377 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-16T02:14:13.739 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10457 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_chain_nat.ko 2023-11-16T02:14:13.739 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 33209 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_compat.ko 2023-11-16T02:14:13.740 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 40721 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_ct.ko 2023-11-16T02:14:13.740 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9601 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-16T02:14:13.740 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11401 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_fib.ko 2023-11-16T02:14:13.740 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13745 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-16T02:14:13.740 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14185 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_hash.ko 2023-11-16T02:14:13.740 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20065 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_limit.ko 2023-11-16T02:14:13.741 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15401 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_log.ko 2023-11-16T02:14:13.741 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14801 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_masq.ko 2023-11-16T02:14:13.741 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14329 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_nat.ko 2023-11-16T02:14:13.741 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13673 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_numgen.ko 2023-11-16T02:14:13.741 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11841 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_osf.ko 2023-11-16T02:14:13.741 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14073 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_queue.ko 2023-11-16T02:14:13.742 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14193 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_redir.ko 2023-11-16T02:14:13.742 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10497 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_reject.ko 2023-11-16T02:14:13.742 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10081 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_reject_inet.ko 2023-11-16T02:14:13.742 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12737 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_socket.ko 2023-11-16T02:14:13.743 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20369 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_synproxy.ko 2023-11-16T02:14:13.743 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14849 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/nft_tproxy.ko 2023-11-16T02:14:13.743 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 89313 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/x_tables.ko 2023-11-16T02:14:13.743 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12097 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_AUDIT.ko 2023-11-16T02:14:13.743 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9633 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-16T02:14:13.744 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-16T02:14:13.744 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11521 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-16T02:14:13.744 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 18169 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_CT.ko 2023-11-16T02:14:13.744 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10497 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_DSCP.ko 2023-11-16T02:14:13.744 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9465 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_HL.ko 2023-11-16T02:14:13.744 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13433 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_HMARK.ko 2023-11-16T02:14:13.745 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 38873 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-16T02:14:13.745 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13889 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_LED.ko 2023-11-16T02:14:13.745 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11489 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_LOG.ko 2023-11-16T02:14:13.745 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11753 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-16T02:14:13.745 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11657 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_NETMAP.ko 2023-11-16T02:14:13.746 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9473 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_NFLOG.ko 2023-11-16T02:14:13.746 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13289 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-16T02:14:13.746 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19665 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_RATEEST.ko 2023-11-16T02:14:13.746 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11073 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-16T02:14:13.746 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 14337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_SECMARK.ko 2023-11-16T02:14:13.746 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16057 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-16T02:14:13.747 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10433 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-16T02:14:13.747 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17361 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_TEE.ko 2023-11-16T02:14:13.747 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16785 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_TPROXY.ko 2023-11-16T02:14:13.747 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8321 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_TRACE.ko 2023-11-16T02:14:13.747 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13897 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_addrtype.ko 2023-11-16T02:14:13.748 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13897 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_bpf.ko 2023-11-16T02:14:13.748 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15529 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_cgroup.ko 2023-11-16T02:14:13.748 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11209 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_cluster.ko 2023-11-16T02:14:13.748 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7505 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_comment.ko 2023-11-16T02:14:13.748 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10465 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_connbytes.ko 2023-11-16T02:14:13.748 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11081 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_connlabel.ko 2023-11-16T02:14:13.749 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9401 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_connlimit.ko 2023-11-16T02:14:13.749 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13129 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_connmark.ko 2023-11-16T02:14:13.749 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12401 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_conntrack.ko 2023-11-16T02:14:13.749 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7817 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_cpu.ko 2023-11-16T02:14:13.749 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10969 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_dccp.ko 2023-11-16T02:14:13.749 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7865 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_devgroup.ko 2023-11-16T02:14:13.750 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8801 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_dscp.ko 2023-11-16T02:14:13.750 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10657 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_ecn.ko 2023-11-16T02:14:13.750 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11473 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_esp.ko 2023-11-16T02:14:13.750 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 43289 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_hashlimit.ko 2023-11-16T02:14:13.750 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11313 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_helper.ko 2023-11-16T02:14:13.750 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7865 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_hl.ko 2023-11-16T02:14:13.751 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11921 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_ipcomp.ko 2023-11-16T02:14:13.751 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11473 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_iprange.ko 2023-11-16T02:14:13.751 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11785 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_ipvs.ko 2023-11-16T02:14:13.751 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16041 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_l2tp.ko 2023-11-16T02:14:13.751 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8001 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_length.ko 2023-11-16T02:14:13.751 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10273 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_limit.ko 2023-11-16T02:14:13.752 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7545 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_mac.ko 2023-11-16T02:14:13.752 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8641 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_mark.ko 2023-11-16T02:14:13.752 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11825 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_multiport.ko 2023-11-16T02:14:13.752 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13817 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_nat.ko 2023-11-16T02:14:13.752 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10105 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_nfacct.ko 2023-11-16T02:14:13.753 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8297 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_osf.ko 2023-11-16T02:14:13.753 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9553 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_owner.ko 2023-11-16T02:14:13.753 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_physdev.ko 2023-11-16T02:14:13.753 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7633 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_pkttype.ko 2023-11-16T02:14:13.753 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11985 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_policy.ko 2023-11-16T02:14:13.753 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9473 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_quota.ko 2023-11-16T02:14:13.753 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10409 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_rateest.ko 2023-11-16T02:14:13.754 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8257 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_realm.ko 2023-11-16T02:14:13.754 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 36497 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_recent.ko 2023-11-16T02:14:13.754 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13393 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_sctp.ko 2023-11-16T02:14:13.754 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 30089 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_set.ko 2023-11-16T02:14:13.754 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 16089 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_socket.ko 2023-11-16T02:14:13.754 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9505 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_state.ko 2023-11-16T02:14:13.754 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9473 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_statistic.ko 2023-11-16T02:14:13.755 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8809 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_string.ko 2023-11-16T02:14:13.755 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 8553 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_tcpmss.ko 2023-11-16T02:14:13.755 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15777 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_tcpudp.ko 2023-11-16T02:14:13.755 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11129 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_time.ko 2023-11-16T02:14:13.755 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9401 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netfilter/xt_u32.ko 2023-11-16T02:14:13.755 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netlink/ 2023-11-16T02:14:13.755 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13969 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/netlink/netlink_diag.ko 2023-11-16T02:14:13.756 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/nsh/ 2023-11-16T02:14:13.756 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 12425 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/nsh/nsh.ko 2023-11-16T02:14:13.756 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/openvswitch/ 2023-11-16T02:14:13.756 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 380033 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/openvswitch/openvswitch.ko 2023-11-16T02:14:13.756 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10321 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/openvswitch/vport-geneve.ko 2023-11-16T02:14:13.756 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9449 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/openvswitch/vport-gre.ko 2023-11-16T02:14:13.756 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 11793 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/openvswitch/vport-vxlan.ko 2023-11-16T02:14:13.756 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/packet/ 2023-11-16T02:14:13.757 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13057 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/packet/af_packet_diag.ko 2023-11-16T02:14:13.757 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/phonet/ 2023-11-16T02:14:13.757 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 110201 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/phonet/phonet.ko 2023-11-16T02:14:13.757 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 54697 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/phonet/pn_pep.ko 2023-11-16T02:14:13.757 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/rds/ 2023-11-16T02:14:13.757 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 251481 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/rds/rds.ko 2023-11-16T02:14:13.757 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 164937 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/rds/rds_rdma.ko 2023-11-16T02:14:13.758 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 67377 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/rds/rds_tcp.ko 2023-11-16T02:14:13.758 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/rxrpc/ 2023-11-16T02:14:13.758 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 819657 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/rxrpc/rxrpc.ko 2023-11-16T02:14:13.758 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/ 2023-11-16T02:14:13.758 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 32241 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_csum.ko 2023-11-16T02:14:13.758 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23577 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_gact.ko 2023-11-16T02:14:13.759 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26873 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_ipt.ko 2023-11-16T02:14:13.759 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 34097 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_mirred.ko 2023-11-16T02:14:13.759 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23401 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_nat.ko 2023-11-16T02:14:13.759 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 43449 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_pedit.ko 2023-11-16T02:14:13.759 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 31961 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_police.ko 2023-11-16T02:14:13.759 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20289 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_simple.ko 2023-11-16T02:14:13.759 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 35297 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_skbedit.ko 2023-11-16T02:14:13.760 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 36665 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/act_vlan.ko 2023-11-16T02:14:13.760 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26169 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/cls_basic.ko 2023-11-16T02:14:13.760 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 33961 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/cls_bpf.ko 2023-11-16T02:14:13.760 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19233 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/cls_cgroup.ko 2023-11-16T02:14:13.760 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 31401 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/cls_flow.ko 2023-11-16T02:14:13.760 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 31769 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/cls_fw.ko 2023-11-16T02:14:13.760 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 38489 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/cls_route.ko 2023-11-16T02:14:13.760 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 61409 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/cls_u32.ko 2023-11-16T02:14:13.761 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7441 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/em_cmp.ko 2023-11-16T02:14:13.761 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 13409 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/em_ipset.ko 2023-11-16T02:14:13.761 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 33289 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/em_meta.ko 2023-11-16T02:14:13.761 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7897 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/em_nbyte.ko 2023-11-16T02:14:13.761 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10625 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/em_text.ko 2023-11-16T02:14:13.761 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7249 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/em_u32.ko 2023-11-16T02:14:13.761 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 21649 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_choke.ko 2023-11-16T02:14:13.761 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20849 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_codel.ko 2023-11-16T02:14:13.761 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 34633 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_drr.ko 2023-11-16T02:14:13.761 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 33609 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_fq.ko 2023-11-16T02:14:13.762 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 31617 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_fq_codel.ko 2023-11-16T02:14:13.762 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 35433 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_gred.ko 2023-11-16T02:14:13.762 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 49601 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_hfsc.ko 2023-11-16T02:14:13.762 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22089 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_hhf.ko 2023-11-16T02:14:13.762 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 66393 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_htb.ko 2023-11-16T02:14:13.762 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26073 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_ingress.ko 2023-11-16T02:14:13.762 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 30273 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_mqprio.ko 2023-11-16T02:14:13.763 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10793 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_mqprio_lib.ko 2023-11-16T02:14:13.763 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26065 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_multiq.ko 2023-11-16T02:14:13.763 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 36137 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_netem.ko 2023-11-16T02:14:13.763 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 27497 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_pie.ko 2023-11-16T02:14:13.763 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10625 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_plug.ko 2023-11-16T02:14:13.763 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 24729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_prio.ko 2023-11-16T02:14:13.764 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 48793 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_qfq.ko 2023-11-16T02:14:13.764 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 32905 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_red.ko 2023-11-16T02:14:13.764 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 26881 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_sfb.ko 2023-11-16T02:14:13.764 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 31353 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_sfq.ko 2023-11-16T02:14:13.764 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28897 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_tbf.ko 2023-11-16T02:14:13.765 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 28105 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sched/sch_teql.ko 2023-11-16T02:14:13.765 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sctp/ 2023-11-16T02:14:13.765 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 929745 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sctp/sctp.ko 2023-11-16T02:14:13.765 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 19033 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sctp/sctp_diag.ko 2023-11-16T02:14:13.765 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sunrpc/ 2023-11-16T02:14:13.765 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sunrpc/auth_gss/ 2023-11-16T02:14:13.766 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 336529 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-16T02:14:13.766 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 54737 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-16T02:14:13.766 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 1520161 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sunrpc/sunrpc.ko 2023-11-16T02:14:13.766 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sunrpc/xprtrdma/ 2023-11-16T02:14:13.766 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 707721 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-16T02:14:13.766 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/tipc/ 2023-11-16T02:14:13.767 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10025 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/tipc/diag.ko 2023-11-16T02:14:13.767 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 862641 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/tipc/tipc.ko 2023-11-16T02:14:13.767 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/unix/ 2023-11-16T02:14:13.767 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15729 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/unix/unix_diag.ko 2023-11-16T02:14:13.767 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/vmw_vsock/ 2023-11-16T02:14:13.767 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 85337 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-16T02:14:13.768 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 68049 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-16T02:14:13.768 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 96193 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/vmw_vsock/vsock.ko 2023-11-16T02:14:13.768 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 10705 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-16T02:14:13.768 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 17521 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-16T02:14:13.768 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/x25/ 2023-11-16T02:14:13.768 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 125177 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/x25/x25.ko 2023-11-16T02:14:13.768 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/xfrm/ 2023-11-16T02:14:13.768 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 22657 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/xfrm/xfrm_algo.ko 2023-11-16T02:14:13.769 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 20649 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-16T02:14:13.769 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 102257 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/net/xfrm/xfrm_user.ko 2023-11-16T02:14:13.769 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/virt/ 2023-11-16T02:14:13.769 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/virt/lib/ 2023-11-16T02:14:13.769 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 15537 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/kernel/virt/lib/irqbypass.ko 2023-11-16T02:14:13.769 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 639863 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.alias 2023-11-16T02:14:13.769 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 623919 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.alias.bin 2023-11-16T02:14:13.769 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 7663 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.builtin 2023-11-16T02:14:13.769 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 23428 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.builtin.alias.bin 2023-11-16T02:14:13.770 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 9821 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.builtin.bin 2023-11-16T02:14:13.770 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 70004 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.builtin.modinfo 2023-11-16T02:14:13.770 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 146313 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.dep 2023-11-16T02:14:13.770 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 232548 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.dep.bin 2023-11-16T02:14:13.770 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 210 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.devname 2023-11-16T02:14:13.770 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 72606 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.order 2023-11-16T02:14:13.771 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 879 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.softdep 2023-11-16T02:14:13.771 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 254438 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.symbols 2023-11-16T02:14:13.771 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 309363 2023-11-07 03:18 ./lib/modules/6.6.0-rc5-g3b796cfe2969/modules.symbols.bin 2023-11-16T02:14:13.771 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./usr/ 2023-11-16T02:14:13.771 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./usr/share/ 2023-11-16T02:14:13.771 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./usr/share/doc/ 2023-11-16T02:14:13.772 INFO:teuthology.orchestra.run.smithi204.stdout:drwxr-xr-x root/root 0 2023-11-07 03:18 ./usr/share/doc/linux-image-6.6.0-rc5-g3b796cfe2969/ 2023-11-16T02:14:13.772 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 175 2023-11-07 03:18 ./usr/share/doc/linux-image-6.6.0-rc5-g3b796cfe2969/changelog.Debian.gz 2023-11-16T02:14:13.772 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-r--r-- root/root 691 2023-11-07 03:18 ./usr/share/doc/linux-image-6.6.0-rc5-g3b796cfe2969/copyright 2023-11-16T02:14:13.773 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g3b796cfe2969 2023-11-16T02:14:13.773 INFO:teuthology.task.kernel:searching for kernel 6.6.0-rc5-g3b796cfe2969 2023-11-16T02:14:13.773 DEBUG:teuthology.orchestra.run.smithi204:> egrep '(submenu|menuentry.*6.6.0-rc5-g3b796cfe2969).*{' /boot/grub/grub.cfg 2023-11-16T02:14:13.781 INFO:teuthology.orchestra.run.smithi204.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-16T02:14:13.781 INFO:teuthology.orchestra.run.smithi204.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g3b796cfe2969' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g3b796cfe2969-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-16T02:14:13.782 INFO:teuthology.orchestra.run.smithi204.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g3b796cfe2969 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g3b796cfe2969-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-16T02:14:13.783 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-16T02:14:13.783 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-rc5-g3b796cfe2969 2023-11-16T02:14:13.783 DEBUG:teuthology.orchestra.run.smithi204:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-16T02:14:13.824 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi204.front.sepia.ceph.com to complete... 2023-11-16T02:14:14.250 INFO:teuthology.orchestra.run.smithi204.stderr:Sourcing file `/etc/default/grub' 2023-11-16T02:14:14.252 INFO:teuthology.orchestra.run.smithi204.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-16T02:14:14.274 INFO:teuthology.orchestra.run.smithi204.stderr:Generating grub configuration file ... 2023-11-16T02:14:14.459 INFO:teuthology.orchestra.run.smithi204.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g3b796cfe2969 2023-11-16T02:14:14.465 INFO:teuthology.orchestra.run.smithi204.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g3b796cfe2969 2023-11-16T02:14:14.675 INFO:teuthology.orchestra.run.smithi204.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-16T02:14:14.680 INFO:teuthology.orchestra.run.smithi204.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-16T02:14:14.723 INFO:teuthology.orchestra.run.smithi204.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-16T02:14:14.728 INFO:teuthology.orchestra.run.smithi204.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-16T02:14:14.850 INFO:teuthology.orchestra.run.smithi204.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-16T02:14:14.851 INFO:teuthology.orchestra.run.smithi204.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-16T02:14:14.851 INFO:teuthology.orchestra.run.smithi204.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-16T02:14:14.874 INFO:teuthology.orchestra.run.smithi204.stderr:done 2023-11-16T02:14:46.020 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-11-16T02:14:46.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2023-11-16T02:14:46.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T02:15:20.698 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-11-16T02:15:29.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2023-11-16T02:15:29.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T02:16:29.704 DEBUG:teuthology.orchestra.remote:timed out 2023-11-16T02:16:41.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2023-11-16T02:16:41.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T02:16:41.977 DEBUG:teuthology.orchestra.run.smithi204:> true 2023-11-16T02:16:42.674 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2023-11-16T02:16:42.674 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-rc5-g3b796cfe2969"... 2023-11-16T02:16:42.675 DEBUG:teuthology.orchestra.run.smithi204:> uname -r 2023-11-16T02:16:42.724 INFO:teuthology.orchestra.run.smithi204.stdout:6.6.0-rc5-g3b796cfe2969 2023-11-16T02:16:42.724 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g3b796cfe2969 vs 6.6.0-rc5-g3b796cfe2969 2023-11-16T02:16:42.725 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-16T02:16:42.725 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-16T02:16:43.726 DEBUG:teuthology.parallel:result is None 2023-11-16T02:16:43.726 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-16T02:16:43.737 INFO:teuthology.task.internal:Creating test directory... 2023-11-16T02:16:43.739 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-16T02:16:43.742 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-16T02:16:43.744 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-16T02:16:43.754 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-16T02:16:43.766 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-16T02:16:43.780 INFO:teuthology.task.internal:Creating archive directory... 2023-11-16T02:16:43.780 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-16T02:16:43.791 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-16T02:16:43.793 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-16T02:16:43.824 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-16T02:16:43.832 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-16T02:16:43.832 DEBUG:teuthology.orchestra.run.smithi028:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-16T02:16:43.846 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-16T02:16:43.847 DEBUG:teuthology.orchestra.run.smithi070:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-16T02:16:43.855 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-16T02:16:43.856 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-16T02:16:43.892 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-16T02:16:43.901 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-16T02:16:43.930 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-16T02:16:43.937 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-16T02:16:43.948 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-16T02:16:43.955 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-16T02:16:43.974 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-16T02:16:43.997 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-16T02:16:44.004 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-16T02:16:44.013 INFO:teuthology.task.internal:Configuring sudo... 2023-11-16T02:16:44.013 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-16T02:16:44.015 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-16T02:16:44.017 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-16T02:16:44.041 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-16T02:16:44.051 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-16T02:16:44.051 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-16T02:16:44.075 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-16T02:16:44.077 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-16T02:16:44.097 DEBUG:teuthology.orchestra.run.smithi028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-16T02:16:44.127 DEBUG:teuthology.orchestra.run.smithi028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-16T02:16:44.174 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-16T02:16:44.174 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-16T02:16:44.239 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-16T02:16:44.245 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-16T02:16:44.292 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-16T02:16:44.293 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-16T02:16:44.356 DEBUG:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-16T02:16:44.365 DEBUG:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-16T02:16:44.417 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-16T02:16:44.418 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-16T02:16:44.490 DEBUG:teuthology.orchestra.run.smithi028:> sudo service rsyslog restart 2023-11-16T02:16:44.492 DEBUG:teuthology.orchestra.run.smithi070:> sudo service rsyslog restart 2023-11-16T02:16:44.495 DEBUG:teuthology.orchestra.run.smithi204:> sudo service rsyslog restart 2023-11-16T02:16:44.635 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-16T02:16:44.642 INFO:teuthology.task.internal:Starting timer... 2023-11-16T02:16:44.642 INFO:teuthology.run_tasks:Running task pcp... 2023-11-16T02:16:44.664 INFO:teuthology.run_tasks:Running task selinux... 2023-11-16T02:16:44.676 DEBUG:teuthology.task.selinux:Excluding smithi028: OS 'ubuntu' does not support SELinux 2023-11-16T02:16:44.676 DEBUG:teuthology.task.selinux:Excluding smithi070: OS 'ubuntu' does not support SELinux 2023-11-16T02:16:44.676 DEBUG:teuthology.task.selinux:Excluding smithi204: OS 'ubuntu' does not support SELinux 2023-11-16T02:16:44.676 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-16T02:16:44.677 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-16T02:16:44.677 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-16T02:16:44.677 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-16T02:16:44.688 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-16T02:16:44.689 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-16T02:16:44.706 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-16T02:16:44.708 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi028.front.sepia.ceph.com,smithi070.front.sepia.ceph.com,smithi204.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-16T02:25:28.788 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi028.front.sepia.ceph.com'), Remote(name='ubuntu@smithi070.front.sepia.ceph.com'), Remote(name='ubuntu@smithi204.front.sepia.ceph.com')] 2023-11-16T02:25:28.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2023-11-16T02:25:28.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T02:25:28.867 DEBUG:teuthology.orchestra.run.smithi028:> true 2023-11-16T02:25:28.985 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com' 2023-11-16T02:25:28.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2023-11-16T02:25:28.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T02:25:29.061 DEBUG:teuthology.orchestra.run.smithi070:> true 2023-11-16T02:25:29.178 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2023-11-16T02:25:29.178 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2023-11-16T02:25:29.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T02:25:29.261 DEBUG:teuthology.orchestra.run.smithi204:> true 2023-11-16T02:25:29.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2023-11-16T02:25:29.382 INFO:teuthology.run_tasks:Running task clock... 2023-11-16T02:25:29.393 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-16T02:25:29.394 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-16T02:25:29.394 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-16T02:25:29.399 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-16T02:25:29.399 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-16T02:25:29.402 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-16T02:25:29.402 DEBUG:teuthology.orchestra.run.smithi204:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-16T02:25:29.425 INFO:teuthology.orchestra.run.smithi028.stdout:16 Nov 02:25:29 ntpd[28516]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-16T02:25:29.425 INFO:teuthology.orchestra.run.smithi028.stdout:16 Nov 02:25:29 ntpd[28516]: Command line: ntpd -gq 2023-11-16T02:25:29.425 INFO:teuthology.orchestra.run.smithi028.stdout:16 Nov 02:25:29 ntpd[28516]: ---------------------------------------------------- 2023-11-16T02:25:29.425 INFO:teuthology.orchestra.run.smithi028.stdout:16 Nov 02:25:29 ntpd[28516]: ntp-4 is maintained by Network Time Foundation, 2023-11-16T02:25:29.426 INFO:teuthology.orchestra.run.smithi028.stdout:16 Nov 02:25:29 ntpd[28516]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-16T02:25:29.426 INFO:teuthology.orchestra.run.smithi028.stdout:16 Nov 02:25:29 ntpd[28516]: corporation. Support and training for ntp-4 are 2023-11-16T02:25:29.426 INFO:teuthology.orchestra.run.smithi028.stdout:16 Nov 02:25:29 ntpd[28516]: available at https://www.nwtime.org/support 2023-11-16T02:25:29.426 INFO:teuthology.orchestra.run.smithi028.stdout:16 Nov 02:25:29 ntpd[28516]: ---------------------------------------------------- 2023-11-16T02:25:29.426 INFO:teuthology.orchestra.run.smithi028.stdout:16 Nov 02:25:29 ntpd[28516]: proto: precision = 0.046 usec (-24) 2023-11-16T02:25:29.426 INFO:teuthology.orchestra.run.smithi028.stdout:16 Nov 02:25:29 ntpd[28516]: basedate set to 2022-02-04 2023-11-16T02:25:29.426 INFO:teuthology.orchestra.run.smithi028.stdout:16 Nov 02:25:29 ntpd[28516]: gps base set to 2022-02-06 (week 2196) 2023-11-16T02:25:29.426 INFO:teuthology.orchestra.run.smithi028.stdout:16 Nov 02:25:29 ntpd[28516]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-16T02:25:29.427 INFO:teuthology.orchestra.run.smithi028.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-16T02:25:29.427 INFO:teuthology.orchestra.run.smithi028.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-16T02:25:29.428 INFO:teuthology.orchestra.run.smithi028.stdout:16 Nov 02:25:29 ntpd[28516]: restrict ::: KOD does nothing without LIMITED. 2023-11-16T02:25:29.428 INFO:teuthology.orchestra.run.smithi028.stdout:16 Nov 02:25:29 ntpd[28516]: Listen and drop on 0 v6wildcard [::]:123 2023-11-16T02:25:29.429 INFO:teuthology.orchestra.run.smithi028.stdout:16 Nov 02:25:29 ntpd[28516]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-16T02:25:29.429 INFO:teuthology.orchestra.run.smithi028.stdout:16 Nov 02:25:29 ntpd[28516]: Listen normally on 2 lo 127.0.0.1:123 2023-11-16T02:25:29.429 INFO:teuthology.orchestra.run.smithi028.stdout:16 Nov 02:25:29 ntpd[28516]: Listen normally on 3 ens1f0 172.21.15.28:123 2023-11-16T02:25:29.429 INFO:teuthology.orchestra.run.smithi028.stdout:16 Nov 02:25:29 ntpd[28516]: Listen normally on 4 lo [::1]:123 2023-11-16T02:25:29.429 INFO:teuthology.orchestra.run.smithi028.stdout:16 Nov 02:25:29 ntpd[28516]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fea5:ca3c%4]:123 2023-11-16T02:25:29.429 INFO:teuthology.orchestra.run.smithi028.stdout:16 Nov 02:25:29 ntpd[28516]: Listening on routing socket on fd #22 for interface updates 2023-11-16T02:25:29.432 INFO:teuthology.orchestra.run.smithi070.stdout:16 Nov 02:25:29 ntpd[28413]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-16T02:25:29.432 INFO:teuthology.orchestra.run.smithi070.stdout:16 Nov 02:25:29 ntpd[28413]: Command line: ntpd -gq 2023-11-16T02:25:29.432 INFO:teuthology.orchestra.run.smithi070.stdout:16 Nov 02:25:29 ntpd[28413]: ---------------------------------------------------- 2023-11-16T02:25:29.432 INFO:teuthology.orchestra.run.smithi070.stdout:16 Nov 02:25:29 ntpd[28413]: ntp-4 is maintained by Network Time Foundation, 2023-11-16T02:25:29.432 INFO:teuthology.orchestra.run.smithi070.stdout:16 Nov 02:25:29 ntpd[28413]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-16T02:25:29.432 INFO:teuthology.orchestra.run.smithi070.stdout:16 Nov 02:25:29 ntpd[28413]: corporation. Support and training for ntp-4 are 2023-11-16T02:25:29.433 INFO:teuthology.orchestra.run.smithi070.stdout:16 Nov 02:25:29 ntpd[28413]: available at https://www.nwtime.org/support 2023-11-16T02:25:29.433 INFO:teuthology.orchestra.run.smithi070.stdout:16 Nov 02:25:29 ntpd[28413]: ---------------------------------------------------- 2023-11-16T02:25:29.434 INFO:teuthology.orchestra.run.smithi070.stdout:16 Nov 02:25:29 ntpd[28413]: proto: precision = 0.047 usec (-24) 2023-11-16T02:25:29.434 INFO:teuthology.orchestra.run.smithi070.stdout:16 Nov 02:25:29 ntpd[28413]: basedate set to 2022-02-04 2023-11-16T02:25:29.434 INFO:teuthology.orchestra.run.smithi070.stdout:16 Nov 02:25:29 ntpd[28413]: gps base set to 2022-02-06 (week 2196) 2023-11-16T02:25:29.434 INFO:teuthology.orchestra.run.smithi070.stdout:16 Nov 02:25:29 ntpd[28413]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-16T02:25:29.435 INFO:teuthology.orchestra.run.smithi070.stdout:16 Nov 02:25:29 ntpd[28413]: restrict ::: KOD does nothing without LIMITED. 2023-11-16T02:25:29.435 INFO:teuthology.orchestra.run.smithi070.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-16T02:25:29.435 INFO:teuthology.orchestra.run.smithi070.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-16T02:25:29.436 INFO:teuthology.orchestra.run.smithi070.stdout:16 Nov 02:25:29 ntpd[28413]: Listen and drop on 0 v6wildcard [::]:123 2023-11-16T02:25:29.436 INFO:teuthology.orchestra.run.smithi070.stdout:16 Nov 02:25:29 ntpd[28413]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-16T02:25:29.436 INFO:teuthology.orchestra.run.smithi070.stdout:16 Nov 02:25:29 ntpd[28413]: Listen normally on 2 lo 127.0.0.1:123 2023-11-16T02:25:29.437 INFO:teuthology.orchestra.run.smithi070.stdout:16 Nov 02:25:29 ntpd[28413]: Listen normally on 3 enp3s0f1 172.21.15.70:123 2023-11-16T02:25:29.437 INFO:teuthology.orchestra.run.smithi070.stdout:16 Nov 02:25:29 ntpd[28413]: Listen normally on 4 lo [::1]:123 2023-11-16T02:25:29.437 INFO:teuthology.orchestra.run.smithi070.stdout:16 Nov 02:25:29 ntpd[28413]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3e7%5]:123 2023-11-16T02:25:29.437 INFO:teuthology.orchestra.run.smithi070.stdout:16 Nov 02:25:29 ntpd[28413]: Listening on routing socket on fd #22 for interface updates 2023-11-16T02:25:29.462 INFO:teuthology.orchestra.run.smithi204.stdout:16 Nov 02:25:29 ntpd[27962]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-16T02:25:29.463 INFO:teuthology.orchestra.run.smithi204.stdout:16 Nov 02:25:29 ntpd[27962]: Command line: ntpd -gq 2023-11-16T02:25:29.463 INFO:teuthology.orchestra.run.smithi204.stdout:16 Nov 02:25:29 ntpd[27962]: ---------------------------------------------------- 2023-11-16T02:25:29.463 INFO:teuthology.orchestra.run.smithi204.stdout:16 Nov 02:25:29 ntpd[27962]: ntp-4 is maintained by Network Time Foundation, 2023-11-16T02:25:29.463 INFO:teuthology.orchestra.run.smithi204.stdout:16 Nov 02:25:29 ntpd[27962]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-16T02:25:29.463 INFO:teuthology.orchestra.run.smithi204.stdout:16 Nov 02:25:29 ntpd[27962]: corporation. Support and training for ntp-4 are 2023-11-16T02:25:29.463 INFO:teuthology.orchestra.run.smithi204.stdout:16 Nov 02:25:29 ntpd[27962]: available at https://www.nwtime.org/support 2023-11-16T02:25:29.463 INFO:teuthology.orchestra.run.smithi204.stdout:16 Nov 02:25:29 ntpd[27962]: ---------------------------------------------------- 2023-11-16T02:25:29.464 INFO:teuthology.orchestra.run.smithi204.stdout:16 Nov 02:25:29 ntpd[27962]: proto: precision = 0.042 usec (-24) 2023-11-16T02:25:29.464 INFO:teuthology.orchestra.run.smithi204.stdout:16 Nov 02:25:29 ntpd[27962]: basedate set to 2022-02-04 2023-11-16T02:25:29.465 INFO:teuthology.orchestra.run.smithi204.stdout:16 Nov 02:25:29 ntpd[27962]: gps base set to 2022-02-06 (week 2196) 2023-11-16T02:25:29.465 INFO:teuthology.orchestra.run.smithi204.stdout:16 Nov 02:25:29 ntpd[27962]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-16T02:25:29.465 INFO:teuthology.orchestra.run.smithi204.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-16T02:25:29.465 INFO:teuthology.orchestra.run.smithi204.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-16T02:25:29.466 INFO:teuthology.orchestra.run.smithi204.stdout:16 Nov 02:25:29 ntpd[27962]: restrict ::: KOD does nothing without LIMITED. 2023-11-16T02:25:29.466 INFO:teuthology.orchestra.run.smithi204.stdout:16 Nov 02:25:29 ntpd[27962]: Listen and drop on 0 v6wildcard [::]:123 2023-11-16T02:25:29.466 INFO:teuthology.orchestra.run.smithi204.stdout:16 Nov 02:25:29 ntpd[27962]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-16T02:25:29.466 INFO:teuthology.orchestra.run.smithi204.stdout:16 Nov 02:25:29 ntpd[27962]: Listen normally on 2 lo 127.0.0.1:123 2023-11-16T02:25:29.467 INFO:teuthology.orchestra.run.smithi204.stdout:16 Nov 02:25:29 ntpd[27962]: Listen normally on 3 enp3s0f1 172.21.15.204:123 2023-11-16T02:25:29.467 INFO:teuthology.orchestra.run.smithi204.stdout:16 Nov 02:25:29 ntpd[27962]: Listen normally on 4 lo [::1]:123 2023-11-16T02:25:29.467 INFO:teuthology.orchestra.run.smithi204.stdout:16 Nov 02:25:29 ntpd[27962]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:77ab%5]:123 2023-11-16T02:25:29.467 INFO:teuthology.orchestra.run.smithi204.stdout:16 Nov 02:25:29 ntpd[27962]: Listening on routing socket on fd #22 for interface updates 2023-11-16T02:25:30.429 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:30 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:30.429 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:30 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:30.430 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:30 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:30.430 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:30 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:30.430 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:30 ntpd[28413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-16T02:25:30.430 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:30 ntpd[28413]: can't open /var/log/ntpstats/peerstats.20231116: Permission denied 2023-11-16T02:25:30.463 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:30 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:30.463 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:30 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:31.429 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:31 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:31.429 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:31 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:31.464 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:31 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:31.464 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:31 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:31.464 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:31 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:31.464 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:31 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:31.464 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:31 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:31.464 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:31 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:31.464 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:31 ntpd[27962]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-16T02:25:31.464 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:31 ntpd[27962]: can't open /var/log/ntpstats/peerstats.20231116: Permission denied 2023-11-16T02:25:31.464 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:31 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:31.464 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:31 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:31.465 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:31 ntpd[27962]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-16T02:25:31.465 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:31 ntpd[27962]: can't open /var/log/ntpstats/peerstats.20231116: Permission denied 2023-11-16T02:25:32.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:32 ntpd[28516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:32.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:32 ntpd[28516]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:32.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:32 ntpd[28516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:32.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:32 ntpd[28516]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:32.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:32 ntpd[28516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:32.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:32 ntpd[28516]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:32.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:32 ntpd[28516]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-16T02:25:32.427 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:32 ntpd[28516]: can't open /var/log/ntpstats/peerstats.20231116: Permission denied 2023-11-16T02:25:32.429 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:32 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:32.429 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:32 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:32.429 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:32 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:32.430 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:32 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:32.430 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:32 ntpd[28413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-16T02:25:32.430 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:32 ntpd[28413]: can't open /var/log/ntpstats/peerstats.20231116: Permission denied 2023-11-16T02:25:33.430 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:33 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:33.430 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:33 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:33.430 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:33 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:33.430 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:33 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:33.430 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:33 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:33.430 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:33 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:33.430 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:33 ntpd[28413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-16T02:25:33.430 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:33 ntpd[28413]: can't open /var/log/ntpstats/peerstats.20231116: Permission denied 2023-11-16T02:25:33.431 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:33 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:33.431 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:33 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:33.431 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:33 ntpd[28413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-16T02:25:33.431 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:33 ntpd[28413]: can't open /var/log/ntpstats/peerstats.20231116: Permission denied 2023-11-16T02:25:33.464 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:33 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:33.464 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:33 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:33.465 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:33 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:33.465 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:33 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:33.465 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:33 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:33.465 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:33 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:33.465 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:33 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:33.465 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:33 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:33.465 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:33 ntpd[27962]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-16T02:25:33.465 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:33 ntpd[27962]: can't open /var/log/ntpstats/peerstats.20231116: Permission denied 2023-11-16T02:25:33.465 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:33 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:33.465 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:33 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:33.466 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:33 ntpd[27962]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-16T02:25:33.466 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:33 ntpd[27962]: can't open /var/log/ntpstats/peerstats.20231116: Permission denied 2023-11-16T02:25:33.466 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:33 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:33.466 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:33 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:33.466 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:33 ntpd[27962]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-16T02:25:33.466 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:33 ntpd[27962]: can't open /var/log/ntpstats/peerstats.20231116: Permission denied 2023-11-16T02:25:34.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:34 ntpd[28516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:34.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:34 ntpd[28516]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:34.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:34 ntpd[28516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:34.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:34 ntpd[28516]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:34.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:34 ntpd[28516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:34.427 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:34 ntpd[28516]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:34.427 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:34 ntpd[28516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:34.427 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:34 ntpd[28516]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:34.427 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:34 ntpd[28516]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-16T02:25:34.427 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:34 ntpd[28516]: can't open /var/log/ntpstats/peerstats.20231116: Permission denied 2023-11-16T02:25:34.427 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:34 ntpd[28516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:34.427 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:34 ntpd[28516]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:34.427 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:34 ntpd[28516]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-16T02:25:34.427 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:34 ntpd[28516]: can't open /var/log/ntpstats/peerstats.20231116: Permission denied 2023-11-16T02:25:34.427 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:34 ntpd[28516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:34.427 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:34 ntpd[28516]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:34.428 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:34 ntpd[28516]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-16T02:25:34.428 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:34 ntpd[28516]: can't open /var/log/ntpstats/peerstats.20231116: Permission denied 2023-11-16T02:25:34.429 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:34 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:34.429 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:34 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:34.429 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:34 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:34.429 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:34 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:34.429 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:34 ntpd[28413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-16T02:25:34.429 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:34 ntpd[28413]: can't open /var/log/ntpstats/peerstats.20231116: Permission denied 2023-11-16T02:25:35.430 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:35 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:35.430 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:35 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:35.430 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:35 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:35.430 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:35 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:35.430 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:35 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:35.430 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:35 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:35.430 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:35 ntpd[28413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-16T02:25:35.430 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:35 ntpd[28413]: can't open /var/log/ntpstats/peerstats.20231116: Permission denied 2023-11-16T02:25:35.430 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:35 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:35.430 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:35 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:35.431 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:35 ntpd[28413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-16T02:25:35.431 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:35 ntpd[28413]: can't open /var/log/ntpstats/peerstats.20231116: Permission denied 2023-11-16T02:25:35.465 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:35 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:35.465 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:35 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:35.466 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:35 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:35.466 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:35 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:35.466 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:35 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:35.466 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:35 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:35.466 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:35 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:35.467 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:35 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:35.467 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:35 ntpd[27962]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-16T02:25:35.467 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:35 ntpd[27962]: can't open /var/log/ntpstats/peerstats.20231116: Permission denied 2023-11-16T02:25:35.467 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:35 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:35.467 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:35 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:35.467 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:35 ntpd[27962]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-16T02:25:35.467 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:35 ntpd[27962]: can't open /var/log/ntpstats/peerstats.20231116: Permission denied 2023-11-16T02:25:35.467 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:35 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:35.467 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:35 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:35.467 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:35 ntpd[27962]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-16T02:25:35.467 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:35 ntpd[27962]: can't open /var/log/ntpstats/peerstats.20231116: Permission denied 2023-11-16T02:25:36.425 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:36 ntpd[28516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:36 ntpd[28516]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:36 ntpd[28516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:36 ntpd[28516]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:36 ntpd[28516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:36 ntpd[28516]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:36 ntpd[28516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:36 ntpd[28516]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:36 ntpd[28516]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-16T02:25:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:36 ntpd[28516]: can't open /var/log/ntpstats/peerstats.20231116: Permission denied 2023-11-16T02:25:36.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:36 ntpd[28516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:36.427 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:36 ntpd[28516]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:36.427 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:36 ntpd[28516]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-16T02:25:36.427 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:36 ntpd[28516]: can't open /var/log/ntpstats/peerstats.20231116: Permission denied 2023-11-16T02:25:36.427 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:36 ntpd[28516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:36.427 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:36 ntpd[28516]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:36.427 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:36 ntpd[28516]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-16T02:25:36.427 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:36 ntpd[28516]: can't open /var/log/ntpstats/peerstats.20231116: Permission denied 2023-11-16T02:25:36.429 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:36 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:36.429 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:36 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:36.429 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:36 ntpd[28413]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:36.429 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:36 ntpd[28413]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:36.429 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:36 ntpd[28413]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-16T02:25:36.429 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:36 ntpd[28413]: can't open /var/log/ntpstats/peerstats.20231116: Permission denied 2023-11-16T02:25:36.430 INFO:teuthology.orchestra.run.smithi070.stdout:16 Nov 02:25:36 ntpd[28413]: ntpd: time slew -0.010746 s 2023-11-16T02:25:36.430 INFO:teuthology.orchestra.run.smithi070.stdout:ntpd: time slew -0.010746s 2023-11-16T02:25:36.431 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:36 ntpd[28413]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-16T02:25:36.431 INFO:teuthology.orchestra.run.smithi070.stderr:16 Nov 02:25:36 ntpd[28413]: can't open /var/log/ntpstats/loopstats.20231116: Permission denied 2023-11-16T02:25:36.599 INFO:teuthology.orchestra.run.smithi070.stdout: remote refid st t when poll reach delay offset jitter 2023-11-16T02:25:36.600 INFO:teuthology.orchestra.run.smithi070.stdout:============================================================================== 2023-11-16T02:25:36.600 INFO:teuthology.orchestra.run.smithi070.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-16T02:25:36.600 INFO:teuthology.orchestra.run.smithi070.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-16T02:25:36.600 INFO:teuthology.orchestra.run.smithi070.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-16T02:25:36.600 INFO:teuthology.orchestra.run.smithi070.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-16T02:25:37.463 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:37 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:37.464 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:37 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:37.464 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:37 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:37.464 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:37 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:37.464 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:37 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:37.464 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:37 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:37.464 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:37 ntpd[27962]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:37.464 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:37 ntpd[27962]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:37.464 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:37 ntpd[27962]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-16T02:25:37.464 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:37 ntpd[27962]: can't open /var/log/ntpstats/peerstats.20231116: Permission denied 2023-11-16T02:25:37.465 INFO:teuthology.orchestra.run.smithi204.stdout:16 Nov 02:25:37 ntpd[27962]: ntpd: time slew +0.001667 s 2023-11-16T02:25:37.465 INFO:teuthology.orchestra.run.smithi204.stdout:ntpd: time slew +0.001667s 2023-11-16T02:25:37.465 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:37 ntpd[27962]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-16T02:25:37.465 INFO:teuthology.orchestra.run.smithi204.stderr:16 Nov 02:25:37 ntpd[27962]: can't open /var/log/ntpstats/loopstats.20231116: Permission denied 2023-11-16T02:25:37.577 INFO:teuthology.orchestra.run.smithi204.stdout: remote refid st t when poll reach delay offset jitter 2023-11-16T02:25:37.577 INFO:teuthology.orchestra.run.smithi204.stdout:============================================================================== 2023-11-16T02:25:37.577 INFO:teuthology.orchestra.run.smithi204.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-16T02:25:37.577 INFO:teuthology.orchestra.run.smithi204.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-16T02:25:37.577 INFO:teuthology.orchestra.run.smithi204.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-16T02:25:37.577 INFO:teuthology.orchestra.run.smithi204.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-16T02:25:38.425 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:38 ntpd[28516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:38.425 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:38 ntpd[28516]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:38.425 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:38 ntpd[28516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:38.425 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:38 ntpd[28516]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:38.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:38 ntpd[28516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:38.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:38 ntpd[28516]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:38.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:38 ntpd[28516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-16T02:25:38.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:38 ntpd[28516]: can't open /var/log/ntpstats/rawstats.20231116: Permission denied 2023-11-16T02:25:38.426 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:38 ntpd[28516]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-16T02:25:38.429 INFO:teuthology.orchestra.run.smithi028.stdout:16 Nov 02:25:38 ntpd[28516]: ntpd: time slew -0.007831 s 2023-11-16T02:25:38.430 INFO:teuthology.orchestra.run.smithi028.stdout:ntpd: time slew -0.007831s 2023-11-16T02:25:38.430 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:38 ntpd[28516]: can't open /var/log/ntpstats/peerstats.20231116: Permission denied 2023-11-16T02:25:38.430 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:38 ntpd[28516]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-16T02:25:38.430 INFO:teuthology.orchestra.run.smithi028.stderr:16 Nov 02:25:38 ntpd[28516]: can't open /var/log/ntpstats/loopstats.20231116: Permission denied 2023-11-16T02:25:38.515 INFO:teuthology.orchestra.run.smithi028.stdout: remote refid st t when poll reach delay offset jitter 2023-11-16T02:25:38.515 INFO:teuthology.orchestra.run.smithi028.stdout:============================================================================== 2023-11-16T02:25:38.515 INFO:teuthology.orchestra.run.smithi028.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-16T02:25:38.516 INFO:teuthology.orchestra.run.smithi028.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-16T02:25:38.516 INFO:teuthology.orchestra.run.smithi028.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-16T02:25:38.516 INFO:teuthology.orchestra.run.smithi028.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-16T02:25:38.517 INFO:teuthology.run_tasks:Running task install... 2023-11-16T02:25:38.525 DEBUG:teuthology.task.install:project ceph 2023-11-16T02:25:38.525 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'cb2179fff8710af9ff3936b02b8bc8cd99900af3'}} 2023-11-16T02:25:38.525 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'cb2179fff8710af9ff3936b02b8bc8cd99900af3'} 2023-11-16T02:25:38.525 INFO:teuthology.task.install:Using flavor: default 2023-11-16T02:25:38.531 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-16T02:25:38.532 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-16T02:25:38.532 DEBUG:teuthology.orchestra.run.smithi028:> sudo apt-key list | grep Ceph 2023-11-16T02:25:38.533 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-key list | grep Ceph 2023-11-16T02:25:38.533 DEBUG:teuthology.orchestra.run.smithi204:> sudo apt-key list | grep Ceph 2023-11-16T02:25:38.617 INFO:teuthology.orchestra.run.smithi070.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-16T02:25:38.619 INFO:teuthology.orchestra.run.smithi028.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-16T02:25:38.641 INFO:teuthology.orchestra.run.smithi204.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-16T02:25:38.648 INFO:teuthology.orchestra.run.smithi028.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-16T02:25:38.648 INFO:teuthology.orchestra.run.smithi028.stdout:uid [ unknown] Ceph.com (release key) 2023-11-16T02:25:38.648 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-16T02:25:38.649 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-16T02:25:38.649 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cb2179fff8710af9ff3936b02b8bc8cd99900af3 2023-11-16T02:25:38.669 INFO:teuthology.orchestra.run.smithi070.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-16T02:25:38.669 INFO:teuthology.orchestra.run.smithi070.stdout:uid [ unknown] Ceph.com (release key) 2023-11-16T02:25:38.669 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-16T02:25:38.669 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-16T02:25:38.670 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cb2179fff8710af9ff3936b02b8bc8cd99900af3 2023-11-16T02:25:38.697 INFO:teuthology.orchestra.run.smithi204.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-16T02:25:38.697 INFO:teuthology.orchestra.run.smithi204.stdout:uid [ unknown] Ceph.com (release key) 2023-11-16T02:25:38.698 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-16T02:25:38.698 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-16T02:25:38.698 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cb2179fff8710af9ff3936b02b8bc8cd99900af3 2023-11-16T02:25:38.841 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default/ 2023-11-16T02:25:38.841 INFO:teuthology.task.install.deb:Package version is 18.2.0-1240-gcb2179ff-1jammy 2023-11-16T02:25:38.883 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default/ 2023-11-16T02:25:38.883 INFO:teuthology.task.install.deb:Package version is 18.2.0-1240-gcb2179ff-1jammy 2023-11-16T02:25:38.888 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default/ 2023-11-16T02:25:38.888 INFO:teuthology.task.install.deb:Package version is 18.2.0-1240-gcb2179ff-1jammy 2023-11-16T02:25:38.971 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-16T02:25:38.971 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-16T02:25:38.992 DEBUG:teuthology.orchestra.run.smithi204:> sudo apt-get update 2023-11-16T02:25:39.064 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-16T02:25:39.064 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-16T02:25:39.073 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-16T02:25:39.073 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-16T02:25:39.079 DEBUG:teuthology.orchestra.run.smithi028:> sudo apt-get update 2023-11-16T02:25:39.088 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get update 2023-11-16T02:25:39.200 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-16T02:25:39.228 INFO:teuthology.orchestra.run.smithi204.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy InRelease 2023-11-16T02:25:39.281 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-16T02:25:39.281 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-16T02:25:39.282 INFO:teuthology.orchestra.run.smithi204.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-16T02:25:39.282 INFO:teuthology.orchestra.run.smithi204.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-16T02:25:39.282 INFO:teuthology.orchestra.run.smithi028.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-16T02:25:39.282 INFO:teuthology.orchestra.run.smithi028.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-16T02:25:39.282 INFO:teuthology.orchestra.run.smithi028.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-16T02:25:39.282 INFO:teuthology.orchestra.run.smithi028.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-16T02:25:39.292 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-16T02:25:39.292 INFO:teuthology.orchestra.run.smithi204.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2023-11-16T02:25:39.304 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-16T02:25:39.308 INFO:teuthology.orchestra.run.smithi028.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy InRelease 2023-11-16T02:25:39.325 INFO:teuthology.orchestra.run.smithi204.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-11-16T02:25:39.329 INFO:teuthology.orchestra.run.smithi028.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-16T02:25:39.351 INFO:teuthology.orchestra.run.smithi028.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-16T02:25:39.370 INFO:teuthology.orchestra.run.smithi070.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy InRelease 2023-11-16T02:25:39.372 INFO:teuthology.orchestra.run.smithi028.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2023-11-16T02:25:39.375 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-16T02:25:39.377 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-16T02:25:39.399 INFO:teuthology.orchestra.run.smithi028.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-11-16T02:25:39.420 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-16T02:25:39.459 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-16T02:25:39.472 INFO:teuthology.orchestra.run.smithi070.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-16T02:25:39.522 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-11-16T02:25:39.575 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2023-11-16T02:25:39.614 INFO:teuthology.orchestra.run.smithi028.stdout:Fetched 28.5 kB in 0s (82.0 kB/s) 2023-11-16T02:25:39.653 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 28.5 kB in 0s (75.1 kB/s) 2023-11-16T02:25:39.804 INFO:teuthology.orchestra.run.smithi204.stdout:Fetched 28.5 kB in 1s (48.3 kB/s) 2023-11-16T02:25:40.529 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2023-11-16T02:25:40.533 INFO:teuthology.orchestra.run.smithi028.stdout:Reading package lists... 2023-11-16T02:25:40.544 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.0-1240-gcb2179ff-1jammy cephadm=18.2.0-1240-gcb2179ff-1jammy ceph-mds=18.2.0-1240-gcb2179ff-1jammy ceph-mgr=18.2.0-1240-gcb2179ff-1jammy ceph-common=18.2.0-1240-gcb2179ff-1jammy ceph-fuse=18.2.0-1240-gcb2179ff-1jammy ceph-test=18.2.0-1240-gcb2179ff-1jammy ceph-volume=18.2.0-1240-gcb2179ff-1jammy radosgw=18.2.0-1240-gcb2179ff-1jammy python3-rados=18.2.0-1240-gcb2179ff-1jammy python3-rgw=18.2.0-1240-gcb2179ff-1jammy python3-cephfs=18.2.0-1240-gcb2179ff-1jammy python3-rbd=18.2.0-1240-gcb2179ff-1jammy libcephfs2=18.2.0-1240-gcb2179ff-1jammy libcephfs-dev=18.2.0-1240-gcb2179ff-1jammy librados2=18.2.0-1240-gcb2179ff-1jammy librbd1=18.2.0-1240-gcb2179ff-1jammy rbd-fuse=18.2.0-1240-gcb2179ff-1jammy python3-cephfs=18.2.0-1240-gcb2179ff-1jammy cephfs-shell=18.2.0-1240-gcb2179ff-1jammy cephfs-top=18.2.0-1240-gcb2179ff-1jammy cephfs-mirror=18.2.0-1240-gcb2179ff-1jammy 2023-11-16T02:25:40.549 DEBUG:teuthology.orchestra.run.smithi028:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.0-1240-gcb2179ff-1jammy cephadm=18.2.0-1240-gcb2179ff-1jammy ceph-mds=18.2.0-1240-gcb2179ff-1jammy ceph-mgr=18.2.0-1240-gcb2179ff-1jammy ceph-common=18.2.0-1240-gcb2179ff-1jammy ceph-fuse=18.2.0-1240-gcb2179ff-1jammy ceph-test=18.2.0-1240-gcb2179ff-1jammy ceph-volume=18.2.0-1240-gcb2179ff-1jammy radosgw=18.2.0-1240-gcb2179ff-1jammy python3-rados=18.2.0-1240-gcb2179ff-1jammy python3-rgw=18.2.0-1240-gcb2179ff-1jammy python3-cephfs=18.2.0-1240-gcb2179ff-1jammy python3-rbd=18.2.0-1240-gcb2179ff-1jammy libcephfs2=18.2.0-1240-gcb2179ff-1jammy libcephfs-dev=18.2.0-1240-gcb2179ff-1jammy librados2=18.2.0-1240-gcb2179ff-1jammy librbd1=18.2.0-1240-gcb2179ff-1jammy rbd-fuse=18.2.0-1240-gcb2179ff-1jammy python3-cephfs=18.2.0-1240-gcb2179ff-1jammy cephfs-shell=18.2.0-1240-gcb2179ff-1jammy cephfs-top=18.2.0-1240-gcb2179ff-1jammy cephfs-mirror=18.2.0-1240-gcb2179ff-1jammy 2023-11-16T02:25:40.595 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2023-11-16T02:25:40.610 INFO:teuthology.orchestra.run.smithi028.stdout:Reading package lists... 2023-11-16T02:25:40.723 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2023-11-16T02:25:40.739 DEBUG:teuthology.orchestra.run.smithi204:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.0-1240-gcb2179ff-1jammy cephadm=18.2.0-1240-gcb2179ff-1jammy ceph-mds=18.2.0-1240-gcb2179ff-1jammy ceph-mgr=18.2.0-1240-gcb2179ff-1jammy ceph-common=18.2.0-1240-gcb2179ff-1jammy ceph-fuse=18.2.0-1240-gcb2179ff-1jammy ceph-test=18.2.0-1240-gcb2179ff-1jammy ceph-volume=18.2.0-1240-gcb2179ff-1jammy radosgw=18.2.0-1240-gcb2179ff-1jammy python3-rados=18.2.0-1240-gcb2179ff-1jammy python3-rgw=18.2.0-1240-gcb2179ff-1jammy python3-cephfs=18.2.0-1240-gcb2179ff-1jammy python3-rbd=18.2.0-1240-gcb2179ff-1jammy libcephfs2=18.2.0-1240-gcb2179ff-1jammy libcephfs-dev=18.2.0-1240-gcb2179ff-1jammy librados2=18.2.0-1240-gcb2179ff-1jammy librbd1=18.2.0-1240-gcb2179ff-1jammy rbd-fuse=18.2.0-1240-gcb2179ff-1jammy python3-cephfs=18.2.0-1240-gcb2179ff-1jammy cephfs-shell=18.2.0-1240-gcb2179ff-1jammy cephfs-top=18.2.0-1240-gcb2179ff-1jammy cephfs-mirror=18.2.0-1240-gcb2179ff-1jammy 2023-11-16T02:25:40.758 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2023-11-16T02:25:40.759 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2023-11-16T02:25:40.799 INFO:teuthology.orchestra.run.smithi028.stdout:Building dependency tree... 2023-11-16T02:25:40.800 INFO:teuthology.orchestra.run.smithi028.stdout:Reading state information... 2023-11-16T02:25:40.814 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2023-11-16T02:25:40.906 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2023-11-16T02:25:40.906 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-16T02:25:40.906 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-16T02:25:40.907 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-16T02:25:40.908 INFO:teuthology.orchestra.run.smithi070.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-11-16T02:25:40.908 INFO:teuthology.orchestra.run.smithi070.stdout: python2.7-minimal 2023-11-16T02:25:40.908 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-16T02:25:40.908 INFO:teuthology.orchestra.run.smithi070.stdout:The following additional packages will be installed: 2023-11-16T02:25:40.908 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-16T02:25:40.908 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-16T02:25:40.908 INFO:teuthology.orchestra.run.smithi070.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-11-16T02:25:40.908 INFO:teuthology.orchestra.run.smithi070.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-11-16T02:25:40.909 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-11-16T02:25:40.909 INFO:teuthology.orchestra.run.smithi070.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-16T02:25:40.909 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-16T02:25:40.910 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-11-16T02:25:40.910 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-11-16T02:25:40.910 INFO:teuthology.orchestra.run.smithi070.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-11-16T02:25:40.910 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-16T02:25:40.910 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-16T02:25:40.910 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-16T02:25:40.910 INFO:teuthology.orchestra.run.smithi070.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-16T02:25:40.910 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-16T02:25:40.910 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-16T02:25:40.910 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-11-16T02:25:40.910 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-11-16T02:25:40.910 INFO:teuthology.orchestra.run.smithi070.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-11-16T02:25:40.911 INFO:teuthology.orchestra.run.smithi070.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-11-16T02:25:40.911 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-11-16T02:25:40.911 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-11-16T02:25:40.911 INFO:teuthology.orchestra.run.smithi070.stdout: qttranslations5-l10n socat xmlstarlet 2023-11-16T02:25:40.911 INFO:teuthology.orchestra.run.smithi070.stdout:Suggested packages: 2023-11-16T02:25:40.911 INFO:teuthology.orchestra.run.smithi070.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-16T02:25:40.911 INFO:teuthology.orchestra.run.smithi070.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-16T02:25:40.911 INFO:teuthology.orchestra.run.smithi070.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-16T02:25:40.911 INFO:teuthology.orchestra.run.smithi070.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-16T02:25:40.911 INFO:teuthology.orchestra.run.smithi070.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-16T02:25:40.912 INFO:teuthology.orchestra.run.smithi070.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-16T02:25:40.912 INFO:teuthology.orchestra.run.smithi070.stdout: python3-watchdog 2023-11-16T02:25:40.912 INFO:teuthology.orchestra.run.smithi070.stdout:Recommended packages: 2023-11-16T02:25:40.913 INFO:teuthology.orchestra.run.smithi070.stdout: btrfs-tools 2023-11-16T02:25:40.976 INFO:teuthology.orchestra.run.smithi028.stdout:The following packages were automatically installed and are no longer required: 2023-11-16T02:25:40.976 INFO:teuthology.orchestra.run.smithi028.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-16T02:25:40.976 INFO:teuthology.orchestra.run.smithi028.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-16T02:25:40.977 INFO:teuthology.orchestra.run.smithi028.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-16T02:25:40.977 INFO:teuthology.orchestra.run.smithi028.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-11-16T02:25:40.977 INFO:teuthology.orchestra.run.smithi028.stdout: python2.7-minimal 2023-11-16T02:25:40.977 INFO:teuthology.orchestra.run.smithi028.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-16T02:25:40.978 INFO:teuthology.orchestra.run.smithi028.stdout:The following additional packages will be installed: 2023-11-16T02:25:40.978 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-16T02:25:40.978 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-16T02:25:40.978 INFO:teuthology.orchestra.run.smithi028.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-11-16T02:25:40.978 INFO:teuthology.orchestra.run.smithi028.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-11-16T02:25:40.979 INFO:teuthology.orchestra.run.smithi204.stdout:Building dependency tree... 2023-11-16T02:25:40.979 INFO:teuthology.orchestra.run.smithi028.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-11-16T02:25:40.980 INFO:teuthology.orchestra.run.smithi028.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-16T02:25:40.980 INFO:teuthology.orchestra.run.smithi028.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-16T02:25:40.980 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-11-16T02:25:40.980 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-11-16T02:25:40.980 INFO:teuthology.orchestra.run.smithi028.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-11-16T02:25:40.980 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-16T02:25:40.980 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-16T02:25:40.980 INFO:teuthology.orchestra.run.smithi028.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-16T02:25:40.980 INFO:teuthology.orchestra.run.smithi028.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-16T02:25:40.980 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-16T02:25:40.980 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-16T02:25:40.980 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-11-16T02:25:40.981 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-11-16T02:25:40.981 INFO:teuthology.orchestra.run.smithi028.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-11-16T02:25:40.981 INFO:teuthology.orchestra.run.smithi028.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-11-16T02:25:40.981 INFO:teuthology.orchestra.run.smithi028.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-11-16T02:25:40.981 INFO:teuthology.orchestra.run.smithi028.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-11-16T02:25:40.981 INFO:teuthology.orchestra.run.smithi028.stdout: qttranslations5-l10n socat xmlstarlet 2023-11-16T02:25:40.981 INFO:teuthology.orchestra.run.smithi204.stdout:Reading state information... 2023-11-16T02:25:40.982 INFO:teuthology.orchestra.run.smithi028.stdout:Suggested packages: 2023-11-16T02:25:40.982 INFO:teuthology.orchestra.run.smithi028.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-16T02:25:40.982 INFO:teuthology.orchestra.run.smithi028.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-16T02:25:40.982 INFO:teuthology.orchestra.run.smithi028.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-16T02:25:40.982 INFO:teuthology.orchestra.run.smithi028.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-16T02:25:40.982 INFO:teuthology.orchestra.run.smithi028.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-16T02:25:40.982 INFO:teuthology.orchestra.run.smithi028.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-16T02:25:40.982 INFO:teuthology.orchestra.run.smithi028.stdout: python3-watchdog 2023-11-16T02:25:40.982 INFO:teuthology.orchestra.run.smithi028.stdout:Recommended packages: 2023-11-16T02:25:40.982 INFO:teuthology.orchestra.run.smithi028.stdout: btrfs-tools 2023-11-16T02:25:41.012 INFO:teuthology.orchestra.run.smithi070.stdout:The following NEW packages will be installed: 2023-11-16T02:25:41.012 INFO:teuthology.orchestra.run.smithi070.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-16T02:25:41.012 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-16T02:25:41.012 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-16T02:25:41.012 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-16T02:25:41.012 INFO:teuthology.orchestra.run.smithi070.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-11-16T02:25:41.012 INFO:teuthology.orchestra.run.smithi070.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-11-16T02:25:41.012 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-11-16T02:25:41.013 INFO:teuthology.orchestra.run.smithi070.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-11-16T02:25:41.013 INFO:teuthology.orchestra.run.smithi070.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-16T02:25:41.013 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-16T02:25:41.014 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-16T02:25:41.014 INFO:teuthology.orchestra.run.smithi070.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-16T02:25:41.014 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-16T02:25:41.014 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-16T02:25:41.014 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-16T02:25:41.014 INFO:teuthology.orchestra.run.smithi070.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-16T02:25:41.014 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-16T02:25:41.014 INFO:teuthology.orchestra.run.smithi070.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-16T02:25:41.014 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-16T02:25:41.014 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-16T02:25:41.014 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-16T02:25:41.014 INFO:teuthology.orchestra.run.smithi070.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-16T02:25:41.015 INFO:teuthology.orchestra.run.smithi070.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-16T02:25:41.015 INFO:teuthology.orchestra.run.smithi070.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-16T02:25:41.015 INFO:teuthology.orchestra.run.smithi070.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-16T02:25:41.015 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-11-16T02:25:41.015 INFO:teuthology.orchestra.run.smithi070.stdout: socat xmlstarlet 2023-11-16T02:25:41.091 INFO:teuthology.orchestra.run.smithi028.stdout:The following NEW packages will be installed: 2023-11-16T02:25:41.091 INFO:teuthology.orchestra.run.smithi028.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-16T02:25:41.091 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-16T02:25:41.091 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-16T02:25:41.091 INFO:teuthology.orchestra.run.smithi028.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-16T02:25:41.091 INFO:teuthology.orchestra.run.smithi028.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-11-16T02:25:41.091 INFO:teuthology.orchestra.run.smithi028.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-11-16T02:25:41.091 INFO:teuthology.orchestra.run.smithi028.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-11-16T02:25:41.091 INFO:teuthology.orchestra.run.smithi028.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-11-16T02:25:41.091 INFO:teuthology.orchestra.run.smithi028.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-16T02:25:41.092 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-16T02:25:41.092 INFO:teuthology.orchestra.run.smithi028.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-16T02:25:41.092 INFO:teuthology.orchestra.run.smithi028.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-16T02:25:41.092 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-16T02:25:41.092 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-16T02:25:41.092 INFO:teuthology.orchestra.run.smithi028.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-16T02:25:41.092 INFO:teuthology.orchestra.run.smithi028.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-16T02:25:41.092 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-16T02:25:41.092 INFO:teuthology.orchestra.run.smithi028.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-16T02:25:41.092 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-16T02:25:41.092 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-16T02:25:41.092 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-16T02:25:41.092 INFO:teuthology.orchestra.run.smithi028.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-16T02:25:41.092 INFO:teuthology.orchestra.run.smithi028.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-16T02:25:41.093 INFO:teuthology.orchestra.run.smithi028.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-16T02:25:41.093 INFO:teuthology.orchestra.run.smithi028.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-16T02:25:41.093 INFO:teuthology.orchestra.run.smithi028.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-11-16T02:25:41.093 INFO:teuthology.orchestra.run.smithi028.stdout: socat xmlstarlet 2023-11-16T02:25:41.093 INFO:teuthology.orchestra.run.smithi070.stdout:0 upgraded, 115 newly installed, 0 to remove and 263 not upgraded. 2023-11-16T02:25:41.093 INFO:teuthology.orchestra.run.smithi070.stdout:Need to get 181 MB of archives. 2023-11-16T02:25:41.093 INFO:teuthology.orchestra.run.smithi070.stdout:After this operation, 812 MB of additional disk space will be used. 2023-11-16T02:25:41.093 INFO:teuthology.orchestra.run.smithi070.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-16T02:25:41.131 INFO:teuthology.orchestra.run.smithi204.stdout:The following packages were automatically installed and are no longer required: 2023-11-16T02:25:41.131 INFO:teuthology.orchestra.run.smithi204.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-16T02:25:41.131 INFO:teuthology.orchestra.run.smithi204.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-16T02:25:41.131 INFO:teuthology.orchestra.run.smithi204.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-16T02:25:41.132 INFO:teuthology.orchestra.run.smithi204.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-16T02:25:41.132 INFO:teuthology.orchestra.run.smithi204.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-16T02:25:41.132 INFO:teuthology.orchestra.run.smithi204.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-16T02:25:41.132 INFO:teuthology.orchestra.run.smithi204.stdout:The following additional packages will be installed: 2023-11-16T02:25:41.132 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-16T02:25:41.133 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-16T02:25:41.134 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-16T02:25:41.134 INFO:teuthology.orchestra.run.smithi204.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-11-16T02:25:41.134 INFO:teuthology.orchestra.run.smithi204.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-11-16T02:25:41.134 INFO:teuthology.orchestra.run.smithi204.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-11-16T02:25:41.134 INFO:teuthology.orchestra.run.smithi204.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-16T02:25:41.134 INFO:teuthology.orchestra.run.smithi204.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-16T02:25:41.134 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-11-16T02:25:41.134 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-11-16T02:25:41.134 INFO:teuthology.orchestra.run.smithi204.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-11-16T02:25:41.134 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-16T02:25:41.134 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-16T02:25:41.135 INFO:teuthology.orchestra.run.smithi204.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-16T02:25:41.135 INFO:teuthology.orchestra.run.smithi204.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-16T02:25:41.135 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-16T02:25:41.135 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-16T02:25:41.135 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-11-16T02:25:41.135 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-11-16T02:25:41.135 INFO:teuthology.orchestra.run.smithi204.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-11-16T02:25:41.135 INFO:teuthology.orchestra.run.smithi204.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-11-16T02:25:41.135 INFO:teuthology.orchestra.run.smithi204.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-11-16T02:25:41.135 INFO:teuthology.orchestra.run.smithi204.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-11-16T02:25:41.135 INFO:teuthology.orchestra.run.smithi204.stdout: qttranslations5-l10n socat xmlstarlet 2023-11-16T02:25:41.136 INFO:teuthology.orchestra.run.smithi204.stdout:Suggested packages: 2023-11-16T02:25:41.136 INFO:teuthology.orchestra.run.smithi204.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-16T02:25:41.136 INFO:teuthology.orchestra.run.smithi204.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-16T02:25:41.136 INFO:teuthology.orchestra.run.smithi204.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-16T02:25:41.136 INFO:teuthology.orchestra.run.smithi204.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-16T02:25:41.136 INFO:teuthology.orchestra.run.smithi204.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-16T02:25:41.136 INFO:teuthology.orchestra.run.smithi204.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-16T02:25:41.136 INFO:teuthology.orchestra.run.smithi204.stdout: python3-watchdog 2023-11-16T02:25:41.136 INFO:teuthology.orchestra.run.smithi204.stdout:Recommended packages: 2023-11-16T02:25:41.137 INFO:teuthology.orchestra.run.smithi204.stdout: btrfs-tools 2023-11-16T02:25:41.138 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-16T02:25:41.281 INFO:teuthology.orchestra.run.smithi028.stdout:0 upgraded, 115 newly installed, 0 to remove and 263 not upgraded. 2023-11-16T02:25:41.281 INFO:teuthology.orchestra.run.smithi028.stdout:Need to get 181 MB of archives. 2023-11-16T02:25:41.281 INFO:teuthology.orchestra.run.smithi028.stdout:After this operation, 812 MB of additional disk space will be used. 2023-11-16T02:25:41.281 INFO:teuthology.orchestra.run.smithi028.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-16T02:25:41.282 INFO:teuthology.orchestra.run.smithi204.stdout:The following NEW packages will be installed: 2023-11-16T02:25:41.283 INFO:teuthology.orchestra.run.smithi204.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-16T02:25:41.283 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-16T02:25:41.283 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-16T02:25:41.283 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-16T02:25:41.283 INFO:teuthology.orchestra.run.smithi204.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-11-16T02:25:41.283 INFO:teuthology.orchestra.run.smithi204.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-11-16T02:25:41.283 INFO:teuthology.orchestra.run.smithi204.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-11-16T02:25:41.283 INFO:teuthology.orchestra.run.smithi204.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-11-16T02:25:41.283 INFO:teuthology.orchestra.run.smithi204.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-16T02:25:41.283 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-16T02:25:41.283 INFO:teuthology.orchestra.run.smithi204.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-16T02:25:41.283 INFO:teuthology.orchestra.run.smithi204.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-16T02:25:41.284 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-16T02:25:41.284 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-16T02:25:41.284 INFO:teuthology.orchestra.run.smithi204.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-16T02:25:41.284 INFO:teuthology.orchestra.run.smithi204.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-16T02:25:41.284 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-16T02:25:41.284 INFO:teuthology.orchestra.run.smithi204.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-16T02:25:41.284 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-16T02:25:41.284 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-16T02:25:41.284 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-16T02:25:41.284 INFO:teuthology.orchestra.run.smithi204.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-16T02:25:41.284 INFO:teuthology.orchestra.run.smithi204.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-16T02:25:41.284 INFO:teuthology.orchestra.run.smithi204.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-16T02:25:41.285 INFO:teuthology.orchestra.run.smithi204.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-16T02:25:41.285 INFO:teuthology.orchestra.run.smithi204.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-11-16T02:25:41.285 INFO:teuthology.orchestra.run.smithi204.stdout: socat xmlstarlet 2023-11-16T02:25:41.285 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-11-16T02:25:41.333 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-16T02:25:41.349 INFO:teuthology.orchestra.run.smithi204.stdout:0 upgraded, 115 newly installed, 0 to remove and 263 not upgraded. 2023-11-16T02:25:41.349 INFO:teuthology.orchestra.run.smithi204.stdout:Need to get 181 MB of archives. 2023-11-16T02:25:41.349 INFO:teuthology.orchestra.run.smithi204.stdout:After this operation, 812 MB of additional disk space will be used. 2023-11-16T02:25:41.349 INFO:teuthology.orchestra.run.smithi204.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-16T02:25:41.356 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.0-1240-gcb2179ff-1jammy [3,417 kB] 2023-11-16T02:25:41.363 INFO:teuthology.orchestra.run.smithi028.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-16T02:25:41.366 INFO:teuthology.orchestra.run.smithi204.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-16T02:25:41.376 INFO:teuthology.orchestra.run.smithi204.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-16T02:25:41.409 INFO:teuthology.orchestra.run.smithi028.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-16T02:25:41.417 INFO:teuthology.orchestra.run.smithi204.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-11-16T02:25:41.426 INFO:teuthology.orchestra.run.smithi204.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-16T02:25:41.433 INFO:teuthology.orchestra.run.smithi028.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.0-1240-gcb2179ff-1jammy [3,417 kB] 2023-11-16T02:25:41.442 INFO:teuthology.orchestra.run.smithi204.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-16T02:25:41.443 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-16T02:25:41.444 INFO:teuthology.orchestra.run.smithi204.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-16T02:25:41.453 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-16T02:25:41.455 INFO:teuthology.orchestra.run.smithi204.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-16T02:25:41.490 INFO:teuthology.orchestra.run.smithi204.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-16T02:25:41.492 INFO:teuthology.orchestra.run.smithi204.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-16T02:25:41.496 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-16T02:25:41.499 INFO:teuthology.orchestra.run.smithi204.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-16T02:25:41.503 INFO:teuthology.orchestra.run.smithi204.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-16T02:25:41.504 INFO:teuthology.orchestra.run.smithi204.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-16T02:25:41.509 INFO:teuthology.orchestra.run.smithi204.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-16T02:25:41.510 INFO:teuthology.orchestra.run.smithi204.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-16T02:25:41.510 INFO:teuthology.orchestra.run.smithi204.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-16T02:25:41.511 INFO:teuthology.orchestra.run.smithi204.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-16T02:25:41.511 INFO:teuthology.orchestra.run.smithi204.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-16T02:25:41.526 INFO:teuthology.orchestra.run.smithi204.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-16T02:25:41.526 INFO:teuthology.orchestra.run.smithi204.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-16T02:25:41.526 INFO:teuthology.orchestra.run.smithi204.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-16T02:25:41.527 INFO:teuthology.orchestra.run.smithi204.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-16T02:25:41.542 INFO:teuthology.orchestra.run.smithi204.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-16T02:25:41.544 INFO:teuthology.orchestra.run.smithi204.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-16T02:25:41.545 INFO:teuthology.orchestra.run.smithi204.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-16T02:25:41.545 INFO:teuthology.orchestra.run.smithi204.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-16T02:25:41.546 INFO:teuthology.orchestra.run.smithi204.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-16T02:25:41.547 INFO:teuthology.orchestra.run.smithi204.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-16T02:25:41.557 INFO:teuthology.orchestra.run.smithi204.stdout:Get:29 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.0-1240-gcb2179ff-1jammy [3,417 kB] 2023-11-16T02:25:41.562 INFO:teuthology.orchestra.run.smithi204.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-16T02:25:41.563 INFO:teuthology.orchestra.run.smithi204.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-16T02:25:41.563 INFO:teuthology.orchestra.run.smithi204.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-16T02:25:41.564 INFO:teuthology.orchestra.run.smithi204.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-16T02:25:41.577 INFO:teuthology.orchestra.run.smithi070.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-16T02:25:41.579 INFO:teuthology.orchestra.run.smithi204.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-16T02:25:41.582 INFO:teuthology.orchestra.run.smithi070.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-16T02:25:41.584 INFO:teuthology.orchestra.run.smithi204.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-16T02:25:41.584 INFO:teuthology.orchestra.run.smithi204.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-16T02:25:41.585 INFO:teuthology.orchestra.run.smithi204.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-16T02:25:41.585 INFO:teuthology.orchestra.run.smithi204.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-16T02:25:41.587 INFO:teuthology.orchestra.run.smithi204.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-16T02:25:41.596 INFO:teuthology.orchestra.run.smithi070.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-16T02:25:41.597 INFO:teuthology.orchestra.run.smithi204.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-16T02:25:41.598 INFO:teuthology.orchestra.run.smithi204.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-16T02:25:41.598 INFO:teuthology.orchestra.run.smithi204.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-16T02:25:41.599 INFO:teuthology.orchestra.run.smithi204.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-16T02:25:41.601 INFO:teuthology.orchestra.run.smithi070.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-16T02:25:41.602 INFO:teuthology.orchestra.run.smithi070.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-16T02:25:41.605 INFO:teuthology.orchestra.run.smithi028.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-11-16T02:25:41.611 INFO:teuthology.orchestra.run.smithi070.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-16T02:25:41.612 INFO:teuthology.orchestra.run.smithi070.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-16T02:25:41.612 INFO:teuthology.orchestra.run.smithi070.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-16T02:25:41.613 INFO:teuthology.orchestra.run.smithi204.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-16T02:25:41.614 INFO:teuthology.orchestra.run.smithi070.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-16T02:25:41.614 INFO:teuthology.orchestra.run.smithi204.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-16T02:25:41.615 INFO:teuthology.orchestra.run.smithi070.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-16T02:25:41.617 INFO:teuthology.orchestra.run.smithi204.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-16T02:25:41.637 INFO:teuthology.orchestra.run.smithi070.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-16T02:25:41.638 INFO:teuthology.orchestra.run.smithi070.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-16T02:25:41.638 INFO:teuthology.orchestra.run.smithi070.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-16T02:25:41.638 INFO:teuthology.orchestra.run.smithi070.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-16T02:25:41.639 INFO:teuthology.orchestra.run.smithi070.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-16T02:25:41.642 INFO:teuthology.orchestra.run.smithi070.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-16T02:25:41.642 INFO:teuthology.orchestra.run.smithi070.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-16T02:25:41.643 INFO:teuthology.orchestra.run.smithi070.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-16T02:25:41.643 INFO:teuthology.orchestra.run.smithi070.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-16T02:25:41.649 INFO:teuthology.orchestra.run.smithi028.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-16T02:25:41.663 INFO:teuthology.orchestra.run.smithi204.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-16T02:25:41.664 INFO:teuthology.orchestra.run.smithi204.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-16T02:25:41.665 INFO:teuthology.orchestra.run.smithi204.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-16T02:25:41.666 INFO:teuthology.orchestra.run.smithi204.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-16T02:25:41.667 INFO:teuthology.orchestra.run.smithi204.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-16T02:25:41.668 INFO:teuthology.orchestra.run.smithi204.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-16T02:25:41.668 INFO:teuthology.orchestra.run.smithi204.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-16T02:25:41.669 INFO:teuthology.orchestra.run.smithi204.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-16T02:25:41.669 INFO:teuthology.orchestra.run.smithi070.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-16T02:25:41.669 INFO:teuthology.orchestra.run.smithi070.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-16T02:25:41.669 INFO:teuthology.orchestra.run.smithi070.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-16T02:25:41.670 INFO:teuthology.orchestra.run.smithi070.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-16T02:25:41.671 INFO:teuthology.orchestra.run.smithi204.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-16T02:25:41.671 INFO:teuthology.orchestra.run.smithi070.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-16T02:25:41.682 INFO:teuthology.orchestra.run.smithi204.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-16T02:25:41.688 INFO:teuthology.orchestra.run.smithi204.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-16T02:25:41.692 INFO:teuthology.orchestra.run.smithi070.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-16T02:25:41.699 INFO:teuthology.orchestra.run.smithi070.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-16T02:25:41.699 INFO:teuthology.orchestra.run.smithi070.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-16T02:25:41.700 INFO:teuthology.orchestra.run.smithi070.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-16T02:25:41.701 INFO:teuthology.orchestra.run.smithi070.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-16T02:25:41.709 INFO:teuthology.orchestra.run.smithi204.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-16T02:25:41.711 INFO:teuthology.orchestra.run.smithi204.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-16T02:25:41.711 INFO:teuthology.orchestra.run.smithi204.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-16T02:25:41.717 INFO:teuthology.orchestra.run.smithi070.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-16T02:25:41.721 INFO:teuthology.orchestra.run.smithi070.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-16T02:25:41.722 INFO:teuthology.orchestra.run.smithi070.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-16T02:25:41.723 INFO:teuthology.orchestra.run.smithi028.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-16T02:25:41.725 INFO:teuthology.orchestra.run.smithi070.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-16T02:25:41.727 INFO:teuthology.orchestra.run.smithi070.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-16T02:25:41.728 INFO:teuthology.orchestra.run.smithi204.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-16T02:25:41.728 INFO:teuthology.orchestra.run.smithi204.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-16T02:25:41.729 INFO:teuthology.orchestra.run.smithi204.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-16T02:25:41.729 INFO:teuthology.orchestra.run.smithi204.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-16T02:25:41.730 INFO:teuthology.orchestra.run.smithi204.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-16T02:25:41.731 INFO:teuthology.orchestra.run.smithi204.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-16T02:25:41.732 INFO:teuthology.orchestra.run.smithi204.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-16T02:25:41.732 INFO:teuthology.orchestra.run.smithi204.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-16T02:25:41.734 INFO:teuthology.orchestra.run.smithi028.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-16T02:25:41.736 INFO:teuthology.orchestra.run.smithi204.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-16T02:25:41.740 INFO:teuthology.orchestra.run.smithi070.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-16T02:25:41.742 INFO:teuthology.orchestra.run.smithi070.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-16T02:25:41.747 INFO:teuthology.orchestra.run.smithi070.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-16T02:25:41.748 INFO:teuthology.orchestra.run.smithi204.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-16T02:25:41.750 INFO:teuthology.orchestra.run.smithi204.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-16T02:25:41.752 INFO:teuthology.orchestra.run.smithi204.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-16T02:25:41.755 INFO:teuthology.orchestra.run.smithi204.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-16T02:25:41.758 INFO:teuthology.orchestra.run.smithi204.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-16T02:25:41.758 INFO:teuthology.orchestra.run.smithi204.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-16T02:25:41.762 INFO:teuthology.orchestra.run.smithi204.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-16T02:25:41.766 INFO:teuthology.orchestra.run.smithi204.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-16T02:25:41.767 INFO:teuthology.orchestra.run.smithi204.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-16T02:25:41.770 INFO:teuthology.orchestra.run.smithi204.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-16T02:25:41.774 INFO:teuthology.orchestra.run.smithi070.stdout:Get:47 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.0-1240-gcb2179ff-1jammy [3,104 kB] 2023-11-16T02:25:41.784 INFO:teuthology.orchestra.run.smithi028.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-16T02:25:41.785 INFO:teuthology.orchestra.run.smithi204.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-16T02:25:41.785 INFO:teuthology.orchestra.run.smithi204.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-16T02:25:41.785 INFO:teuthology.orchestra.run.smithi204.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-16T02:25:41.820 INFO:teuthology.orchestra.run.smithi070.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-16T02:25:41.820 INFO:teuthology.orchestra.run.smithi070.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-16T02:25:41.822 INFO:teuthology.orchestra.run.smithi070.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-16T02:25:41.822 INFO:teuthology.orchestra.run.smithi070.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-16T02:25:41.823 INFO:teuthology.orchestra.run.smithi070.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-16T02:25:41.824 INFO:teuthology.orchestra.run.smithi070.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-16T02:25:41.824 INFO:teuthology.orchestra.run.smithi070.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-16T02:25:41.824 INFO:teuthology.orchestra.run.smithi070.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-16T02:25:41.827 INFO:teuthology.orchestra.run.smithi070.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-16T02:25:41.849 INFO:teuthology.orchestra.run.smithi070.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-16T02:25:41.870 INFO:teuthology.orchestra.run.smithi070.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-16T02:25:41.906 INFO:teuthology.orchestra.run.smithi070.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-16T02:25:41.909 INFO:teuthology.orchestra.run.smithi070.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-16T02:25:41.910 INFO:teuthology.orchestra.run.smithi070.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-16T02:25:41.921 INFO:teuthology.orchestra.run.smithi028.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.0-1240-gcb2179ff-1jammy [3,104 kB] 2023-11-16T02:25:41.941 INFO:teuthology.orchestra.run.smithi070.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-16T02:25:41.941 INFO:teuthology.orchestra.run.smithi070.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-16T02:25:41.941 INFO:teuthology.orchestra.run.smithi070.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-16T02:25:41.942 INFO:teuthology.orchestra.run.smithi070.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-16T02:25:41.943 INFO:teuthology.orchestra.run.smithi070.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-16T02:25:41.943 INFO:teuthology.orchestra.run.smithi070.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-16T02:25:41.946 INFO:teuthology.orchestra.run.smithi028.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-16T02:25:41.950 INFO:teuthology.orchestra.run.smithi070.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.0-1240-gcb2179ff-1jammy [670 kB] 2023-11-16T02:25:41.956 INFO:teuthology.orchestra.run.smithi028.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-16T02:25:41.962 INFO:teuthology.orchestra.run.smithi070.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-16T02:25:41.963 INFO:teuthology.orchestra.run.smithi070.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-16T02:25:41.967 INFO:teuthology.orchestra.run.smithi070.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-16T02:25:41.982 INFO:teuthology.orchestra.run.smithi028.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-16T02:25:41.987 INFO:teuthology.orchestra.run.smithi070.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.0-1240-gcb2179ff-1jammy [356 kB] 2023-11-16T02:25:41.991 INFO:teuthology.orchestra.run.smithi070.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-16T02:25:41.993 INFO:teuthology.orchestra.run.smithi070.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-16T02:25:41.994 INFO:teuthology.orchestra.run.smithi070.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-16T02:25:41.999 INFO:teuthology.orchestra.run.smithi070.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-16T02:25:42.000 INFO:teuthology.orchestra.run.smithi070.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.0-1240-gcb2179ff-1jammy [32.8 kB] 2023-11-16T02:25:42.002 INFO:teuthology.orchestra.run.smithi070.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-16T02:25:42.002 INFO:teuthology.orchestra.run.smithi070.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-16T02:25:42.004 INFO:teuthology.orchestra.run.smithi070.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.0-1240-gcb2179ff-1jammy [180 kB] 2023-11-16T02:25:42.009 INFO:teuthology.orchestra.run.smithi070.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-16T02:25:42.014 INFO:teuthology.orchestra.run.smithi070.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.0-1240-gcb2179ff-1jammy [61.5 kB] 2023-11-16T02:25:42.016 INFO:teuthology.orchestra.run.smithi070.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.0-1240-gcb2179ff-1jammy [330 kB] 2023-11-16T02:25:42.029 INFO:teuthology.orchestra.run.smithi070.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-16T02:25:42.030 INFO:teuthology.orchestra.run.smithi070.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-16T02:25:42.032 INFO:teuthology.orchestra.run.smithi070.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-16T02:25:42.051 INFO:teuthology.orchestra.run.smithi070.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.0-1240-gcb2179ff-1jammy [5,884 kB] 2023-11-16T02:25:42.060 INFO:teuthology.orchestra.run.smithi070.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-16T02:25:42.061 INFO:teuthology.orchestra.run.smithi070.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-16T02:25:42.062 INFO:teuthology.orchestra.run.smithi070.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-16T02:25:42.154 INFO:teuthology.orchestra.run.smithi028.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-16T02:25:42.165 INFO:teuthology.orchestra.run.smithi028.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.0-1240-gcb2179ff-1jammy [670 kB] 2023-11-16T02:25:42.245 INFO:teuthology.orchestra.run.smithi028.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.0-1240-gcb2179ff-1jammy [356 kB] 2023-11-16T02:25:42.265 INFO:teuthology.orchestra.run.smithi028.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.0-1240-gcb2179ff-1jammy [32.8 kB] 2023-11-16T02:25:42.266 INFO:teuthology.orchestra.run.smithi028.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.0-1240-gcb2179ff-1jammy [180 kB] 2023-11-16T02:25:42.318 INFO:teuthology.orchestra.run.smithi028.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.0-1240-gcb2179ff-1jammy [61.5 kB] 2023-11-16T02:25:42.322 INFO:teuthology.orchestra.run.smithi028.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.0-1240-gcb2179ff-1jammy [330 kB] 2023-11-16T02:25:42.329 INFO:teuthology.orchestra.run.smithi028.stdout:Get:21 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.0-1240-gcb2179ff-1jammy [5,884 kB] 2023-11-16T02:25:42.349 INFO:teuthology.orchestra.run.smithi028.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-16T02:25:42.380 INFO:teuthology.orchestra.run.smithi070.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.0-1240-gcb2179ff-1jammy [112 kB] 2023-11-16T02:25:42.382 INFO:teuthology.orchestra.run.smithi070.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.0-1240-gcb2179ff-1jammy [442 kB] 2023-11-16T02:25:42.429 INFO:teuthology.orchestra.run.smithi070.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.0-1240-gcb2179ff-1jammy [22.0 MB] 2023-11-16T02:25:42.716 INFO:teuthology.orchestra.run.smithi028.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-16T02:25:42.723 INFO:teuthology.orchestra.run.smithi028.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-16T02:25:42.725 INFO:teuthology.orchestra.run.smithi028.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-16T02:25:42.738 INFO:teuthology.orchestra.run.smithi028.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-16T02:25:42.738 INFO:teuthology.orchestra.run.smithi028.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-16T02:25:42.739 INFO:teuthology.orchestra.run.smithi028.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-16T02:25:42.741 INFO:teuthology.orchestra.run.smithi028.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-16T02:25:42.745 INFO:teuthology.orchestra.run.smithi028.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-16T02:25:42.745 INFO:teuthology.orchestra.run.smithi028.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-16T02:25:42.867 INFO:teuthology.orchestra.run.smithi028.stdout:Get:32 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.0-1240-gcb2179ff-1jammy [112 kB] 2023-11-16T02:25:42.870 INFO:teuthology.orchestra.run.smithi028.stdout:Get:33 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.0-1240-gcb2179ff-1jammy [442 kB] 2023-11-16T02:25:42.910 INFO:teuthology.orchestra.run.smithi028.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-16T02:25:42.955 INFO:teuthology.orchestra.run.smithi028.stdout:Get:35 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.0-1240-gcb2179ff-1jammy [22.0 MB] 2023-11-16T02:25:43.232 INFO:teuthology.orchestra.run.smithi204.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.0-1240-gcb2179ff-1jammy [3,104 kB] 2023-11-16T02:25:43.342 INFO:teuthology.orchestra.run.smithi028.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-16T02:25:43.352 INFO:teuthology.orchestra.run.smithi028.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-16T02:25:43.357 INFO:teuthology.orchestra.run.smithi028.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-16T02:25:43.361 INFO:teuthology.orchestra.run.smithi028.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-16T02:25:43.379 INFO:teuthology.orchestra.run.smithi028.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-16T02:25:43.382 INFO:teuthology.orchestra.run.smithi028.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-16T02:25:43.384 INFO:teuthology.orchestra.run.smithi028.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-16T02:25:43.428 INFO:teuthology.orchestra.run.smithi028.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-16T02:25:43.440 INFO:teuthology.orchestra.run.smithi028.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-16T02:25:43.445 INFO:teuthology.orchestra.run.smithi028.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-16T02:25:43.698 INFO:teuthology.orchestra.run.smithi028.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-16T02:25:43.762 INFO:teuthology.orchestra.run.smithi070.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.0-1240-gcb2179ff-1jammy [6,838 kB] 2023-11-16T02:25:43.782 INFO:teuthology.orchestra.run.smithi028.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-16T02:25:43.872 INFO:teuthology.orchestra.run.smithi028.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-16T02:25:43.929 INFO:teuthology.orchestra.run.smithi028.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-16T02:25:43.999 INFO:teuthology.orchestra.run.smithi070.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.0-1240-gcb2179ff-1jammy [237 kB] 2023-11-16T02:25:44.013 INFO:teuthology.orchestra.run.smithi070.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.0-1240-gcb2179ff-1jammy [130 kB] 2023-11-16T02:25:44.018 INFO:teuthology.orchestra.run.smithi070.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.0-1240-gcb2179ff-1jammy [1,483 kB] 2023-11-16T02:25:44.031 INFO:teuthology.orchestra.run.smithi204.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.0-1240-gcb2179ff-1jammy [670 kB] 2023-11-16T02:25:44.050 INFO:teuthology.orchestra.run.smithi028.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-16T02:25:44.099 INFO:teuthology.orchestra.run.smithi070.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.0-1240-gcb2179ff-1jammy [9,877 kB] 2023-11-16T02:25:44.118 INFO:teuthology.orchestra.run.smithi204.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.0-1240-gcb2179ff-1jammy [356 kB] 2023-11-16T02:25:44.137 INFO:teuthology.orchestra.run.smithi028.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-16T02:25:44.155 INFO:teuthology.orchestra.run.smithi028.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-16T02:25:44.185 INFO:teuthology.orchestra.run.smithi028.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-16T02:25:44.196 INFO:teuthology.orchestra.run.smithi028.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-16T02:25:44.204 INFO:teuthology.orchestra.run.smithi204.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.0-1240-gcb2179ff-1jammy [32.8 kB] 2023-11-16T02:25:44.205 INFO:teuthology.orchestra.run.smithi204.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.0-1240-gcb2179ff-1jammy [180 kB] 2023-11-16T02:25:44.235 INFO:teuthology.orchestra.run.smithi028.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-16T02:25:44.242 INFO:teuthology.orchestra.run.smithi028.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-16T02:25:44.277 INFO:teuthology.orchestra.run.smithi204.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.0-1240-gcb2179ff-1jammy [61.5 kB] 2023-11-16T02:25:44.279 INFO:teuthology.orchestra.run.smithi204.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.0-1240-gcb2179ff-1jammy [330 kB] 2023-11-16T02:25:44.338 INFO:teuthology.orchestra.run.smithi204.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.0-1240-gcb2179ff-1jammy [5,884 kB] 2023-11-16T02:25:44.434 INFO:teuthology.orchestra.run.smithi028.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-16T02:25:44.674 INFO:teuthology.orchestra.run.smithi070.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.0-1240-gcb2179ff-1jammy [31.5 MB] 2023-11-16T02:25:45.245 INFO:teuthology.orchestra.run.smithi204.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.0-1240-gcb2179ff-1jammy [112 kB] 2023-11-16T02:25:45.246 INFO:teuthology.orchestra.run.smithi204.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.0-1240-gcb2179ff-1jammy [442 kB] 2023-11-16T02:25:45.252 INFO:teuthology.orchestra.run.smithi028.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-16T02:25:45.254 INFO:teuthology.orchestra.run.smithi028.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-16T02:25:45.257 INFO:teuthology.orchestra.run.smithi028.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-16T02:25:45.259 INFO:teuthology.orchestra.run.smithi028.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-16T02:25:45.260 INFO:teuthology.orchestra.run.smithi028.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-16T02:25:45.262 INFO:teuthology.orchestra.run.smithi028.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-16T02:25:45.262 INFO:teuthology.orchestra.run.smithi028.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-16T02:25:45.263 INFO:teuthology.orchestra.run.smithi028.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-16T02:25:45.269 INFO:teuthology.orchestra.run.smithi028.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-16T02:25:45.333 INFO:teuthology.orchestra.run.smithi028.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-16T02:25:45.339 INFO:teuthology.orchestra.run.smithi204.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.0-1240-gcb2179ff-1jammy [22.0 MB] 2023-11-16T02:25:45.499 INFO:teuthology.orchestra.run.smithi028.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-16T02:25:46.003 INFO:teuthology.orchestra.run.smithi028.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.0-1240-gcb2179ff-1jammy [6,838 kB] 2023-11-16T02:25:46.207 INFO:teuthology.orchestra.run.smithi028.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-16T02:25:46.212 INFO:teuthology.orchestra.run.smithi028.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-16T02:25:46.213 INFO:teuthology.orchestra.run.smithi028.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-16T02:25:46.264 INFO:teuthology.orchestra.run.smithi028.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-16T02:25:46.288 INFO:teuthology.orchestra.run.smithi028.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-16T02:25:46.290 INFO:teuthology.orchestra.run.smithi028.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-16T02:25:46.291 INFO:teuthology.orchestra.run.smithi028.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-16T02:25:46.293 INFO:teuthology.orchestra.run.smithi028.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-16T02:25:46.294 INFO:teuthology.orchestra.run.smithi028.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-16T02:25:46.459 INFO:teuthology.orchestra.run.smithi028.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-16T02:25:46.580 INFO:teuthology.orchestra.run.smithi028.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-16T02:25:46.799 INFO:teuthology.orchestra.run.smithi070.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.0-1240-gcb2179ff-1jammy [14.1 kB] 2023-11-16T02:25:46.800 INFO:teuthology.orchestra.run.smithi070.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.0-1240-gcb2179ff-1jammy [824 kB] 2023-11-16T02:25:46.816 INFO:teuthology.orchestra.run.smithi070.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.0-1240-gcb2179ff-1jammy [2,171 kB] 2023-11-16T02:25:46.881 INFO:teuthology.orchestra.run.smithi070.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.0-1240-gcb2179ff-1jammy [235 kB] 2023-11-16T02:25:46.882 INFO:teuthology.orchestra.run.smithi028.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-16T02:25:46.889 INFO:teuthology.orchestra.run.smithi070.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.0-1240-gcb2179ff-1jammy [138 kB] 2023-11-16T02:25:46.898 INFO:teuthology.orchestra.run.smithi070.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.0-1240-gcb2179ff-1jammy [1,898 kB] 2023-11-16T02:25:46.926 INFO:teuthology.orchestra.run.smithi028.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-16T02:25:46.952 INFO:teuthology.orchestra.run.smithi028.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-16T02:25:46.960 INFO:teuthology.orchestra.run.smithi028.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-16T02:25:47.005 INFO:teuthology.orchestra.run.smithi028.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-16T02:25:47.031 INFO:teuthology.orchestra.run.smithi028.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-16T02:25:47.033 INFO:teuthology.orchestra.run.smithi028.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-16T02:25:47.040 INFO:teuthology.orchestra.run.smithi070.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.0-1240-gcb2179ff-1jammy [8,625 kB] 2023-11-16T02:25:47.047 INFO:teuthology.orchestra.run.smithi028.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.0-1240-gcb2179ff-1jammy [237 kB] 2023-11-16T02:25:47.068 INFO:teuthology.orchestra.run.smithi028.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-16T02:25:47.086 INFO:teuthology.orchestra.run.smithi028.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-16T02:25:47.119 INFO:teuthology.orchestra.run.smithi028.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.0-1240-gcb2179ff-1jammy [130 kB] 2023-11-16T02:25:47.123 INFO:teuthology.orchestra.run.smithi028.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.0-1240-gcb2179ff-1jammy [1,483 kB] 2023-11-16T02:25:47.252 INFO:teuthology.orchestra.run.smithi028.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-16T02:25:47.396 INFO:teuthology.orchestra.run.smithi028.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.0-1240-gcb2179ff-1jammy [9,877 kB] 2023-11-16T02:25:47.612 INFO:teuthology.orchestra.run.smithi070.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.0-1240-gcb2179ff-1jammy [14.2 kB] 2023-11-16T02:25:47.613 INFO:teuthology.orchestra.run.smithi070.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.0-1240-gcb2179ff-1jammy [46.5 MB] 2023-11-16T02:25:47.647 INFO:teuthology.orchestra.run.smithi028.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-16T02:25:47.682 INFO:teuthology.orchestra.run.smithi204.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.0-1240-gcb2179ff-1jammy [6,838 kB] 2023-11-16T02:25:47.867 INFO:teuthology.orchestra.run.smithi028.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-16T02:25:47.870 INFO:teuthology.orchestra.run.smithi028.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-16T02:25:47.879 INFO:teuthology.orchestra.run.smithi028.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-16T02:25:48.361 INFO:teuthology.orchestra.run.smithi204.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.0-1240-gcb2179ff-1jammy [237 kB] 2023-11-16T02:25:48.369 INFO:teuthology.orchestra.run.smithi204.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.0-1240-gcb2179ff-1jammy [130 kB] 2023-11-16T02:25:48.385 INFO:teuthology.orchestra.run.smithi204.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.0-1240-gcb2179ff-1jammy [1,483 kB] 2023-11-16T02:25:48.501 INFO:teuthology.orchestra.run.smithi204.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.0-1240-gcb2179ff-1jammy [9,877 kB] 2023-11-16T02:25:49.194 INFO:teuthology.orchestra.run.smithi028.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.0-1240-gcb2179ff-1jammy [31.5 MB] 2023-11-16T02:25:49.270 INFO:teuthology.orchestra.run.smithi204.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.0-1240-gcb2179ff-1jammy [31.5 MB] 2023-11-16T02:25:51.583 INFO:teuthology.orchestra.run.smithi204.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.0-1240-gcb2179ff-1jammy [14.1 kB] 2023-11-16T02:25:51.583 INFO:teuthology.orchestra.run.smithi204.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.0-1240-gcb2179ff-1jammy [824 kB] 2023-11-16T02:25:51.624 INFO:teuthology.orchestra.run.smithi204.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.0-1240-gcb2179ff-1jammy [2,171 kB] 2023-11-16T02:25:51.769 INFO:teuthology.orchestra.run.smithi204.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.0-1240-gcb2179ff-1jammy [235 kB] 2023-11-16T02:25:51.778 INFO:teuthology.orchestra.run.smithi204.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.0-1240-gcb2179ff-1jammy [138 kB] 2023-11-16T02:25:51.789 INFO:teuthology.orchestra.run.smithi204.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.0-1240-gcb2179ff-1jammy [1,898 kB] 2023-11-16T02:25:51.908 INFO:teuthology.orchestra.run.smithi204.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.0-1240-gcb2179ff-1jammy [8,625 kB] 2023-11-16T02:25:52.099 INFO:teuthology.orchestra.run.smithi070.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.0-1240-gcb2179ff-1jammy [120 kB] 2023-11-16T02:25:52.101 INFO:teuthology.orchestra.run.smithi070.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.0-1240-gcb2179ff-1jammy [228 kB] 2023-11-16T02:25:52.106 INFO:teuthology.orchestra.run.smithi070.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.0-1240-gcb2179ff-1jammy [34.0 kB] 2023-11-16T02:25:52.107 INFO:teuthology.orchestra.run.smithi070.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.0-1240-gcb2179ff-1jammy [23.3 kB] 2023-11-16T02:25:52.108 INFO:teuthology.orchestra.run.smithi070.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.0-1240-gcb2179ff-1jammy [38.3 kB] 2023-11-16T02:25:52.108 INFO:teuthology.orchestra.run.smithi070.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.0-1240-gcb2179ff-1jammy [11.6 MB] 2023-11-16T02:25:52.426 INFO:teuthology.orchestra.run.smithi204.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.0-1240-gcb2179ff-1jammy [14.2 kB] 2023-11-16T02:25:52.426 INFO:teuthology.orchestra.run.smithi204.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.0-1240-gcb2179ff-1jammy [46.5 MB] 2023-11-16T02:25:53.445 INFO:teuthology.orchestra.run.smithi070.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.0-1240-gcb2179ff-1jammy [92.9 kB] 2023-11-16T02:25:53.992 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 181 MB in 12s (14.6 MB/s) 2023-11-16T02:25:54.106 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-16T02:25:54.151 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2023-11-16T02:25:54.155 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-16T02:25:54.189 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-16T02:25:54.289 INFO:teuthology.orchestra.run.smithi028.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.0-1240-gcb2179ff-1jammy [14.1 kB] 2023-11-16T02:25:54.290 INFO:teuthology.orchestra.run.smithi028.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.0-1240-gcb2179ff-1jammy [824 kB] 2023-11-16T02:25:54.311 INFO:teuthology.orchestra.run.smithi028.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.0-1240-gcb2179ff-1jammy [2,171 kB] 2023-11-16T02:25:54.433 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-16T02:25:54.454 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-16T02:25:54.483 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-16T02:25:54.594 INFO:teuthology.orchestra.run.smithi028.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.0-1240-gcb2179ff-1jammy [235 kB] 2023-11-16T02:25:54.630 INFO:teuthology.orchestra.run.smithi028.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.0-1240-gcb2179ff-1jammy [138 kB] 2023-11-16T02:25:54.661 INFO:teuthology.orchestra.run.smithi028.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.0-1240-gcb2179ff-1jammy [1,898 kB] 2023-11-16T02:25:54.777 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cmd2. 2023-11-16T02:25:54.799 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-16T02:25:54.836 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-16T02:25:54.971 INFO:teuthology.orchestra.run.smithi028.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.0-1240-gcb2179ff-1jammy [8,625 kB] 2023-11-16T02:25:55.130 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libfmt8:amd64. 2023-11-16T02:25:55.151 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-11-16T02:25:55.231 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-11-16T02:25:55.428 INFO:teuthology.orchestra.run.smithi204.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.0-1240-gcb2179ff-1jammy [120 kB] 2023-11-16T02:25:55.429 INFO:teuthology.orchestra.run.smithi204.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.0-1240-gcb2179ff-1jammy [228 kB] 2023-11-16T02:25:55.440 INFO:teuthology.orchestra.run.smithi204.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.0-1240-gcb2179ff-1jammy [34.0 kB] 2023-11-16T02:25:55.444 INFO:teuthology.orchestra.run.smithi204.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.0-1240-gcb2179ff-1jammy [23.3 kB] 2023-11-16T02:25:55.446 INFO:teuthology.orchestra.run.smithi204.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.0-1240-gcb2179ff-1jammy [38.3 kB] 2023-11-16T02:25:55.448 INFO:teuthology.orchestra.run.smithi204.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.0-1240-gcb2179ff-1jammy [11.6 MB] 2023-11-16T02:25:55.633 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-16T02:26:00.553 INFO:teuthology.orchestra.run.smithi028.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.0-1240-gcb2179ff-1jammy [14.2 kB] 2023-11-16T02:26:00.554 INFO:teuthology.orchestra.run.smithi028.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.0-1240-gcb2179ff-1jammy [46.5 MB] 2023-11-16T02:26:00.562 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-16T02:26:00.562 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-16T02:26:00.562 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-16T02:26:00.562 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-16T02:26:00.563 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-16T02:26:00.563 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-16T02:26:00.563 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-16T02:26:00.563 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-16T02:26:00.563 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-16T02:26:00.563 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-16T02:26:00.563 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-16T02:26:00.563 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-16T02:26:00.563 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-16T02:26:00.563 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-16T02:26:00.563 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-16T02:26:00.563 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-16T02:26:00.563 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-16T02:26:00.564 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-16T02:26:00.564 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-16T02:26:00.564 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-16T02:26:00.564 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librados2. 2023-11-16T02:26:00.564 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../011-librados2_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:00.597 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librados2 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:00.597 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librbd1. 2023-11-16T02:26:00.597 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../012-librbd1_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:00.597 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librbd1 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:00.597 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libcephfs2. 2023-11-16T02:26:00.597 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../013-libcephfs2_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:00.597 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libcephfs2 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:00.597 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rados. 2023-11-16T02:26:00.597 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../014-python3-rados_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:00.597 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rados (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:00.598 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-16T02:26:00.598 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:00.598 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-ceph-argparse (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:00.598 INFO:teuthology.orchestra.run.smithi204.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.0-1240-gcb2179ff-1jammy [92.9 kB] 2023-11-16T02:26:00.599 INFO:teuthology.orchestra.run.smithi204.stdout:Fetched 181 MB in 15s (11.9 MB/s) 2023-11-16T02:26:00.599 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-16T02:26:00.599 INFO:teuthology.orchestra.run.smithi204.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-16T02:26:00.599 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-16T02:26:00.599 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-16T02:26:00.599 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-16T02:26:00.599 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-16T02:26:00.599 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-16T02:26:00.599 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-cmd2. 2023-11-16T02:26:00.599 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-16T02:26:00.599 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-16T02:26:00.600 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libfmt8:amd64. 2023-11-16T02:26:00.600 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-11-16T02:26:00.600 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-11-16T02:26:00.600 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-16T02:26:00.600 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-16T02:26:00.600 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-16T02:26:00.600 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-16T02:26:00.600 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-16T02:26:00.600 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-16T02:26:00.600 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-16T02:26:00.600 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-16T02:26:00.600 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-16T02:26:00.600 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-16T02:26:00.601 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-16T02:26:00.601 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-16T02:26:00.658 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-16T02:26:00.669 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-16T02:26:00.705 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-16T02:26:00.784 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cephfs. 2023-11-16T02:26:00.796 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../016-python3-cephfs_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:00.834 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cephfs (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:01.072 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-16T02:26:01.087 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-16T02:26:01.131 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-16T02:26:01.153 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-16T02:26:01.165 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:01.194 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-ceph-common (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:01.506 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-prettytable. 2023-11-16T02:26:01.509 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-16T02:26:01.524 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-16T02:26:01.526 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-11-16T02:26:01.566 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-16T02:26:01.567 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-16T02:26:01.833 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rbd. 2023-11-16T02:26:01.854 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../019-python3-rbd_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:01.892 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rbd (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:01.937 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package librados2. 2023-11-16T02:26:01.952 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../011-librados2_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:02.078 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking librados2 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:02.244 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-16T02:26:02.265 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-16T02:26:02.303 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-16T02:26:02.531 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package librbd1. 2023-11-16T02:26:02.546 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../012-librbd1_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:02.606 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking librbd1 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:02.614 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librgw2. 2023-11-16T02:26:02.634 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../021-librgw2_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:02.672 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librgw2 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:03.025 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libcephfs2. 2023-11-16T02:26:03.040 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../013-libcephfs2_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:03.084 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libcephfs2 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:03.141 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rgw. 2023-11-16T02:26:03.153 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../022-python3-rgw_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:03.191 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rgw (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:03.355 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-rados. 2023-11-16T02:26:03.368 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../014-python3-rados_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:03.428 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-rados (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:03.560 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-16T02:26:03.581 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-16T02:26:03.619 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-16T02:26:03.706 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-16T02:26:03.721 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:03.764 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-ceph-argparse (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:03.947 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libradosstriper1. 2023-11-16T02:26:03.967 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../024-libradosstriper1_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:03.996 INFO:teuthology.orchestra.run.smithi028.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.0-1240-gcb2179ff-1jammy [120 kB] 2023-11-16T02:26:03.999 INFO:teuthology.orchestra.run.smithi028.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.0-1240-gcb2179ff-1jammy [228 kB] 2023-11-16T02:26:04.003 INFO:teuthology.orchestra.run.smithi028.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.0-1240-gcb2179ff-1jammy [34.0 kB] 2023-11-16T02:26:04.005 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libradosstriper1 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:04.005 INFO:teuthology.orchestra.run.smithi028.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.0-1240-gcb2179ff-1jammy [23.3 kB] 2023-11-16T02:26:04.006 INFO:teuthology.orchestra.run.smithi028.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.0-1240-gcb2179ff-1jammy [38.3 kB] 2023-11-16T02:26:04.006 INFO:teuthology.orchestra.run.smithi028.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.0-1240-gcb2179ff-1jammy [11.6 MB] 2023-11-16T02:26:04.041 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-cephfs. 2023-11-16T02:26:04.056 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../016-python3-cephfs_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:04.100 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-cephfs (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:04.391 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-common. 2023-11-16T02:26:04.412 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../025-ceph-common_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:04.441 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-common (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:04.444 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-16T02:26:04.459 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:04.503 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-ceph-common (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:04.864 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-prettytable. 2023-11-16T02:26:04.878 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-11-16T02:26:04.922 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-16T02:26:05.133 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-rbd. 2023-11-16T02:26:05.150 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../019-python3-rbd_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:05.175 INFO:teuthology.orchestra.run.smithi028.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-11-14-0743-reef/cb2179fff8710af9ff3936b02b8bc8cd99900af3/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.0-1240-gcb2179ff-1jammy [92.9 kB] 2023-11-16T02:26:05.183 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-rbd (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:05.553 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-16T02:26:05.570 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-16T02:26:05.611 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-16T02:26:05.730 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-base. 2023-11-16T02:26:05.750 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../026-ceph-base_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:05.757 INFO:teuthology.orchestra.run.smithi028.stdout:Fetched 181 MB in 24s (7,512 kB/s) 2023-11-16T02:26:05.797 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-base (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:05.884 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-16T02:26:05.946 INFO:teuthology.orchestra.run.smithi028.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2023-11-16T02:26:05.951 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-16T02:26:05.957 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package librgw2. 2023-11-16T02:26:05.970 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../021-librgw2_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:05.991 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-16T02:26:06.015 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking librgw2 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:06.286 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-16T02:26:06.306 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-16T02:26:06.344 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-16T02:26:06.491 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-rgw. 2023-11-16T02:26:06.506 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../022-python3-rgw_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:06.541 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-rgw (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:06.559 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-16T02:26:06.580 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-16T02:26:06.617 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-16T02:26:06.696 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-cmd2. 2023-11-16T02:26:06.717 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-16T02:26:06.755 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-16T02:26:06.895 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cheroot. 2023-11-16T02:26:06.903 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-16T02:26:06.915 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-16T02:26:06.917 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-16T02:26:06.945 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-16T02:26:06.961 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-16T02:26:07.065 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libfmt8:amd64. 2023-11-16T02:26:07.086 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-11-16T02:26:07.166 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-11-16T02:26:07.248 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-16T02:26:07.269 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-16T02:26:07.298 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-16T02:26:07.323 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libradosstriper1. 2023-11-16T02:26:07.337 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../024-libradosstriper1_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:07.381 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libradosstriper1 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:07.527 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-16T02:26:07.548 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-16T02:26:07.584 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-16T02:26:07.604 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-16T02:26:07.627 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-16T02:26:07.642 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-16T02:26:07.792 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-common. 2023-11-16T02:26:07.807 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../025-ceph-common_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:07.842 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-common (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:07.945 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-16T02:26:07.955 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-16T02:26:07.965 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-16T02:26:07.976 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-16T02:26:08.004 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-16T02:26:08.013 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-16T02:26:08.365 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-tempora. 2023-11-16T02:26:08.366 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-16T02:26:08.385 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-11-16T02:26:08.387 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-16T02:26:08.431 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-16T02:26:08.441 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-16T02:26:08.767 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-portend. 2023-11-16T02:26:08.788 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-11-16T02:26:08.828 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-16T02:26:08.861 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-16T02:26:08.883 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-16T02:26:08.920 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-16T02:26:08.956 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-base. 2023-11-16T02:26:08.971 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../026-ceph-base_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:09.024 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-base (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:09.153 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-16T02:26:09.174 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-16T02:26:09.223 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-16T02:26:09.489 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-16T02:26:09.510 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-16T02:26:09.547 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-16T02:26:09.719 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-16T02:26:09.731 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-16T02:26:09.733 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-16T02:26:09.754 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-16T02:26:09.798 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-16T02:26:09.802 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-16T02:26:09.885 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-16T02:26:09.905 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-16T02:26:09.942 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-16T02:26:10.088 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-cheroot. 2023-11-16T02:26:10.103 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-16T02:26:10.147 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-16T02:26:10.185 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-natsort. 2023-11-16T02:26:10.205 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-11-16T02:26:10.243 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-16T02:26:10.297 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-16T02:26:10.316 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-16T02:26:10.429 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-16T02:26:10.491 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-16T02:26:10.507 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-16T02:26:10.563 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-logutils. 2023-11-16T02:26:10.566 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-16T02:26:10.585 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-11-16T02:26:10.621 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-16T02:26:10.894 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-16T02:26:10.909 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-16T02:26:10.915 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-16T02:26:10.936 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-16T02:26:10.953 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-16T02:26:10.972 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package librados2. 2023-11-16T02:26:10.973 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-16T02:26:10.994 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../011-librados2_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:11.031 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking librados2 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:11.251 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-mako. 2023-11-16T02:26:11.272 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-16T02:26:11.272 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-16T02:26:11.288 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-16T02:26:11.309 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-16T02:26:11.322 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-16T02:26:11.483 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package librbd1. 2023-11-16T02:26:11.504 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../012-librbd1_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:11.541 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking librbd1 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:11.592 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-tempora. 2023-11-16T02:26:11.607 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-11-16T02:26:11.638 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-16T02:26:11.650 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-16T02:26:11.658 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-16T02:26:11.696 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-16T02:26:11.978 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libcephfs2. 2023-11-16T02:26:11.986 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-portend. 2023-11-16T02:26:11.999 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../013-libcephfs2_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:12.001 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-11-16T02:26:12.036 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libcephfs2 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:12.041 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-16T02:26:12.044 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-16T02:26:12.061 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-16T02:26:12.098 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-16T02:26:12.313 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-rados. 2023-11-16T02:26:12.326 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../014-python3-rados_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:12.363 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-rados (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:12.401 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-webob. 2023-11-16T02:26:12.422 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-16T02:26:12.459 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-16T02:26:12.556 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-16T02:26:12.571 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-16T02:26:12.614 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-16T02:26:12.657 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-16T02:26:12.678 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:12.724 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-ceph-argparse (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:12.950 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-16T02:26:12.965 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-16T02:26:12.968 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-cephfs. 2023-11-16T02:26:12.982 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../016-python3-cephfs_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:13.008 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-16T02:26:13.018 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-cephfs (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:13.338 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-16T02:26:13.358 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:13.397 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-ceph-common (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:13.480 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-waitress. 2023-11-16T02:26:13.500 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-16T02:26:13.516 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-natsort. 2023-11-16T02:26:13.532 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-11-16T02:26:13.533 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-16T02:26:13.757 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-prettytable. 2023-11-16T02:26:13.777 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-11-16T02:26:13.818 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-16T02:26:13.857 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-tempita. 2023-11-16T02:26:13.878 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-16T02:26:13.915 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-16T02:26:14.062 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-16T02:26:14.067 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-rbd. 2023-11-16T02:26:14.079 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../019-python3-rbd_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:14.109 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-rbd (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:14.218 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-paste. 2023-11-16T02:26:14.239 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-16T02:26:14.276 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-16T02:26:14.373 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-logutils. 2023-11-16T02:26:14.389 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-11-16T02:26:14.432 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-16T02:26:14.759 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-16T02:26:14.774 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-16T02:26:14.813 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-16T02:26:14.821 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-16T02:26:14.834 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-16T02:26:14.871 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-16T02:26:15.105 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-16T02:26:15.125 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-16T02:26:15.129 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-mako. 2023-11-16T02:26:15.144 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-16T02:26:15.174 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-16T02:26:15.179 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-16T02:26:15.195 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-16T02:26:15.204 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-16T02:26:15.232 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-16T02:26:15.518 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-16T02:26:15.531 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-16T02:26:15.557 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package librgw2. 2023-11-16T02:26:15.560 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-webtest. 2023-11-16T02:26:15.574 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-16T02:26:15.577 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../021-librgw2_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:15.581 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-11-16T02:26:15.615 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking librgw2 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:15.618 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-16T02:26:15.860 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-16T02:26:15.875 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-16T02:26:15.938 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pecan. 2023-11-16T02:26:15.952 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-16T02:26:15.958 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-16T02:26:15.988 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-16T02:26:16.263 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-webob. 2023-11-16T02:26:16.278 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-16T02:26:16.300 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-rgw. 2023-11-16T02:26:16.317 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-certifi. 2023-11-16T02:26:16.318 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../022-python3-rgw_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:16.321 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-16T02:26:16.338 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-11-16T02:26:16.358 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-rgw (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:16.367 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-16T02:26:16.674 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-waitress. 2023-11-16T02:26:16.689 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-16T02:26:16.705 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-idna. 2023-11-16T02:26:16.705 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-16T02:26:16.724 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-16T02:26:16.726 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-11-16T02:26:16.727 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-16T02:26:16.761 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-16T02:26:16.762 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-16T02:26:17.060 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-tempita. 2023-11-16T02:26:17.076 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-16T02:26:17.099 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-urllib3. 2023-11-16T02:26:17.106 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libradosstriper1. 2023-11-16T02:26:17.119 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-16T02:26:17.120 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-16T02:26:17.127 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../024-libradosstriper1_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:17.156 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-16T02:26:17.164 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libradosstriper1 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:17.439 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-paste. 2023-11-16T02:26:17.454 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-16T02:26:17.488 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-16T02:26:17.509 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-requests. 2023-11-16T02:26:17.530 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-16T02:26:17.534 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-common. 2023-11-16T02:26:17.557 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../025-ceph-common_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:17.567 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-16T02:26:17.583 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-common (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:17.774 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-16T02:26:17.789 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-16T02:26:17.866 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-16T02:26:17.879 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-16T02:26:17.899 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-16T02:26:17.939 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-16T02:26:18.127 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-16T02:26:18.141 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-16T02:26:18.177 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-16T02:26:18.233 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-16T02:26:18.255 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:18.291 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-modules-core (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:18.498 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-webtest. 2023-11-16T02:26:18.513 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-11-16T02:26:18.555 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-16T02:26:18.679 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-16T02:26:18.700 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:18.738 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libsqlite3-mod-ceph (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:18.883 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pecan. 2023-11-16T02:26:18.898 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-16T02:26:18.930 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-base. 2023-11-16T02:26:18.933 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-16T02:26:18.952 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../026-ceph-base_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:18.998 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-base (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:19.065 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-openssl. 2023-11-16T02:26:19.086 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-11-16T02:26:19.124 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-16T02:26:19.331 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-certifi. 2023-11-16T02:26:19.345 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-11-16T02:26:19.388 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-16T02:26:19.502 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr. 2023-11-16T02:26:19.522 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../058-ceph-mgr_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:19.560 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:19.691 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-idna. 2023-11-16T02:26:19.706 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-11-16T02:26:19.740 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-16T02:26:19.843 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-16T02:26:19.864 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-16T02:26:19.903 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-16T02:26:19.963 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mon. 2023-11-16T02:26:19.984 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../059-ceph-mon_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:20.021 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mon (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:20.044 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-urllib3. 2023-11-16T02:26:20.058 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-16T02:26:20.102 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-16T02:26:20.164 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-cheroot. 2023-11-16T02:26:20.185 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-16T02:26:20.214 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-16T02:26:20.439 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-requests. 2023-11-16T02:26:20.454 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-16T02:26:20.467 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-16T02:26:20.491 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-16T02:26:20.497 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-16T02:26:20.516 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-16T02:26:20.833 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-16T02:26:20.848 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-16T02:26:20.852 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-16T02:26:20.873 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-16T02:26:20.891 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-16T02:26:20.911 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-16T02:26:20.933 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-osd. 2023-11-16T02:26:20.954 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../060-ceph-osd_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:20.991 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-osd (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:21.152 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-16T02:26:21.167 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:21.232 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mgr-modules-core (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:21.439 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-16T02:26:21.460 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-16T02:26:21.522 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-16T02:26:21.616 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-16T02:26:21.630 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:21.674 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libsqlite3-mod-ceph (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:21.825 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-tempora. 2023-11-16T02:26:21.845 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-11-16T02:26:21.891 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-16T02:26:21.977 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-openssl. 2023-11-16T02:26:21.992 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-11-16T02:26:22.026 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-16T02:26:22.260 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-portend. 2023-11-16T02:26:22.281 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-11-16T02:26:22.327 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-16T02:26:22.522 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mgr. 2023-11-16T02:26:22.537 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../058-ceph-mgr_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:22.580 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mgr (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:22.705 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-16T02:26:22.726 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-16T02:26:22.773 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-16T02:26:22.911 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph. 2023-11-16T02:26:22.922 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../061-ceph_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:22.961 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:23.017 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mon. 2023-11-16T02:26:23.031 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../059-ceph-mon_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:23.075 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mon (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:23.108 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-16T02:26:23.129 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-16T02:26:23.166 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-16T02:26:23.280 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-fuse. 2023-11-16T02:26:23.301 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../062-ceph-fuse_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:23.338 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-fuse (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:23.586 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-natsort. 2023-11-16T02:26:23.607 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-11-16T02:26:23.652 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-16T02:26:23.683 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mds. 2023-11-16T02:26:23.706 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../063-ceph-mds_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:23.741 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mds (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:23.895 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-osd. 2023-11-16T02:26:23.910 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../060-ceph-osd_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:23.954 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-osd (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:24.031 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-logutils. 2023-11-16T02:26:24.051 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-11-16T02:26:24.122 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-16T02:26:24.161 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package cephadm. 2023-11-16T02:26:24.182 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../064-cephadm_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:24.219 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking cephadm (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:24.450 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-16T02:26:24.470 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-16T02:26:24.508 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-16T02:26:24.547 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-16T02:26:24.568 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-16T02:26:24.605 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-16T02:26:24.869 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-mako. 2023-11-16T02:26:24.890 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-16T02:26:24.935 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-16T02:26:25.125 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-16T02:26:25.137 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-16T02:26:25.166 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-16T02:26:25.207 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph. 2023-11-16T02:26:25.221 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../061-ceph_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:25.281 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:25.338 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-16T02:26:25.338 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-16T02:26:25.364 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-16T02:26:25.584 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-fuse. 2023-11-16T02:26:25.599 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../062-ceph-fuse_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:25.642 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-fuse (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:25.650 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-16T02:26:25.670 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-16T02:26:25.708 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-16T02:26:26.010 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-webob. 2023-11-16T02:26:26.020 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mds. 2023-11-16T02:26:26.022 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-16T02:26:26.035 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../063-ceph-mds_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:26.052 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-16T02:26:26.079 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mds (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:26.229 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-babel. 2023-11-16T02:26:26.242 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-16T02:26:26.279 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-16T02:26:26.465 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package cephadm. 2023-11-16T02:26:26.481 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../064-cephadm_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:26.497 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-waitress. 2023-11-16T02:26:26.515 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking cephadm (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:26.518 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-16T02:26:26.550 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-16T02:26:26.625 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jinja2. 2023-11-16T02:26:26.646 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-11-16T02:26:26.682 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-16T02:26:26.818 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-16T02:26:26.833 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-16T02:26:26.858 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-tempita. 2023-11-16T02:26:26.876 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-16T02:26:26.879 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-16T02:26:26.916 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-16T02:26:27.036 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-16T02:26:27.057 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:27.095 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-cephadm (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:27.204 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-16T02:26:27.218 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-paste. 2023-11-16T02:26:27.219 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-16T02:26:27.240 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-16T02:26:27.254 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-16T02:26:27.276 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-16T02:26:27.448 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-16T02:26:27.469 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-16T02:26:27.514 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-16T02:26:27.596 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-16T02:26:27.609 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-16T02:26:27.672 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-16T02:26:27.795 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pluggy. 2023-11-16T02:26:27.813 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-16T02:26:27.850 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-16T02:26:27.974 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-16T02:26:27.998 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-16T02:26:28.032 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-16T02:26:28.161 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-py. 2023-11-16T02:26:28.174 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2023-11-16T02:26:28.211 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-16T02:26:28.310 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-babel. 2023-11-16T02:26:28.323 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-16T02:26:28.335 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-webtest. 2023-11-16T02:26:28.356 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-11-16T02:26:28.367 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-16T02:26:28.393 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-16T02:26:28.582 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-16T02:26:28.603 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-16T02:26:28.639 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-16T02:26:28.730 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pecan. 2023-11-16T02:26:28.746 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-jinja2. 2023-11-16T02:26:28.751 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-16T02:26:28.761 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-11-16T02:26:28.789 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-16T02:26:28.796 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-16T02:26:28.984 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-toml. 2023-11-16T02:26:29.006 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2023-11-16T02:26:29.050 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-16T02:26:29.100 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-certifi. 2023-11-16T02:26:29.122 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-11-16T02:26:29.157 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-16T02:26:29.158 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-16T02:26:29.171 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:29.208 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mgr-cephadm (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:29.312 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pytest. 2023-11-16T02:26:29.333 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-16T02:26:29.362 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-16T02:26:29.445 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-idna. 2023-11-16T02:26:29.466 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-11-16T02:26:29.477 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-16T02:26:29.491 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-16T02:26:29.503 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-16T02:26:29.535 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-16T02:26:29.724 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-16T02:26:29.745 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2023-11-16T02:26:29.790 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-16T02:26:29.797 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-urllib3. 2023-11-16T02:26:29.810 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-16T02:26:29.839 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-16T02:26:29.873 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pluggy. 2023-11-16T02:26:29.886 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-16T02:26:29.930 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-16T02:26:30.117 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-requests. 2023-11-16T02:26:30.138 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-16T02:26:30.175 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-16T02:26:30.260 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-routes. 2023-11-16T02:26:30.267 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-py. 2023-11-16T02:26:30.281 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2023-11-16T02:26:30.281 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-16T02:26:30.325 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-16T02:26:30.326 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-16T02:26:30.470 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-16T02:26:30.491 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-16T02:26:30.527 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-16T02:26:30.663 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-16T02:26:30.684 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:30.687 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-16T02:26:30.701 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-16T02:26:30.729 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-dashboard (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:30.745 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-16T02:26:30.842 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-16T02:26:30.852 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:30.880 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr-modules-core (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:31.166 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-16T02:26:31.182 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-toml. 2023-11-16T02:26:31.185 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-16T02:26:31.197 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2023-11-16T02:26:31.231 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-16T02:26:31.249 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-16T02:26:31.319 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-16T02:26:31.340 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:31.385 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libsqlite3-mod-ceph (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:31.568 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pytest. 2023-11-16T02:26:31.583 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-16T02:26:31.626 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-16T02:26:31.687 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-openssl. 2023-11-16T02:26:31.700 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-11-16T02:26:31.738 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-16T02:26:31.761 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-joblib. 2023-11-16T02:26:31.782 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-16T02:26:31.819 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-16T02:26:31.929 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-16T02:26:31.944 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2023-11-16T02:26:32.004 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-16T02:26:32.065 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr. 2023-11-16T02:26:32.078 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../058-ceph-mgr_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:32.107 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:32.190 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-16T02:26:32.211 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-16T02:26:32.256 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-16T02:26:32.308 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-routes. 2023-11-16T02:26:32.322 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-16T02:26:32.366 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-16T02:26:32.493 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mon. 2023-11-16T02:26:32.514 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../059-ceph-mon_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:32.517 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-sklearn. 2023-11-16T02:26:32.539 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-16T02:26:32.553 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mon (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:32.576 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-16T02:26:32.885 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-16T02:26:32.901 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:32.981 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mgr-dashboard (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:33.389 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-16T02:26:33.404 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-16T02:26:33.419 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-16T02:26:33.431 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:33.455 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-16T02:26:33.469 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:33.605 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-osd. 2023-11-16T02:26:33.626 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../060-ceph-osd_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:33.796 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-osd (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:33.934 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-joblib. 2023-11-16T02:26:33.948 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-16T02:26:33.984 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-16T02:26:34.320 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-16T02:26:34.334 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-16T02:26:34.404 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-16T02:26:34.572 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cachetools. 2023-11-16T02:26:34.596 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2023-11-16T02:26:34.630 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-16T02:26:34.667 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-sklearn. 2023-11-16T02:26:34.681 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-16T02:26:34.725 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-16T02:26:34.892 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-16T02:26:34.904 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-16T02:26:34.941 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-16T02:26:35.262 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-16T02:26:35.282 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-16T02:26:35.320 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-16T02:26:35.513 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-16T02:26:35.525 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:35.570 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:35.665 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rsa. 2023-11-16T02:26:35.686 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2023-11-16T02:26:35.723 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-16T02:26:35.774 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph. 2023-11-16T02:26:35.796 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../061-ceph_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:35.824 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:36.035 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-google-auth. 2023-11-16T02:26:36.056 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2023-11-16T02:26:36.093 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-16T02:26:36.118 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-fuse. 2023-11-16T02:26:36.140 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../062-ceph-fuse_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:36.177 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-fuse (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:36.413 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-16T02:26:36.434 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-16T02:26:36.471 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-16T02:26:36.573 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-cachetools. 2023-11-16T02:26:36.588 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2023-11-16T02:26:36.623 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-16T02:26:36.749 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-websocket. 2023-11-16T02:26:36.761 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2023-11-16T02:26:36.772 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mds. 2023-11-16T02:26:36.790 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-16T02:26:36.793 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../063-ceph-mds_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:36.830 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mds (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:36.942 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-16T02:26:36.958 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-16T02:26:37.001 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-16T02:26:37.094 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-16T02:26:37.114 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-16T02:26:37.143 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-16T02:26:37.250 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package cephadm. 2023-11-16T02:26:37.271 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../064-cephadm_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:37.308 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking cephadm (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:37.363 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-16T02:26:37.378 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-16T02:26:37.421 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-16T02:26:37.585 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-16T02:26:37.607 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-16T02:26:37.644 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-16T02:26:37.776 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-rsa. 2023-11-16T02:26:37.790 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2023-11-16T02:26:37.832 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-16T02:26:37.849 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-16T02:26:37.871 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:37.915 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-k8sevents (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:37.963 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-16T02:26:37.984 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-16T02:26:38.021 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-16T02:26:38.153 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-google-auth. 2023-11-16T02:26:38.169 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2023-11-16T02:26:38.185 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-16T02:26:38.206 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-16T02:26:38.236 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-16T02:26:38.245 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-16T02:26:38.539 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-16T02:26:38.554 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-16T02:26:38.589 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-16T02:26:38.596 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-16T02:26:38.617 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-16T02:26:38.662 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-16T02:26:38.917 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-websocket. 2023-11-16T02:26:38.931 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package jq. 2023-11-16T02:26:38.932 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2023-11-16T02:26:38.944 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-16T02:26:38.975 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-16T02:26:38.981 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-16T02:26:39.068 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-babel. 2023-11-16T02:26:39.090 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-16T02:26:39.134 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-16T02:26:39.234 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package socat. 2023-11-16T02:26:39.248 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-16T02:26:39.292 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-16T02:26:39.329 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-16T02:26:39.344 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-16T02:26:39.387 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-16T02:26:39.454 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-jinja2. 2023-11-16T02:26:39.476 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-11-16T02:26:39.512 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-16T02:26:39.629 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package xmlstarlet. 2023-11-16T02:26:39.641 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-16T02:26:39.670 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-16T02:26:39.924 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-16T02:26:39.945 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:39.990 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr-cephadm (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:40.033 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-test. 2023-11-16T02:26:40.055 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../098-ceph-test_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:40.091 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-test (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:40.093 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-16T02:26:40.109 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:40.151 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mgr-k8sevents (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:40.319 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-16T02:26:40.340 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-16T02:26:40.385 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-16T02:26:40.445 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-16T02:26:40.459 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-16T02:26:40.495 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-16T02:26:40.713 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pluggy. 2023-11-16T02:26:40.734 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-16T02:26:40.779 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-16T02:26:40.857 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-16T02:26:40.871 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-16T02:26:40.915 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-16T02:26:41.091 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-py. 2023-11-16T02:26:41.112 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2023-11-16T02:26:41.157 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-16T02:26:41.200 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package jq. 2023-11-16T02:26:41.214 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-16T02:26:41.259 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-16T02:26:41.485 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-16T02:26:41.504 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package socat. 2023-11-16T02:26:41.507 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-16T02:26:41.518 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-16T02:26:41.562 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-16T02:26:41.585 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-16T02:26:41.865 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package xmlstarlet. 2023-11-16T02:26:41.880 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-16T02:26:41.888 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-toml. 2023-11-16T02:26:41.909 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2023-11-16T02:26:41.915 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-16T02:26:41.954 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-16T02:26:42.257 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pytest. 2023-11-16T02:26:42.279 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-16T02:26:42.286 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-test. 2023-11-16T02:26:42.300 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../098-ceph-test_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:42.324 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-16T02:26:42.345 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-test (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:42.428 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-volume. 2023-11-16T02:26:42.449 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../099-ceph-volume_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:42.494 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-volume (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:42.685 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-16T02:26:42.707 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2023-11-16T02:26:42.752 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-16T02:26:42.874 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-16T02:26:42.895 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:42.940 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking cephfs-mirror (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:43.054 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-routes. 2023-11-16T02:26:43.076 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-16T02:26:43.121 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-16T02:26:43.252 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-colorama. 2023-11-16T02:26:43.273 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2023-11-16T02:26:43.318 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-16T02:26:43.483 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-16T02:26:43.505 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:43.550 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr-dashboard (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:43.579 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package cephfs-shell. 2023-11-16T02:26:43.591 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../102-cephfs-shell_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:43.629 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking cephfs-shell (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:43.907 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package cephfs-top. 2023-11-16T02:26:43.919 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../103-cephfs-top_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:43.957 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking cephfs-top (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:43.962 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-16T02:26:43.974 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-16T02:26:44.011 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-16T02:26:44.243 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-16T02:26:44.249 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-volume. 2023-11-16T02:26:44.255 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:44.265 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../099-ceph-volume_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:44.301 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libcephfs-dev (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:44.308 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-volume (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:44.548 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-joblib. 2023-11-16T02:26:44.570 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-16T02:26:44.614 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-16T02:26:44.720 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-16T02:26:44.736 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:44.771 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package nvme-cli. 2023-11-16T02:26:44.779 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking cephfs-mirror (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:44.793 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-16T02:26:44.846 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-16T02:26:44.976 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-16T02:26:44.998 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-16T02:26:45.042 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-16T02:26:45.090 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-colorama. 2023-11-16T02:26:45.106 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2023-11-16T02:26:45.140 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-16T02:26:45.210 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-16T02:26:45.231 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-16T02:26:45.276 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-16T02:26:45.362 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-sklearn. 2023-11-16T02:26:45.383 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-16T02:26:45.389 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package cephfs-shell. 2023-11-16T02:26:45.405 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../102-cephfs-shell_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:45.428 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-16T02:26:45.443 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking cephfs-shell (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:45.679 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pastescript. 2023-11-16T02:26:45.700 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2023-11-16T02:26:45.712 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package cephfs-top. 2023-11-16T02:26:45.728 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../103-cephfs-top_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:45.745 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-16T02:26:45.771 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking cephfs-top (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:46.033 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-psutil. 2023-11-16T02:26:46.044 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-16T02:26:46.048 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-16T02:26:46.064 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:46.090 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-16T02:26:46.106 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libcephfs-dev (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:46.288 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-16T02:26:46.311 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:46.363 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:46.435 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pygments. 2023-11-16T02:26:46.457 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-16T02:26:46.468 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package nvme-cli. 2023-11-16T02:26:46.484 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-16T02:26:46.501 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-16T02:26:46.527 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-16T02:26:46.882 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-16T02:26:46.897 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-16T02:26:46.940 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-16T02:26:46.972 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-16T02:26:46.994 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-16T02:26:47.038 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-16T02:26:47.341 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-simplejson. 2023-11-16T02:26:47.363 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-16T02:26:47.377 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pastescript. 2023-11-16T02:26:47.392 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2023-11-16T02:26:47.407 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-16T02:26:47.434 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-16T02:26:47.566 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-cachetools. 2023-11-16T02:26:47.588 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2023-11-16T02:26:47.624 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-16T02:26:47.677 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-16T02:26:47.699 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-16T02:26:47.744 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-16T02:26:47.755 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-psutil. 2023-11-16T02:26:47.770 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-16T02:26:47.813 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-16T02:26:47.885 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-16T02:26:47.907 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-16T02:26:47.952 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-16T02:26:48.166 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pygments. 2023-11-16T02:26:48.182 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-16T02:26:48.224 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-16T02:26:48.297 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-16T02:26:48.318 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-16T02:26:48.372 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-16T02:26:48.663 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package radosgw. 2023-11-16T02:26:48.678 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../113-radosgw_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:48.678 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-16T02:26:48.694 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-16T02:26:48.708 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-rsa. 2023-11-16T02:26:48.731 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking radosgw (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:48.731 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2023-11-16T02:26:48.760 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-16T02:26:48.774 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-16T02:26:49.015 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-simplejson. 2023-11-16T02:26:49.033 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-16T02:26:49.061 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-google-auth. 2023-11-16T02:26:49.074 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-16T02:26:49.086 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2023-11-16T02:26:49.120 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-16T02:26:49.382 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-16T02:26:49.395 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-16T02:26:49.395 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-16T02:26:49.408 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-16T02:26:49.423 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-16T02:26:49.450 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-16T02:26:49.519 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package rbd-fuse. 2023-11-16T02:26:49.538 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../114-rbd-fuse_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:49.583 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking rbd-fuse (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:49.759 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-websocket. 2023-11-16T02:26:49.782 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2023-11-16T02:26:49.825 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-16T02:26:49.893 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-16T02:26:50.138 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package radosgw. 2023-11-16T02:26:50.152 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../113-radosgw_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:50.163 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-16T02:26:50.170 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-16T02:26:50.187 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking radosgw (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:50.192 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-16T02:26:50.236 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-16T02:26:50.331 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-16T02:26:50.605 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-16T02:26:50.782 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package rbd-fuse. 2023-11-16T02:26:50.797 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../114-rbd-fuse_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:50.840 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking rbd-fuse (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:50.942 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-16T02:26:50.953 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-16T02:26:50.972 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:51.016 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr-k8sevents (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:51.133 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-16T02:26:51.361 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-16T02:26:51.382 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-16T02:26:51.412 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-16T02:26:51.427 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-16T02:26:51.451 INFO:teuthology.orchestra.run.smithi070.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-16T02:26:51.513 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-16T02:26:51.558 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up cephadm (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:51.730 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-16T02:26:51.752 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-16T02:26:51.762 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-16T02:26:51.797 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-16T02:26:52.074 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package jq. 2023-11-16T02:26:52.083 INFO:teuthology.orchestra.run.smithi070.stdout:Adding system user cephadm....done 2023-11-16T02:26:52.087 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-16T02:26:52.124 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-16T02:26:52.177 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-16T02:26:52.297 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-16T02:26:52.386 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package socat. 2023-11-16T02:26:52.398 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-16T02:26:52.435 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-16T02:26:52.557 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-16T02:26:52.788 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package xmlstarlet. 2023-11-16T02:26:52.791 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-16T02:26:52.799 INFO:teuthology.orchestra.run.smithi204.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-16T02:26:52.810 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-16T02:26:52.812 INFO:teuthology.orchestra.run.smithi204.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-16T02:26:52.854 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-16T02:26:52.882 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up cephadm (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:52.892 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-16T02:26:53.143 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-16T02:26:53.258 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-test. 2023-11-16T02:26:53.272 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../098-ceph-test_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:53.317 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-test (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:53.402 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-16T02:26:53.512 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-16T02:26:53.546 INFO:teuthology.orchestra.run.smithi204.stdout:Adding system user cephadm....done 2023-11-16T02:26:53.805 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-16T02:26:54.023 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-16T02:26:54.148 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-16T02:26:54.341 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-16T02:26:54.391 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-16T02:26:54.618 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-16T02:26:54.635 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-16T02:26:54.744 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-16T02:26:54.902 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-16T02:26:55.011 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-16T02:26:55.145 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-16T02:26:55.288 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-16T02:26:55.389 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-16T02:26:55.396 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-16T02:26:55.647 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-ceph-argparse (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:55.700 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-16T02:26:55.956 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-16T02:26:55.971 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-volume. 2023-11-16T02:26:55.993 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../099-ceph-volume_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:56.045 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-volume (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:56.057 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-16T02:26:56.077 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-16T02:26:56.333 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-16T02:26:56.344 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-16T02:26:56.491 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-16T02:26:56.513 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:56.566 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking cephfs-mirror (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:56.593 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-16T02:26:56.603 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-16T02:26:56.719 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-16T02:26:56.919 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-colorama. 2023-11-16T02:26:56.938 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-16T02:26:56.941 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2023-11-16T02:26:56.985 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-16T02:26:57.078 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-16T02:26:57.204 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-16T02:26:57.255 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package cephfs-shell. 2023-11-16T02:26:57.277 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../102-cephfs-shell_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:57.281 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-16T02:26:57.313 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking cephfs-shell (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:57.481 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-16T02:26:57.549 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-16T02:26:57.599 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package cephfs-top. 2023-11-16T02:26:57.621 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../103-cephfs-top_18.2.0-1240-gcb2179ff-1jammy_all.deb ... 2023-11-16T02:26:57.666 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking cephfs-top (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:57.727 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-16T02:26:57.817 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-ceph-argparse (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:57.918 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-16T02:26:57.940 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:26:57.985 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libcephfs-dev (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:26:58.008 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-16T02:26:58.085 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-16T02:26:58.211 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-16T02:26:58.371 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package nvme-cli. 2023-11-16T02:26:58.393 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-16T02:26:58.454 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-16T02:26:58.478 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-16T02:26:58.693 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-16T02:26:58.730 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-16T02:26:58.820 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-16T02:26:58.830 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-16T02:26:58.833 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-16T02:26:58.878 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-16T02:26:58.952 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-16T02:26:59.087 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-16T02:26:59.215 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-16T02:26:59.238 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-16T02:26:59.341 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-16T02:26:59.364 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pastescript. 2023-11-16T02:26:59.386 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2023-11-16T02:26:59.431 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-16T02:26:59.539 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-16T02:26:59.659 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-16T02:26:59.751 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-psutil. 2023-11-16T02:26:59.773 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-16T02:26:59.818 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-16T02:26:59.932 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-16T02:26:59.935 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-16T02:27:00.183 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-16T02:27:00.205 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pygments. 2023-11-16T02:27:00.226 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-16T02:27:00.245 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-16T02:27:00.270 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-16T02:27:00.568 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-16T02:27:00.741 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-16T02:27:00.763 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-16T02:27:00.816 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-16T02:27:00.861 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-16T02:27:00.922 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-16T02:27:01.127 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-simplejson. 2023-11-16T02:27:01.140 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-16T02:27:01.163 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-16T02:27:01.169 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-16T02:27:01.190 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-16T02:27:01.349 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-16T02:27:01.421 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-16T02:27:01.434 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-16T02:27:01.471 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-16T02:27:01.483 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-16T02:27:01.505 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-16T02:27:01.748 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-16T02:27:01.826 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-16T02:27:01.874 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-ceph-common (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:02.175 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-idna (3.3-1) ... 2023-11-16T02:27:02.228 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-16T02:27:02.284 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package radosgw. 2023-11-16T02:27:02.306 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../113-radosgw_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:27:02.350 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking radosgw (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:02.493 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-16T02:27:02.512 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-16T02:27:02.905 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-16T02:27:03.206 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-16T02:27:03.286 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package rbd-fuse. 2023-11-16T02:27:03.308 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../114-rbd-fuse_18.2.0-1240-gcb2179ff-1jammy_amd64.deb ... 2023-11-16T02:27:03.353 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking rbd-fuse (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:03.592 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-16T02:27:03.624 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-16T02:27:03.663 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-16T02:27:03.742 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-16T02:27:03.943 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-16T02:27:04.001 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-16T02:27:04.066 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-16T02:27:04.127 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-16T02:27:04.192 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-16T02:27:04.236 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-16T02:27:04.253 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-16T02:27:04.362 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-ceph-common (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:04.481 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-16T02:27:04.556 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-16T02:27:04.655 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-idna (3.3-1) ... 2023-11-16T02:27:04.824 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-16T02:27:04.862 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-16T02:27:05.006 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-16T02:27:05.083 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-16T02:27:05.201 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-11-16T02:27:05.308 INFO:teuthology.orchestra.run.smithi028.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-16T02:27:05.318 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-16T02:27:05.370 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up cephadm (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:05.603 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-16T02:27:05.854 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-16T02:27:05.928 INFO:teuthology.orchestra.run.smithi028.stdout:Adding system user cephadm....done 2023-11-16T02:27:06.084 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-16T02:27:06.124 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-16T02:27:06.245 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-16T02:27:06.372 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-16T02:27:06.381 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-16T02:27:06.410 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-16T02:27:06.633 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-16T02:27:06.639 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-16T02:27:06.678 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-16T02:27:06.765 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-16T02:27:06.804 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-16T02:27:06.893 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-16T02:27:06.900 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-16T02:27:07.026 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-16T02:27:07.063 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-16T02:27:07.209 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-16T02:27:07.302 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-16T02:27:07.323 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-16T02:27:07.428 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-16T02:27:07.449 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-16T02:27:07.487 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-16T02:27:07.729 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-16T02:27:07.768 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-16T02:27:07.770 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-16T02:27:07.871 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-11-16T02:27:07.997 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-16T02:27:08.039 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-16T02:27:08.136 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-16T02:27:08.298 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-16T02:27:08.351 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-16T02:27:08.387 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-16T02:27:08.616 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-16T02:27:08.646 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-16T02:27:08.726 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-16T02:27:08.909 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-16T02:27:08.923 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-16T02:27:09.009 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-16T02:27:09.135 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-16T02:27:09.210 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-16T02:27:09.218 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-16T02:27:09.483 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-16T02:27:09.495 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-16T02:27:09.511 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-16T02:27:09.771 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-16T02:27:09.771 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-16T02:27:09.851 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-ceph-argparse (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:09.872 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-16T02:27:10.031 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-16T02:27:10.157 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-16T02:27:10.173 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-16T02:27:10.185 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-16T02:27:10.299 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-16T02:27:10.311 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-16T02:27:10.466 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-16T02:27:10.579 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-16T02:27:10.609 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-16T02:27:10.750 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-16T02:27:10.847 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-16T02:27:10.953 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-16T02:27:10.973 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-16T02:27:11.010 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-16T02:27:11.136 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-16T02:27:11.219 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-16T02:27:11.358 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-16T02:27:11.395 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-16T02:27:11.484 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-16T02:27:11.663 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-16T02:27:11.667 INFO:teuthology.orchestra.run.smithi204.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-16T02:27:11.752 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-16T02:27:11.931 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-16T02:27:11.939 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-16T02:27:12.028 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-16T02:27:12.065 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-16T02:27:12.307 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-16T02:27:12.354 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-16T02:27:12.467 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-16T02:27:12.593 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-16T02:27:12.743 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-16T02:27:12.927 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-16T02:27:13.028 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-16T02:27:13.048 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-16T02:27:13.053 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librados2 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:13.153 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-16T02:27:13.179 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librgw2 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:13.364 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-16T02:27:13.391 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libsqlite3-mod-ceph (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:13.471 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-16T02:27:13.492 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-16T02:27:13.516 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libcephfs2 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:13.627 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-16T02:27:13.634 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libradosstriper1 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:13.735 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-16T02:27:13.765 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-16T02:27:13.936 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-16T02:27:14.003 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librbd1 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:14.099 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-16T02:27:14.162 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-modules-core (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:14.233 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-16T02:27:14.289 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-fuse (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:14.345 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-16T02:27:14.499 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-16T02:27:14.499 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-16T02:27:14.551 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-16T02:27:14.597 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-16T02:27:14.837 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-16T02:27:15.024 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-16T02:27:15.065 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libcephfs-dev (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:15.112 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-16T02:27:15.183 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rados (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:15.310 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up cephfs-top (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:15.358 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-16T02:27:15.435 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-16T02:27:15.489 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-16T02:27:15.685 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-16T02:27:15.790 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-16T02:27:16.053 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-16T02:27:16.144 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-16T02:27:16.293 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up librados2 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:16.312 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-16T02:27:16.411 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up librgw2 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:16.463 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-ceph-common (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:16.589 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rbd (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:16.614 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libsqlite3-mod-ceph (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:16.698 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up rbd-fuse (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:16.774 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libcephfs2 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:16.790 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-idna (3.3-1) ... 2023-11-16T02:27:16.816 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rgw (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:16.900 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libradosstriper1 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:16.942 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cephfs (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:17.034 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-16T02:27:17.068 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up cephfs-shell (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:17.141 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-16T02:27:17.194 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-common (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:17.331 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up librbd1 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:17.437 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mgr-modules-core (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:17.538 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-fuse (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:17.770 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-16T02:27:17.770 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-16T02:27:17.795 INFO:teuthology.orchestra.run.smithi070.stdout:Adding group ceph....done 2023-11-16T02:27:18.138 INFO:teuthology.orchestra.run.smithi070.stdout:Adding system user ceph....done 2023-11-16T02:27:18.298 INFO:teuthology.orchestra.run.smithi070.stdout:Setting system user ceph properties....done 2023-11-16T02:27:18.317 INFO:teuthology.orchestra.run.smithi070.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-16T02:27:18.398 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libcephfs-dev (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:18.430 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-16T02:27:18.457 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-16T02:27:18.533 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-rados (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:18.589 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-16T02:27:18.684 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up cephfs-top (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:18.795 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-16T02:27:18.802 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-16T02:27:18.865 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-16T02:27:19.000 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-16T02:27:19.134 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-16T02:27:19.378 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up cephfs-mirror (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:19.469 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-16T02:27:19.596 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-16T02:27:19.596 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-16T02:27:19.737 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-16T02:27:20.005 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-16T02:27:20.081 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-rbd (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:20.131 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-11-16T02:27:20.138 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-test (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:20.208 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up rbd-fuse (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:20.264 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up radosgw (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:20.282 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-16T02:27:20.334 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-rgw (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:20.460 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-cephfs (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:20.611 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up cephfs-shell (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:20.625 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-16T02:27:20.721 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-common (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:20.764 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-16T02:27:20.766 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-16T02:27:20.893 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-16T02:27:21.177 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-16T02:27:21.259 INFO:teuthology.orchestra.run.smithi204.stdout:Adding group ceph....done 2023-11-16T02:27:21.284 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-base (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:21.445 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-16T02:27:21.661 INFO:teuthology.orchestra.run.smithi204.stdout:Adding system user ceph....done 2023-11-16T02:27:21.730 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-16T02:27:21.839 INFO:teuthology.orchestra.run.smithi204.stdout:Setting system user ceph properties....done 2023-11-16T02:27:21.855 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-16T02:27:21.856 INFO:teuthology.orchestra.run.smithi204.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-16T02:27:21.997 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-16T02:27:22.048 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-16T02:27:22.199 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-16T02:27:22.383 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-16T02:27:22.462 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mds (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:22.509 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-16T02:27:22.643 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-16T02:27:22.692 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-16T02:27:22.692 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-16T02:27:22.961 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-16T02:27:23.116 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up cephfs-mirror (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:23.236 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:23.270 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-16T02:27:23.324 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-16T02:27:23.324 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-16T02:27:23.490 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-16T02:27:23.490 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-16T02:27:23.538 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-16T02:27:23.926 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-16T02:27:23.933 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-test (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:24.038 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-osd (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:24.051 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up radosgw (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:24.216 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-16T02:27:24.342 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-16T02:27:24.355 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-16T02:27:24.356 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-16T02:27:24.602 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-16T02:27:24.602 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-16T02:27:24.744 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-16T02:27:24.931 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-k8sevents (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:25.020 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-16T02:27:25.141 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-diskprediction-local (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:25.229 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-base (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:25.263 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-16T02:27:25.309 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mon (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:25.414 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-16T02:27:25.510 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-16T02:27:25.511 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-16T02:27:25.619 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-16T02:27:25.806 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-16T02:27:26.068 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-cephadm (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:26.108 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-16T02:27:26.219 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:26.299 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mds (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:26.354 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-dashboard (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:26.401 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-16T02:27:26.505 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-volume (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:26.520 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-16T02:27:26.520 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-16T02:27:26.527 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-16T02:27:26.803 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-16T02:27:26.849 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-16T02:27:27.104 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-16T02:27:27.149 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mgr (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:27.403 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-16T02:27:27.404 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-16T02:27:27.422 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-16T02:27:27.716 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-16T02:27:27.840 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-16T02:27:28.033 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-osd (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:28.150 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-16T02:27:28.178 INFO:teuthology.orchestra.run.smithi070.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-16T02:27:28.181 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-16T02:27:28.281 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2023-11-16T02:27:28.468 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2023-11-16T02:27:28.469 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2023-11-16T02:27:28.476 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-16T02:27:28.476 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-16T02:27:28.505 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-16T02:27:28.632 INFO:teuthology.orchestra.run.smithi070.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-16T02:27:28.632 INFO:teuthology.orchestra.run.smithi070.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-16T02:27:28.632 INFO:teuthology.orchestra.run.smithi070.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-16T02:27:28.632 INFO:teuthology.orchestra.run.smithi070.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-16T02:27:28.632 INFO:teuthology.orchestra.run.smithi070.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-16T02:27:28.632 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2023-11-16T02:27:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-16T02:27:28.632 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-16T02:27:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-16T02:27:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-11-16T02:27:28.633 INFO:teuthology.orchestra.run.smithi070.stdout: python2.7-minimal 2023-11-16T02:27:28.634 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-16T02:27:28.634 INFO:teuthology.orchestra.run.smithi070.stdout:The following additional packages will be installed: 2023-11-16T02:27:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-16T02:27:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-16T02:27:28.634 INFO:teuthology.orchestra.run.smithi070.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-16T02:27:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-16T02:27:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-16T02:27:28.635 INFO:teuthology.orchestra.run.smithi070.stdout:Suggested packages: 2023-11-16T02:27:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-16T02:27:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-16T02:27:28.635 INFO:teuthology.orchestra.run.smithi070.stdout: libengine-pkcs11-openssl 2023-11-16T02:27:28.653 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up librados2 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:28.671 INFO:teuthology.orchestra.run.smithi070.stdout:The following NEW packages will be installed: 2023-11-16T02:27:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-16T02:27:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-16T02:27:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-16T02:27:28.672 INFO:teuthology.orchestra.run.smithi070.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-16T02:27:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-16T02:27:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-16T02:27:28.673 INFO:teuthology.orchestra.run.smithi070.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-16T02:27:28.673 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages will be upgraded: 2023-11-16T02:27:28.674 INFO:teuthology.orchestra.run.smithi070.stdout: libssl3 2023-11-16T02:27:28.727 INFO:teuthology.orchestra.run.smithi070.stdout:1 upgraded, 39 newly installed, 0 to remove and 262 not upgraded. 2023-11-16T02:27:28.727 INFO:teuthology.orchestra.run.smithi070.stdout:Need to get 54.6 MB of archives. 2023-11-16T02:27:28.727 INFO:teuthology.orchestra.run.smithi070.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-16T02:27:28.727 INFO:teuthology.orchestra.run.smithi070.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-16T02:27:28.804 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up librgw2 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:28.847 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-16T02:27:28.923 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-16T02:27:28.940 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-16T02:27:28.941 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-16T02:27:28.944 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-16T02:27:28.946 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-16T02:27:28.946 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-16T02:27:28.948 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-16T02:27:28.951 INFO:teuthology.orchestra.run.smithi070.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-16T02:27:28.951 INFO:teuthology.orchestra.run.smithi070.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-16T02:27:28.957 INFO:teuthology.orchestra.run.smithi070.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-16T02:27:28.970 INFO:teuthology.orchestra.run.smithi070.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-16T02:27:29.066 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libsqlite3-mod-ceph (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:29.094 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mgr-k8sevents (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:29.192 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libcephfs2 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:29.279 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mgr-diskprediction-local (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:29.335 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libradosstriper1 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:29.422 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mon (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:29.486 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-16T02:27:29.491 INFO:teuthology.orchestra.run.smithi070.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-16T02:27:29.493 INFO:teuthology.orchestra.run.smithi070.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-16T02:27:29.494 INFO:teuthology.orchestra.run.smithi070.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-16T02:27:29.498 INFO:teuthology.orchestra.run.smithi070.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-16T02:27:29.498 INFO:teuthology.orchestra.run.smithi070.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-16T02:27:29.505 INFO:teuthology.orchestra.run.smithi070.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-16T02:27:29.507 INFO:teuthology.orchestra.run.smithi070.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-16T02:27:29.519 INFO:teuthology.orchestra.run.smithi070.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-16T02:27:29.547 INFO:teuthology.orchestra.run.smithi070.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-16T02:27:29.583 INFO:teuthology.orchestra.run.smithi070.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-16T02:27:29.583 INFO:teuthology.orchestra.run.smithi070.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-16T02:27:29.598 INFO:teuthology.orchestra.run.smithi070.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-16T02:27:29.623 INFO:teuthology.orchestra.run.smithi070.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-16T02:27:29.626 INFO:teuthology.orchestra.run.smithi070.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-16T02:27:29.627 INFO:teuthology.orchestra.run.smithi070.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-16T02:27:29.627 INFO:teuthology.orchestra.run.smithi070.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-16T02:27:29.628 INFO:teuthology.orchestra.run.smithi070.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-16T02:27:29.631 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-16T02:27:29.631 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-16T02:27:29.638 INFO:teuthology.orchestra.run.smithi070.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-16T02:27:29.639 INFO:teuthology.orchestra.run.smithi070.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-16T02:27:29.807 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up librbd1 (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:29.918 INFO:teuthology.orchestra.run.smithi070.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-16T02:27:29.918 INFO:teuthology.orchestra.run.smithi070.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-16T02:27:29.919 INFO:teuthology.orchestra.run.smithi070.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-16T02:27:29.919 INFO:teuthology.orchestra.run.smithi070.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-16T02:27:29.919 INFO:teuthology.orchestra.run.smithi070.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-16T02:27:29.919 INFO:teuthology.orchestra.run.smithi070.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-16T02:27:29.930 INFO:teuthology.orchestra.run.smithi070.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-16T02:27:29.930 INFO:teuthology.orchestra.run.smithi070.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-16T02:27:29.941 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr-modules-core (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:30.065 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-fuse (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:30.265 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mgr-cephadm (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:30.283 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-16T02:27:30.283 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-16T02:27:30.333 INFO:teuthology.orchestra.run.smithi070.stdout:Preconfiguring packages ... 2023-11-16T02:27:30.407 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:30.485 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 54.6 MB in 1s (43.7 MB/s) 2023-11-16T02:27:30.517 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mgr-dashboard (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:30.624 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package flex. 2023-11-16T02:27:30.676 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-volume (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:30.712 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137421 files and directories currently installed.) 2023-11-16T02:27:30.716 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-16T02:27:30.755 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-16T02:27:30.800 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libcephfs-dev (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:30.926 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-rados (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:31.029 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-16T02:27:31.052 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up cephfs-top (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:31.178 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-16T02:27:31.332 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-16T02:27:31.519 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-16T02:27:31.942 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-16T02:27:32.189 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-16T02:27:32.374 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-rbd (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:32.479 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package bison. 2023-11-16T02:27:32.525 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up rbd-fuse (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:32.567 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137494 files and directories currently installed.) 2023-11-16T02:27:32.571 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-16T02:27:32.622 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-16T02:27:32.651 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-rgw (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:32.666 INFO:teuthology.orchestra.run.smithi204.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-16T02:27:32.671 DEBUG:teuthology.orchestra.run.smithi204:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-16T02:27:32.748 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2023-11-16T02:27:32.777 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-cephfs (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:32.903 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up cephfs-shell (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:32.915 INFO:teuthology.orchestra.run.smithi204.stdout:Building dependency tree... 2023-11-16T02:27:32.916 INFO:teuthology.orchestra.run.smithi204.stdout:Reading state information... 2023-11-16T02:27:33.054 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-common (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:33.056 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-16T02:27:33.065 INFO:teuthology.orchestra.run.smithi204.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-16T02:27:33.065 INFO:teuthology.orchestra.run.smithi204.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-16T02:27:33.065 INFO:teuthology.orchestra.run.smithi204.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-16T02:27:33.065 INFO:teuthology.orchestra.run.smithi204.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-16T02:27:33.065 INFO:teuthology.orchestra.run.smithi204.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-16T02:27:33.065 INFO:teuthology.orchestra.run.smithi204.stdout:The following packages were automatically installed and are no longer required: 2023-11-16T02:27:33.065 INFO:teuthology.orchestra.run.smithi204.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-16T02:27:33.065 INFO:teuthology.orchestra.run.smithi204.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-16T02:27:33.065 INFO:teuthology.orchestra.run.smithi204.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-16T02:27:33.066 INFO:teuthology.orchestra.run.smithi204.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-16T02:27:33.066 INFO:teuthology.orchestra.run.smithi204.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-16T02:27:33.066 INFO:teuthology.orchestra.run.smithi204.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-16T02:27:33.066 INFO:teuthology.orchestra.run.smithi204.stdout:The following additional packages will be installed: 2023-11-16T02:27:33.067 INFO:teuthology.orchestra.run.smithi204.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-16T02:27:33.067 INFO:teuthology.orchestra.run.smithi204.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-16T02:27:33.067 INFO:teuthology.orchestra.run.smithi204.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-16T02:27:33.067 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-16T02:27:33.067 INFO:teuthology.orchestra.run.smithi204.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-16T02:27:33.068 INFO:teuthology.orchestra.run.smithi204.stdout:Suggested packages: 2023-11-16T02:27:33.068 INFO:teuthology.orchestra.run.smithi204.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-16T02:27:33.068 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-16T02:27:33.068 INFO:teuthology.orchestra.run.smithi204.stdout: libengine-pkcs11-openssl 2023-11-16T02:27:33.078 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-16T02:27:33.117 INFO:teuthology.orchestra.run.smithi204.stdout:The following NEW packages will be installed: 2023-11-16T02:27:33.118 INFO:teuthology.orchestra.run.smithi204.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-16T02:27:33.118 INFO:teuthology.orchestra.run.smithi204.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-16T02:27:33.118 INFO:teuthology.orchestra.run.smithi204.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-16T02:27:33.118 INFO:teuthology.orchestra.run.smithi204.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-16T02:27:33.118 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-16T02:27:33.118 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-16T02:27:33.119 INFO:teuthology.orchestra.run.smithi204.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-16T02:27:33.119 INFO:teuthology.orchestra.run.smithi204.stdout:The following packages will be upgraded: 2023-11-16T02:27:33.120 INFO:teuthology.orchestra.run.smithi204.stdout: libssl3 2023-11-16T02:27:33.123 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-16T02:27:33.182 INFO:teuthology.orchestra.run.smithi204.stdout:1 upgraded, 39 newly installed, 0 to remove and 262 not upgraded. 2023-11-16T02:27:33.182 INFO:teuthology.orchestra.run.smithi204.stdout:Need to get 54.6 MB of archives. 2023-11-16T02:27:33.182 INFO:teuthology.orchestra.run.smithi204.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-16T02:27:33.182 INFO:teuthology.orchestra.run.smithi204.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-16T02:27:33.301 INFO:teuthology.orchestra.run.smithi204.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-16T02:27:33.365 INFO:teuthology.orchestra.run.smithi204.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-16T02:27:33.375 INFO:teuthology.orchestra.run.smithi204.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-16T02:27:33.376 INFO:teuthology.orchestra.run.smithi204.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-16T02:27:33.378 INFO:teuthology.orchestra.run.smithi204.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-16T02:27:33.379 INFO:teuthology.orchestra.run.smithi204.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-16T02:27:33.379 INFO:teuthology.orchestra.run.smithi204.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-16T02:27:33.380 INFO:teuthology.orchestra.run.smithi204.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-16T02:27:33.381 INFO:teuthology.orchestra.run.smithi204.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-16T02:27:33.382 INFO:teuthology.orchestra.run.smithi204.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-16T02:27:33.386 INFO:teuthology.orchestra.run.smithi204.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-16T02:27:33.402 INFO:teuthology.orchestra.run.smithi204.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-16T02:27:33.468 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package dump. 2023-11-16T02:27:33.490 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-16T02:27:33.534 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking dump (0.4b47-3) ... 2023-11-16T02:27:33.640 INFO:teuthology.orchestra.run.smithi204.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-16T02:27:33.642 INFO:teuthology.orchestra.run.smithi204.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-16T02:27:33.643 INFO:teuthology.orchestra.run.smithi204.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-16T02:27:33.646 INFO:teuthology.orchestra.run.smithi204.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-16T02:27:33.646 INFO:teuthology.orchestra.run.smithi204.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-16T02:27:33.651 INFO:teuthology.orchestra.run.smithi204.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-16T02:27:33.653 INFO:teuthology.orchestra.run.smithi204.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-16T02:27:33.661 INFO:teuthology.orchestra.run.smithi204.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-16T02:27:33.661 INFO:teuthology.orchestra.run.smithi204.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-16T02:27:33.684 INFO:teuthology.orchestra.run.smithi204.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-16T02:27:33.685 INFO:teuthology.orchestra.run.smithi204.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-16T02:27:33.696 INFO:teuthology.orchestra.run.smithi204.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-16T02:27:33.714 INFO:teuthology.orchestra.run.smithi028.stdout:Adding group ceph....done 2023-11-16T02:27:33.718 INFO:teuthology.orchestra.run.smithi204.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-16T02:27:33.722 INFO:teuthology.orchestra.run.smithi204.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-16T02:27:33.722 INFO:teuthology.orchestra.run.smithi204.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-16T02:27:33.723 INFO:teuthology.orchestra.run.smithi204.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-16T02:27:33.724 INFO:teuthology.orchestra.run.smithi204.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-16T02:27:33.736 INFO:teuthology.orchestra.run.smithi204.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-16T02:27:33.739 INFO:teuthology.orchestra.run.smithi204.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-16T02:27:33.863 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package indent. 2023-11-16T02:27:33.885 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-16T02:27:33.899 INFO:teuthology.orchestra.run.smithi204.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-16T02:27:33.899 INFO:teuthology.orchestra.run.smithi204.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-16T02:27:33.899 INFO:teuthology.orchestra.run.smithi204.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-16T02:27:33.899 INFO:teuthology.orchestra.run.smithi204.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-16T02:27:33.900 INFO:teuthology.orchestra.run.smithi204.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-16T02:27:33.900 INFO:teuthology.orchestra.run.smithi204.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-16T02:27:33.914 INFO:teuthology.orchestra.run.smithi204.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-16T02:27:33.914 INFO:teuthology.orchestra.run.smithi204.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-16T02:27:33.937 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-16T02:27:34.099 INFO:teuthology.orchestra.run.smithi028.stdout:Adding system user ceph....done 2023-11-16T02:27:34.289 INFO:teuthology.orchestra.run.smithi204.stdout:Preconfiguring packages ... 2023-11-16T02:27:34.301 INFO:teuthology.orchestra.run.smithi028.stdout:Setting system user ceph properties....done 2023-11-16T02:27:34.317 INFO:teuthology.orchestra.run.smithi028.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-16T02:27:34.339 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-16T02:27:34.358 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-16T02:27:34.463 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-16T02:27:34.488 INFO:teuthology.orchestra.run.smithi204.stdout:Fetched 54.6 MB in 1s (69.4 MB/s) 2023-11-16T02:27:34.613 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package flex. 2023-11-16T02:27:34.665 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-16T02:27:34.684 INFO:teuthology.orchestra.run.smithi204.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139847 files and directories currently installed.) 2023-11-16T02:27:34.688 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-16T02:27:34.728 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-16T02:27:34.827 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-16T02:27:35.076 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-16T02:27:35.099 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-16T02:27:35.143 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-16T02:27:35.315 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-16T02:27:35.370 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-16T02:27:35.373 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up cephfs-mirror (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:35.383 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-16T02:27:35.412 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-16T02:27:35.518 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-16T02:27:35.599 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-16T02:27:35.599 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-16T02:27:35.766 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-16T02:27:35.789 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-16T02:27:35.832 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-16T02:27:35.915 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-16T02:27:36.067 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-16T02:27:36.080 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-16T02:27:36.099 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-test (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:36.118 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-16T02:27:36.234 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up radosgw (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:36.387 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libjson-perl. 2023-11-16T02:27:36.408 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-16T02:27:36.453 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-16T02:27:36.527 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package bison. 2023-11-16T02:27:36.599 INFO:teuthology.orchestra.run.smithi204.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139920 files and directories currently installed.) 2023-11-16T02:27:36.602 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-16T02:27:36.646 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-16T02:27:36.715 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-16T02:27:36.737 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-16T02:27:36.755 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-16T02:27:36.755 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-16T02:27:36.781 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-16T02:27:37.089 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-16T02:27:37.104 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-16T02:27:37.148 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-16T02:27:37.236 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-base (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:37.500 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package dump. 2023-11-16T02:27:37.515 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-16T02:27:37.559 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking dump (0.4b47-3) ... 2023-11-16T02:27:37.635 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-16T02:27:37.885 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package indent. 2023-11-16T02:27:37.899 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-16T02:27:37.946 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-16T02:27:38.171 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mds (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:38.173 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-16T02:27:38.189 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-16T02:27:38.232 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-16T02:27:38.409 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-16T02:27:38.409 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-16T02:27:38.525 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-16T02:27:38.547 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-16T02:27:38.593 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-16T02:27:38.594 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-16T02:27:38.610 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-16T02:27:38.652 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-16T02:27:38.886 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-16T02:27:38.908 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-16T02:27:38.915 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:38.930 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-16T02:27:38.945 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-16T02:27:38.969 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-16T02:27:38.988 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-16T02:27:39.148 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-16T02:27:39.148 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-16T02:27:39.305 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-16T02:27:39.325 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-16T02:27:39.327 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-16T02:27:39.341 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-16T02:27:39.372 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-16T02:27:39.419 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-16T02:27:39.666 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-osd (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:39.728 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-16T02:27:39.744 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-16T02:27:39.791 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-16T02:27:39.812 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-16T02:27:39.814 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-16T02:27:39.908 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-16T02:27:40.020 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-16T02:27:40.020 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-16T02:27:40.056 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libjson-perl. 2023-11-16T02:27:40.072 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-16T02:27:40.106 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-16T02:27:40.434 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-16T02:27:40.450 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-16T02:27:40.462 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-16T02:27:40.484 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-16T02:27:40.492 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-16T02:27:40.526 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr-k8sevents (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:40.529 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-16T02:27:40.677 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr-diskprediction-local (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:40.854 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mon (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:40.857 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-16T02:27:40.878 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-16T02:27:40.923 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-16T02:27:41.091 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-16T02:27:41.092 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-16T02:27:41.292 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-16T02:27:41.314 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-16T02:27:41.359 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-16T02:27:41.630 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr-cephadm (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:41.682 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-16T02:27:41.700 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-16T02:27:41.745 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-16T02:27:41.806 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:41.879 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-16T02:27:41.894 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-16T02:27:41.937 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-16T02:27:41.971 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr-dashboard (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:42.014 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-16T02:27:42.035 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-16T02:27:42.080 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-16T02:27:42.133 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-volume (18.2.0-1240-gcb2179ff-1jammy) ... 2023-11-16T02:27:42.224 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-16T02:27:42.239 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-16T02:27:42.273 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-16T02:27:42.498 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-16T02:27:42.600 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-16T02:27:42.601 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-16T02:27:42.616 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-16T02:27:42.621 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-16T02:27:42.651 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-16T02:27:42.667 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-16T02:27:43.012 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-16T02:27:43.028 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-16T02:27:43.036 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package modemmanager. 2023-11-16T02:27:43.058 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-16T02:27:43.070 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-16T02:27:43.103 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-16T02:27:43.398 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-16T02:27:43.413 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-16T02:27:43.481 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-16T02:27:43.596 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-16T02:27:43.778 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package network-manager. 2023-11-16T02:27:43.793 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-16T02:27:43.799 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-16T02:27:43.808 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-16T02:27:43.850 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-16T02:27:43.851 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-16T02:27:44.125 INFO:teuthology.orchestra.run.smithi028.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-16T02:27:44.128 DEBUG:teuthology.orchestra.run.smithi028:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-16T02:27:44.185 INFO:teuthology.orchestra.run.smithi028.stdout:Reading package lists... 2023-11-16T02:27:44.187 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-16T02:27:44.203 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-16T02:27:44.245 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-16T02:27:44.376 INFO:teuthology.orchestra.run.smithi028.stdout:Building dependency tree... 2023-11-16T02:27:44.377 INFO:teuthology.orchestra.run.smithi028.stdout:Reading state information... 2023-11-16T02:27:44.546 INFO:teuthology.orchestra.run.smithi028.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-16T02:27:44.547 INFO:teuthology.orchestra.run.smithi028.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-16T02:27:44.547 INFO:teuthology.orchestra.run.smithi028.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-16T02:27:44.547 INFO:teuthology.orchestra.run.smithi028.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-16T02:27:44.547 INFO:teuthology.orchestra.run.smithi028.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-16T02:27:44.547 INFO:teuthology.orchestra.run.smithi028.stdout:The following packages were automatically installed and are no longer required: 2023-11-16T02:27:44.547 INFO:teuthology.orchestra.run.smithi028.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-16T02:27:44.547 INFO:teuthology.orchestra.run.smithi028.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-16T02:27:44.548 INFO:teuthology.orchestra.run.smithi028.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-16T02:27:44.548 INFO:teuthology.orchestra.run.smithi028.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-11-16T02:27:44.548 INFO:teuthology.orchestra.run.smithi028.stdout: python2.7-minimal 2023-11-16T02:27:44.548 INFO:teuthology.orchestra.run.smithi028.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-16T02:27:44.548 INFO:teuthology.orchestra.run.smithi028.stdout:The following additional packages will be installed: 2023-11-16T02:27:44.548 INFO:teuthology.orchestra.run.smithi028.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-16T02:27:44.548 INFO:teuthology.orchestra.run.smithi028.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-16T02:27:44.549 INFO:teuthology.orchestra.run.smithi028.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-16T02:27:44.549 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-16T02:27:44.549 INFO:teuthology.orchestra.run.smithi028.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-16T02:27:44.550 INFO:teuthology.orchestra.run.smithi028.stdout:Suggested packages: 2023-11-16T02:27:44.550 INFO:teuthology.orchestra.run.smithi028.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-16T02:27:44.550 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-16T02:27:44.550 INFO:teuthology.orchestra.run.smithi028.stdout: libengine-pkcs11-openssl 2023-11-16T02:27:44.558 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ppp. 2023-11-16T02:27:44.579 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-16T02:27:44.586 INFO:teuthology.orchestra.run.smithi028.stdout:The following NEW packages will be installed: 2023-11-16T02:27:44.587 INFO:teuthology.orchestra.run.smithi028.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-16T02:27:44.587 INFO:teuthology.orchestra.run.smithi028.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-16T02:27:44.588 INFO:teuthology.orchestra.run.smithi028.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-16T02:27:44.588 INFO:teuthology.orchestra.run.smithi028.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-16T02:27:44.588 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-16T02:27:44.588 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-16T02:27:44.588 INFO:teuthology.orchestra.run.smithi028.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-16T02:27:44.588 INFO:teuthology.orchestra.run.smithi028.stdout:The following packages will be upgraded: 2023-11-16T02:27:44.589 INFO:teuthology.orchestra.run.smithi028.stdout: libssl3 2023-11-16T02:27:44.632 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-16T02:27:44.647 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-16T02:27:44.690 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-16T02:27:44.770 INFO:teuthology.orchestra.run.smithi028.stdout:1 upgraded, 39 newly installed, 0 to remove and 262 not upgraded. 2023-11-16T02:27:44.770 INFO:teuthology.orchestra.run.smithi028.stdout:Need to get 54.6 MB of archives. 2023-11-16T02:27:44.770 INFO:teuthology.orchestra.run.smithi028.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-16T02:27:44.770 INFO:teuthology.orchestra.run.smithi028.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-16T02:27:44.854 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-16T02:27:44.984 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-16T02:27:45.000 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-16T02:27:45.042 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-16T02:27:45.162 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package pptp-linux. 2023-11-16T02:27:45.175 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-16T02:27:45.211 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-16T02:27:45.247 INFO:teuthology.orchestra.run.smithi028.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-16T02:27:45.504 INFO:teuthology.orchestra.run.smithi028.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-16T02:27:45.538 INFO:teuthology.orchestra.run.smithi028.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-16T02:27:45.540 INFO:teuthology.orchestra.run.smithi028.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-16T02:27:45.545 INFO:teuthology.orchestra.run.smithi028.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-16T02:27:45.546 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-16T02:27:45.549 INFO:teuthology.orchestra.run.smithi028.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-16T02:27:45.550 INFO:teuthology.orchestra.run.smithi028.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-16T02:27:45.553 INFO:teuthology.orchestra.run.smithi028.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-16T02:27:45.557 INFO:teuthology.orchestra.run.smithi028.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-16T02:27:45.560 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-16T02:27:45.604 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-16T02:27:45.605 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-16T02:27:45.626 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-16T02:27:45.673 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-16T02:27:45.723 INFO:teuthology.orchestra.run.smithi028.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-16T02:27:45.723 INFO:teuthology.orchestra.run.smithi028.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-16T02:27:45.970 INFO:teuthology.orchestra.run.smithi028.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-16T02:27:45.974 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package modemmanager. 2023-11-16T02:27:45.989 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-16T02:27:46.032 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-16T02:27:46.043 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-16T02:27:46.065 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-16T02:27:46.118 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking postgresql-client-common (238) ... 2023-11-16T02:27:46.489 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-16T02:27:46.510 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-16T02:27:46.563 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-16T02:27:46.680 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package network-manager. 2023-11-16T02:27:46.696 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-16T02:27:46.747 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-16T02:27:47.130 INFO:teuthology.orchestra.run.smithi028.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-16T02:27:47.134 INFO:teuthology.orchestra.run.smithi028.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-16T02:27:47.135 INFO:teuthology.orchestra.run.smithi028.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-16T02:27:47.141 INFO:teuthology.orchestra.run.smithi028.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-16T02:27:47.142 INFO:teuthology.orchestra.run.smithi028.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-16T02:27:47.152 INFO:teuthology.orchestra.run.smithi028.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-16T02:27:47.156 INFO:teuthology.orchestra.run.smithi028.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-16T02:27:47.159 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package postgresql-common. 2023-11-16T02:27:47.173 INFO:teuthology.orchestra.run.smithi028.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-16T02:27:47.181 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-16T02:27:47.244 INFO:teuthology.orchestra.run.smithi070.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-16T02:27:47.282 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking postgresql-common (238) ... 2023-11-16T02:27:47.337 INFO:teuthology.orchestra.run.smithi028.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-16T02:27:47.388 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ppp. 2023-11-16T02:27:47.406 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-16T02:27:47.717 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package postgresql-14. 2023-11-16T02:27:47.739 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-16T02:27:47.752 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-16T02:27:47.778 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-16T02:27:48.061 INFO:teuthology.orchestra.run.smithi028.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-16T02:27:48.062 INFO:teuthology.orchestra.run.smithi028.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-16T02:27:48.089 INFO:teuthology.orchestra.run.smithi028.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-16T02:27:48.092 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package pptp-linux. 2023-11-16T02:27:48.107 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-16T02:27:48.151 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-16T02:27:48.165 INFO:teuthology.orchestra.run.smithi028.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-16T02:27:48.174 INFO:teuthology.orchestra.run.smithi028.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-16T02:27:48.175 INFO:teuthology.orchestra.run.smithi028.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-16T02:27:48.177 INFO:teuthology.orchestra.run.smithi028.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-16T02:27:48.178 INFO:teuthology.orchestra.run.smithi028.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-16T02:27:48.203 INFO:teuthology.orchestra.run.smithi028.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-16T02:27:48.206 INFO:teuthology.orchestra.run.smithi028.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-16T02:27:48.437 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-16T02:27:48.451 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-16T02:27:48.486 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-16T02:27:48.815 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-16T02:27:48.830 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-16T02:27:48.870 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking postgresql-client-common (238) ... 2023-11-16T02:27:48.916 INFO:teuthology.orchestra.run.smithi028.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-16T02:27:48.998 INFO:teuthology.orchestra.run.smithi028.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-16T02:27:48.999 INFO:teuthology.orchestra.run.smithi028.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-16T02:27:48.999 INFO:teuthology.orchestra.run.smithi028.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-16T02:27:49.069 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package postgresql. 2023-11-16T02:27:49.082 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-16T02:27:49.088 INFO:teuthology.orchestra.run.smithi028.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-16T02:27:49.094 INFO:teuthology.orchestra.run.smithi028.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-16T02:27:49.119 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking postgresql (14+238) ... 2023-11-16T02:27:49.152 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-16T02:27:49.167 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-16T02:27:49.235 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-16T02:27:49.364 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package postgresql-client. 2023-11-16T02:27:49.385 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-16T02:27:49.430 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking postgresql-client (14+238) ... 2023-11-16T02:27:49.550 INFO:teuthology.orchestra.run.smithi028.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-16T02:27:49.552 INFO:teuthology.orchestra.run.smithi028.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-16T02:27:49.674 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-16T02:27:49.696 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-16T02:27:49.740 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-16T02:27:49.981 INFO:teuthology.orchestra.run.smithi028.stdout:Preconfiguring packages ... 2023-11-16T02:27:50.000 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package postgresql-common. 2023-11-16T02:27:50.016 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-16T02:27:50.060 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package tcl8.6. 2023-11-16T02:27:50.075 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-16T02:27:50.076 INFO:teuthology.orchestra.run.smithi204.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-16T02:27:50.107 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking postgresql-common (238) ... 2023-11-16T02:27:50.126 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-16T02:27:50.141 INFO:teuthology.orchestra.run.smithi028.stdout:Fetched 54.6 MB in 5s (11.0 MB/s) 2023-11-16T02:27:50.246 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package flex. 2023-11-16T02:27:50.329 INFO:teuthology.orchestra.run.smithi028.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137421 files and directories currently installed.) 2023-11-16T02:27:50.333 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-16T02:27:50.370 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-16T02:27:50.583 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package postgresql-14. 2023-11-16T02:27:50.599 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-16T02:27:50.614 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package tcl. 2023-11-16T02:27:50.637 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-16T02:27:50.644 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-16T02:27:50.844 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-16T02:27:50.989 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-16T02:27:51.159 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-16T02:27:51.284 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package wpasupplicant. 2023-11-16T02:27:51.307 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-16T02:27:51.351 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-16T02:27:51.600 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-16T02:27:51.716 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-16T02:27:51.738 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-16T02:27:51.782 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-16T02:27:51.853 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package postgresql. 2023-11-16T02:27:51.868 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-16T02:27:51.928 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking postgresql (14+238) ... 2023-11-16T02:27:52.111 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package bison. 2023-11-16T02:27:52.127 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-16T02:27:52.149 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-16T02:27:52.172 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package postgresql-client. 2023-11-16T02:27:52.186 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-16T02:27:52.202 INFO:teuthology.orchestra.run.smithi028.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137494 files and directories currently installed.) 2023-11-16T02:27:52.203 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-16T02:27:52.207 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-16T02:27:52.231 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking postgresql-client (14+238) ... 2023-11-16T02:27:52.255 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-16T02:27:52.496 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up postgresql-client-common (238) ... 2023-11-16T02:27:52.508 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-16T02:27:52.522 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-16T02:27:52.566 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-16T02:27:52.697 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-16T02:27:52.719 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-16T02:27:52.742 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-16T02:27:52.763 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-16T02:27:52.893 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-16T02:27:52.910 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package tcl8.6. 2023-11-16T02:27:52.925 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-16T02:27:52.968 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-16T02:27:53.053 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-16T02:27:53.125 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package dump. 2023-11-16T02:27:53.147 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-16T02:27:53.191 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking dump (0.4b47-3) ... 2023-11-16T02:27:53.195 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-16T02:27:53.238 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package tcl. 2023-11-16T02:27:53.254 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-16T02:27:53.301 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-16T02:27:53.347 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-16T02:27:53.498 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-16T02:27:53.570 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package indent. 2023-11-16T02:27:53.584 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-16T02:27:53.620 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-16T02:27:53.649 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package wpasupplicant. 2023-11-16T02:27:53.665 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-16T02:27:53.707 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-16T02:27:53.873 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-16T02:27:53.886 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-16T02:27:53.914 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-16T02:27:54.061 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-16T02:27:54.079 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-16T02:27:54.095 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-16T02:27:54.137 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-16T02:27:54.145 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-16T02:27:54.293 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-16T02:27:54.315 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-16T02:27:54.360 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-16T02:27:54.499 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-16T02:27:54.514 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-16T02:27:54.565 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-16T02:27:54.580 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-16T02:27:54.580 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-16T02:27:54.629 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-16T02:27:54.642 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-16T02:27:54.679 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-16T02:27:55.016 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-16T02:27:55.037 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-16T02:27:55.090 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-16T02:27:55.099 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-16T02:27:55.250 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-16T02:27:55.301 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up postgresql-client-common (238) ... 2023-11-16T02:27:55.362 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-16T02:27:55.384 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-16T02:27:55.401 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-16T02:27:55.428 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-16T02:27:55.523 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-16T02:27:55.552 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-16T02:27:55.649 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-16T02:27:55.681 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libjson-perl. 2023-11-16T02:27:55.694 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-16T02:27:55.695 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-16T02:27:55.731 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-16T02:27:55.791 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-16T02:27:55.829 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-16T02:27:55.892 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-16T02:27:55.986 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-16T02:27:56.010 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-16T02:27:56.043 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-16T02:27:56.065 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-16T02:27:56.100 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-16T02:27:56.136 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-16T02:27:56.786 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-16T02:27:56.912 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up dump (0.4b47-3) ... 2023-11-16T02:27:57.006 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-16T02:27:57.081 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-16T02:27:57.170 INFO:teuthology.orchestra.run.smithi204.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-16T02:27:57.232 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-16T02:27:57.284 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-16T02:27:57.392 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-16T02:27:57.543 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-16T02:27:57.684 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-16T02:27:57.684 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-16T02:27:57.694 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-16T02:27:57.801 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-16T02:27:57.820 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-16T02:27:57.842 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-16T02:27:57.870 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-16T02:27:57.887 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-16T02:27:58.005 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-16T02:27:58.156 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-16T02:27:58.178 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-16T02:27:58.206 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-16T02:27:58.222 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-16T02:27:58.304 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-16T02:27:58.383 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-16T02:27:58.421 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-16T02:27:58.547 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-16T02:27:58.550 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-16T02:27:58.660 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-16T02:27:58.681 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-16T02:27:58.707 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-16T02:27:58.717 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-16T02:27:58.752 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up postgresql-client (14+238) ... 2023-11-16T02:27:58.833 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-16T02:27:58.904 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-16T02:27:59.017 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-16T02:27:59.062 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-16T02:27:59.084 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-16T02:27:59.129 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-16T02:27:59.168 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-16T02:27:59.441 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:27:59.442 INFO:teuthology.orchestra.run.smithi070.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-16T02:27:59.442 INFO:teuthology.orchestra.run.smithi070.stdout:which means they are currently configured by ifupdown: 2023-11-16T02:27:59.442 INFO:teuthology.orchestra.run.smithi070.stdout:- enp3s0f1 2023-11-16T02:27:59.442 INFO:teuthology.orchestra.run.smithi070.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-16T02:27:59.442 INFO:teuthology.orchestra.run.smithi070.stdout:remove their configuration from /etc/network/interfaces. 2023-11-16T02:27:59.442 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:27:59.481 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-16T02:27:59.504 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-16T02:27:59.548 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-16T02:27:59.559 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-16T02:27:59.857 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-16T02:27:59.892 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-16T02:27:59.915 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-16T02:27:59.955 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-16T02:27:59.959 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-16T02:27:59.975 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up dump (0.4b47-3) ... 2023-11-16T02:28:00.086 INFO:teuthology.orchestra.run.smithi204.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-16T02:28:00.152 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-16T02:28:00.278 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-16T02:28:00.312 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-16T02:28:00.314 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-16T02:28:00.335 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-16T02:28:00.378 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-16T02:28:00.404 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-16T02:28:00.564 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-16T02:28:00.673 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-16T02:28:00.686 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-16T02:28:00.689 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-16T02:28:00.722 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-16T02:28:00.780 INFO:teuthology.orchestra.run.smithi204.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-16T02:28:00.849 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-16T02:28:00.906 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-16T02:28:00.950 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-16T02:28:00.967 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-16T02:28:00.980 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-16T02:28:01.016 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-16T02:28:01.074 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-16T02:28:01.143 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-16T02:28:01.269 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-16T02:28:01.404 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-16T02:28:01.598 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up postgresql-client (14+238) ... 2023-11-16T02:28:01.655 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-16T02:28:01.676 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-16T02:28:01.723 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-16T02:28:01.729 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-16T02:28:01.767 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-16T02:28:01.919 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up postgresql-common (238) ... 2023-11-16T02:28:02.182 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package modemmanager. 2023-11-16T02:28:02.204 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-16T02:28:02.257 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-16T02:28:02.291 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:02.291 INFO:teuthology.orchestra.run.smithi204.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-16T02:28:02.291 INFO:teuthology.orchestra.run.smithi204.stdout:which means they are currently configured by ifupdown: 2023-11-16T02:28:02.291 INFO:teuthology.orchestra.run.smithi204.stdout:- enp3s0f1 2023-11-16T02:28:02.291 INFO:teuthology.orchestra.run.smithi204.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-16T02:28:02.292 INFO:teuthology.orchestra.run.smithi204.stdout:remove their configuration from /etc/network/interfaces. 2023-11-16T02:28:02.292 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:02.424 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-16T02:28:02.788 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-16T02:28:02.924 INFO:teuthology.orchestra.run.smithi070.stdout:Adding user postgres to group ssl-cert 2023-11-16T02:28:03.029 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package network-manager. 2023-11-16T02:28:03.052 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-16T02:28:03.112 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-16T02:28:03.113 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:03.113 INFO:teuthology.orchestra.run.smithi070.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-16T02:28:03.154 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-16T02:28:03.322 INFO:teuthology.orchestra.run.smithi070.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-16T02:28:03.322 INFO:teuthology.orchestra.run.smithi070.stdout:Removing obsolete dictionary files: 2023-11-16T02:28:03.809 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-16T02:28:03.930 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ppp. 2023-11-16T02:28:03.934 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-16T02:28:03.953 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-16T02:28:03.977 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-16T02:28:04.086 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-16T02:28:04.213 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up postgresql-common (238) ... 2023-11-16T02:28:04.260 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-16T02:28:04.380 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-16T02:28:04.568 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package pptp-linux. 2023-11-16T02:28:04.581 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-16T02:28:04.627 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-16T02:28:04.718 INFO:teuthology.orchestra.run.smithi070.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-16T02:28:04.734 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-16T02:28:04.778 INFO:teuthology.orchestra.run.smithi070.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-16T02:28:04.778 INFO:teuthology.orchestra.run.smithi070.stdout:This user must also own the server process. 2023-11-16T02:28:04.778 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:04.779 INFO:teuthology.orchestra.run.smithi070.stdout:The database cluster will be initialized with locale "en_US". 2023-11-16T02:28:04.779 INFO:teuthology.orchestra.run.smithi070.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-16T02:28:04.779 INFO:teuthology.orchestra.run.smithi070.stdout:The default text search configuration will be set to "english". 2023-11-16T02:28:04.779 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:04.779 INFO:teuthology.orchestra.run.smithi070.stdout:Data page checksums are disabled. 2023-11-16T02:28:04.779 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:04.779 INFO:teuthology.orchestra.run.smithi070.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-16T02:28:04.779 INFO:teuthology.orchestra.run.smithi070.stdout:creating subdirectories ... ok 2023-11-16T02:28:04.779 INFO:teuthology.orchestra.run.smithi070.stdout:selecting dynamic shared memory implementation ... posix 2023-11-16T02:28:04.793 INFO:teuthology.orchestra.run.smithi070.stdout:selecting default max_connections ... 100 2023-11-16T02:28:04.810 INFO:teuthology.orchestra.run.smithi070.stdout:selecting default shared_buffers ... 128MB 2023-11-16T02:28:04.820 INFO:teuthology.orchestra.run.smithi070.stdout:selecting default time zone ... Etc/UTC 2023-11-16T02:28:04.821 INFO:teuthology.orchestra.run.smithi070.stdout:creating configuration files ... ok 2023-11-16T02:28:04.904 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-16T02:28:04.917 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-16T02:28:04.930 INFO:teuthology.orchestra.run.smithi070.stdout:running bootstrap script ... ok 2023-11-16T02:28:04.954 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-16T02:28:05.148 INFO:teuthology.orchestra.run.smithi204.stdout:Adding user postgres to group ssl-cert 2023-11-16T02:28:05.257 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-16T02:28:05.279 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-16T02:28:05.323 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-client-common (238) ... 2023-11-16T02:28:05.397 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:05.397 INFO:teuthology.orchestra.run.smithi204.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-16T02:28:05.521 INFO:teuthology.orchestra.run.smithi070.stdout:performing post-bootstrap initialization ... ok 2023-11-16T02:28:05.644 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-16T02:28:05.648 INFO:teuthology.orchestra.run.smithi204.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-16T02:28:05.648 INFO:teuthology.orchestra.run.smithi204.stdout:Removing obsolete dictionary files: 2023-11-16T02:28:05.666 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-16T02:28:05.710 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-16T02:28:06.349 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-common. 2023-11-16T02:28:06.371 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-16T02:28:06.377 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-16T02:28:06.458 INFO:teuthology.orchestra.run.smithi028.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-16T02:28:06.489 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-common (238) ... 2023-11-16T02:28:06.573 INFO:teuthology.orchestra.run.smithi070.stdout:syncing data to disk ... ok 2023-11-16T02:28:06.873 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-16T02:28:06.948 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-14. 2023-11-16T02:28:06.970 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-16T02:28:06.991 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-16T02:28:07.009 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-16T02:28:07.270 INFO:teuthology.orchestra.run.smithi204.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-16T02:28:07.290 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-16T02:28:07.340 INFO:teuthology.orchestra.run.smithi204.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-16T02:28:07.340 INFO:teuthology.orchestra.run.smithi204.stdout:This user must also own the server process. 2023-11-16T02:28:07.340 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:07.340 INFO:teuthology.orchestra.run.smithi204.stdout:The database cluster will be initialized with locale "en_US". 2023-11-16T02:28:07.340 INFO:teuthology.orchestra.run.smithi204.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-16T02:28:07.340 INFO:teuthology.orchestra.run.smithi204.stdout:The default text search configuration will be set to "english". 2023-11-16T02:28:07.341 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:07.341 INFO:teuthology.orchestra.run.smithi204.stdout:Data page checksums are disabled. 2023-11-16T02:28:07.341 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:07.341 INFO:teuthology.orchestra.run.smithi204.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-16T02:28:07.341 INFO:teuthology.orchestra.run.smithi204.stdout:creating subdirectories ... ok 2023-11-16T02:28:07.342 INFO:teuthology.orchestra.run.smithi204.stdout:selecting dynamic shared memory implementation ... posix 2023-11-16T02:28:07.365 INFO:teuthology.orchestra.run.smithi204.stdout:selecting default max_connections ... 100 2023-11-16T02:28:07.400 INFO:teuthology.orchestra.run.smithi204.stdout:selecting default shared_buffers ... 128MB 2023-11-16T02:28:07.414 INFO:teuthology.orchestra.run.smithi204.stdout:selecting default time zone ... Etc/UTC 2023-11-16T02:28:07.415 INFO:teuthology.orchestra.run.smithi204.stdout:creating configuration files ... ok 2023-11-16T02:28:07.586 INFO:teuthology.orchestra.run.smithi204.stdout:running bootstrap script ... ok 2023-11-16T02:28:08.234 INFO:teuthology.orchestra.run.smithi204.stdout:performing post-bootstrap initialization ... ok 2023-11-16T02:28:08.501 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql. 2023-11-16T02:28:08.524 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-16T02:28:08.567 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql (14+238) ... 2023-11-16T02:28:08.820 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-client. 2023-11-16T02:28:08.833 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-16T02:28:08.874 INFO:teuthology.orchestra.run.smithi204.stdout:syncing data to disk ... ok 2023-11-16T02:28:08.977 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-client (14+238) ... 2023-11-16T02:28:09.381 INFO:teuthology.orchestra.run.smithi204.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-16T02:28:09.630 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-16T02:28:09.644 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-16T02:28:09.680 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-16T02:28:09.820 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-16T02:28:09.971 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-16T02:28:10.000 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package tcl8.6. 2023-11-16T02:28:10.022 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-16T02:28:10.074 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-16T02:28:10.122 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up postgresql (14+238) ... 2023-11-16T02:28:10.273 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-16T02:28:10.361 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package tcl. 2023-11-16T02:28:10.383 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-16T02:28:10.424 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-16T02:28:10.432 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-16T02:28:10.711 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-16T02:28:10.711 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-16T02:28:10.723 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package wpasupplicant. 2023-11-16T02:28:10.745 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-16T02:28:10.788 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-16T02:28:11.168 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-16T02:28:11.190 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-16T02:28:11.235 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-16T02:28:11.352 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-16T02:28:11.621 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-16T02:28:11.644 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-16T02:28:11.671 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-16T02:28:11.696 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-16T02:28:11.839 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-16T02:28:12.006 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-client-common (238) ... 2023-11-16T02:28:12.218 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-16T02:28:12.353 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-16T02:28:12.479 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-16T02:28:12.623 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-16T02:28:12.682 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-16T02:28:12.765 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-16T02:28:12.799 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-16T02:28:12.890 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-16T02:28:12.900 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up postgresql (14+238) ... 2023-11-16T02:28:13.026 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-16T02:28:13.194 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-16T02:28:13.343 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-16T02:28:13.418 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-16T02:28:13.460 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-16T02:28:13.472 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-16T02:28:13.472 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-16T02:28:13.530 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-16T02:28:13.864 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-16T02:28:13.864 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-16T02:28:14.137 INFO:teuthology.orchestra.run.smithi070.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-16T02:28:14.140 DEBUG:teuthology.parallel:result is None 2023-11-16T02:28:14.182 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-16T02:28:14.424 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-16T02:28:14.642 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-16T02:28:14.810 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-16T02:28:14.892 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-16T02:28:15.144 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-16T02:28:15.295 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-16T02:28:15.421 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-16T02:28:15.546 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-16T02:28:15.672 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-16T02:28:16.188 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-16T02:28:16.288 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-16T02:28:16.497 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-16T02:28:16.621 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up dump (0.4b47-3) ... 2023-11-16T02:28:16.714 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-16T02:28:16.772 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-16T02:28:16.898 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-16T02:28:16.984 INFO:teuthology.orchestra.run.smithi204.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-16T02:28:16.988 DEBUG:teuthology.parallel:result is None 2023-11-16T02:28:17.049 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-16T02:28:17.175 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-16T02:28:17.284 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-16T02:28:17.367 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-16T02:28:17.428 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-16T02:28:17.546 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-16T02:28:17.739 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-16T02:28:17.881 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-16T02:28:18.007 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-16T02:28:18.175 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-client (14+238) ... 2023-11-16T02:28:18.284 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-16T02:28:18.791 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:18.791 INFO:teuthology.orchestra.run.smithi028.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-16T02:28:18.791 INFO:teuthology.orchestra.run.smithi028.stdout:which means they are currently configured by ifupdown: 2023-11-16T02:28:18.791 INFO:teuthology.orchestra.run.smithi028.stdout:- ens1f0 2023-11-16T02:28:18.791 INFO:teuthology.orchestra.run.smithi028.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-16T02:28:18.791 INFO:teuthology.orchestra.run.smithi028.stdout:remove their configuration from /etc/network/interfaces. 2023-11-16T02:28:18.791 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:18.918 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-16T02:28:19.268 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-16T02:28:19.618 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-16T02:28:20.154 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-16T02:28:20.298 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-16T02:28:20.423 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-16T02:28:20.574 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-common (238) ... 2023-11-16T02:28:21.556 INFO:teuthology.orchestra.run.smithi028.stdout:Adding user postgres to group ssl-cert 2023-11-16T02:28:21.746 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:21.746 INFO:teuthology.orchestra.run.smithi028.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-16T02:28:21.930 INFO:teuthology.orchestra.run.smithi028.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-16T02:28:21.930 INFO:teuthology.orchestra.run.smithi028.stdout:Removing obsolete dictionary files: 2023-11-16T02:28:22.514 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-16T02:28:22.893 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-16T02:28:23.217 INFO:teuthology.orchestra.run.smithi028.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-16T02:28:23.229 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-16T02:28:23.346 INFO:teuthology.orchestra.run.smithi028.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-16T02:28:23.346 INFO:teuthology.orchestra.run.smithi028.stdout:This user must also own the server process. 2023-11-16T02:28:23.346 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:23.346 INFO:teuthology.orchestra.run.smithi028.stdout:The database cluster will be initialized with locale "en_US". 2023-11-16T02:28:23.347 INFO:teuthology.orchestra.run.smithi028.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-16T02:28:23.347 INFO:teuthology.orchestra.run.smithi028.stdout:The default text search configuration will be set to "english". 2023-11-16T02:28:23.347 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:23.347 INFO:teuthology.orchestra.run.smithi028.stdout:Data page checksums are disabled. 2023-11-16T02:28:23.347 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:23.347 INFO:teuthology.orchestra.run.smithi028.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-16T02:28:23.347 INFO:teuthology.orchestra.run.smithi028.stdout:creating subdirectories ... ok 2023-11-16T02:28:23.347 INFO:teuthology.orchestra.run.smithi028.stdout:selecting dynamic shared memory implementation ... posix 2023-11-16T02:28:23.363 INFO:teuthology.orchestra.run.smithi028.stdout:selecting default max_connections ... 100 2023-11-16T02:28:23.385 INFO:teuthology.orchestra.run.smithi028.stdout:selecting default shared_buffers ... 128MB 2023-11-16T02:28:23.397 INFO:teuthology.orchestra.run.smithi028.stdout:selecting default time zone ... Etc/UTC 2023-11-16T02:28:23.398 INFO:teuthology.orchestra.run.smithi028.stdout:creating configuration files ... ok 2023-11-16T02:28:23.523 INFO:teuthology.orchestra.run.smithi028.stdout:running bootstrap script ... ok 2023-11-16T02:28:24.881 INFO:teuthology.orchestra.run.smithi028.stdout:performing post-bootstrap initialization ... ok 2023-11-16T02:28:25.649 INFO:teuthology.orchestra.run.smithi028.stdout:syncing data to disk ... ok 2023-11-16T02:28:26.062 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-16T02:28:28.946 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-16T02:28:29.072 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-16T02:28:29.198 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql (14+238) ... 2023-11-16T02:28:29.349 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-16T02:28:29.475 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-16T02:28:29.743 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-16T02:28:29.743 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-16T02:28:30.328 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-16T02:28:30.680 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-16T02:28:30.840 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-16T02:28:31.950 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-16T02:28:32.050 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-16T02:28:32.676 INFO:teuthology.orchestra.run.smithi028.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-16T02:28:32.679 DEBUG:teuthology.parallel:result is None 2023-11-16T02:28:32.679 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cb2179fff8710af9ff3936b02b8bc8cd99900af3 2023-11-16T02:28:32.823 DEBUG:teuthology.orchestra.run.smithi028:> dpkg-query -W -f '${Version}' ceph 2023-11-16T02:28:32.843 INFO:teuthology.orchestra.run.smithi028.stdout:18.2.0-1240-gcb2179ff-1jammy 2023-11-16T02:28:32.843 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1240-gcb2179ff-1jammy 2023-11-16T02:28:32.844 INFO:teuthology.task.install:The correct ceph version 18.2.0-1240-gcb2179ff-1jammy is installed. 2023-11-16T02:28:32.844 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cb2179fff8710af9ff3936b02b8bc8cd99900af3 2023-11-16T02:28:33.057 DEBUG:teuthology.orchestra.run.smithi070:> dpkg-query -W -f '${Version}' ceph 2023-11-16T02:28:33.076 INFO:teuthology.orchestra.run.smithi070.stdout:18.2.0-1240-gcb2179ff-1jammy 2023-11-16T02:28:33.077 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1240-gcb2179ff-1jammy 2023-11-16T02:28:33.077 INFO:teuthology.task.install:The correct ceph version 18.2.0-1240-gcb2179ff-1jammy is installed. 2023-11-16T02:28:33.077 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cb2179fff8710af9ff3936b02b8bc8cd99900af3 2023-11-16T02:28:33.213 DEBUG:teuthology.orchestra.run.smithi204:> dpkg-query -W -f '${Version}' ceph 2023-11-16T02:28:33.237 INFO:teuthology.orchestra.run.smithi204.stdout:18.2.0-1240-gcb2179ff-1jammy 2023-11-16T02:28:33.237 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1240-gcb2179ff-1jammy 2023-11-16T02:28:33.237 INFO:teuthology.task.install:The correct ceph version 18.2.0-1240-gcb2179ff-1jammy is installed. 2023-11-16T02:28:33.238 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-16T02:28:33.238 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-16T02:28:33.238 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-16T02:28:33.253 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-16T02:28:33.253 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-16T02:28:33.268 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-16T02:28:33.268 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-16T02:28:33.307 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-16T02:28:33.308 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-16T02:28:33.308 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/daemon-helper 2023-11-16T02:28:33.321 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-16T02:28:33.380 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-16T02:28:33.380 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/daemon-helper 2023-11-16T02:28:33.395 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-16T02:28:33.450 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-16T02:28:33.450 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/daemon-helper 2023-11-16T02:28:33.472 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-16T02:28:33.538 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-16T02:28:33.538 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-16T02:28:33.538 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-16T02:28:33.553 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-16T02:28:33.609 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-16T02:28:33.609 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-16T02:28:33.623 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-16T02:28:33.678 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-16T02:28:33.678 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-16T02:28:33.700 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-16T02:28:33.762 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-16T02:28:33.763 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-16T02:28:33.763 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/stdin-killer 2023-11-16T02:28:33.777 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-16T02:28:33.833 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-16T02:28:33.833 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/stdin-killer 2023-11-16T02:28:33.847 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-16T02:28:33.902 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-16T02:28:33.902 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/stdin-killer 2023-11-16T02:28:33.925 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-16T02:28:33.994 INFO:teuthology.run_tasks:Running task ceph... 2023-11-16T02:28:34.057 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-16T02:28:34.057 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 777 /var/log/ceph 2023-11-16T02:28:34.060 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 777 /var/log/ceph 2023-11-16T02:28:34.062 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 777 /var/log/ceph 2023-11-16T02:28:34.085 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-16T02:28:34.085 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-16T02:28:34.114 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-16T02:28:34.118 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-16T02:28:34.155 INFO:tasks.ceph:Creating extra log directories... 2023-11-16T02:28:34.155 DEBUG:teuthology.orchestra.run.smithi028:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-16T02:28:34.170 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-16T02:28:34.173 DEBUG:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-16T02:28:34.225 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-16T02:28:34.226 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-16T02:28:34.226 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-16T02:28:34.226 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-16T02:28:34.226 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-16T02:28:34.232 DEBUG:teuthology.orchestra.run.smithi028:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-16T02:28:34.307 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-16T02:28:34.307 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-16T02:28:34.312 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-16T02:28:34.386 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-16T02:28:34.386 DEBUG:teuthology.orchestra.run.smithi204:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-16T02:28:34.395 DEBUG:teuthology.orchestra.run.smithi204:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-16T02:28:34.493 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-16T02:28:34.493 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-16T02:28:34.493 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-11-15_23:07:34-fs-wip-yuri-testing-2023-11-14-0743-reef-distro-default-smithi/7459949', 'branch': 'wip-yuri-testing-2023-11-14-0743-reef', 'description': 'fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7459949', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-11-15_23:07:34-fs-wip-yuri-testing-2023-11-14-0743-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-11-14-0743-reef'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'cb2179fff8710af9ff3936b02b8bc8cd99900af3'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'cb2179fff8710af9ff3936b02b8bc8cd99900af3'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-11-14-0743-reef', 'sha1': 'cb2179fff8710af9ff3936b02b8bc8cd99900af3'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0']], 'seed': 3105, 'sha1': 'cb2179fff8710af9ff3936b02b8bc8cd99900af3', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-11-14-0743-reef', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_cb2179fff8710af9ff3936b02b8bc8cd99900af3/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'cb2179fff8710af9ff3936b02b8bc8cd99900af3', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi028.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOPCTl5rGC0ntQL8s7g6vBSIuOVUO0Apo/2vtzgVKjspwX/XByy+QAJuPIuFpLS1Up2tdfeVOQ/TSE982TadPR0=', 'smithi070.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGpiA81trjG0Gg0d58ydwBrok6P5E1cNPHYyJhG91X9nHUd0zWJrtbv2Rz2GUJ+SraMjWOR0EemoLRj1AnXaI9E=', 'smithi204.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKmIkAxtpvJP9ai86HXRi0rJ+KIQNzeFNcEDdo1u6evxYeDlC8m63Xtq2BNF/kUxiSEg7p38TRMccrz/IH/s3UE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'cb2179fff8710af9ff3936b02b8bc8cd99900af3'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'cb2179fff8710af9ff3936b02b8bc8cd99900af3', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_fscrypt']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '6899cd26fceddb2fec83dc1a1349394b28c8998e', 'timestamp': '2023-11-15_23:07:34', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1224587'} 2023-11-16T02:28:34.494 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-16T02:28:34.497 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-16T02:28:34.500 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-16T02:28:34.510 DEBUG:teuthology.orchestra.run.smithi028:> sudo install -d -m0777 -- /var/run/ceph 2023-11-16T02:28:34.546 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/run/ceph 2023-11-16T02:28:34.549 DEBUG:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/run/ceph 2023-11-16T02:28:34.580 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-16T02:28:34.580 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/scratch_devs of=/dev/stdout 2023-11-16T02:28:34.606 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-16T02:28:34.606 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_1 2023-11-16T02:28:34.654 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-16T02:28:34.654 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-16T02:28:34.654 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 884 Links: 1 2023-11-16T02:28:34.654 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-16T02:28:34.654 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2023-11-16 02:21:33.474520522 +0000 2023-11-16T02:28:34.654 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2023-11-16 02:21:33.470520560 +0000 2023-11-16T02:28:34.654 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2023-11-16 02:21:33.470520560 +0000 2023-11-16T02:28:34.654 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: - 2023-11-16T02:28:34.654 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-16T02:28:34.708 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2023-11-16T02:28:34.708 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2023-11-16T02:28:34.708 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.000338822 s, 1.5 MB/s 2023-11-16T02:28:34.709 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-16T02:28:34.758 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_2 2023-11-16T02:28:34.805 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-16T02:28:34.805 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-16T02:28:34.805 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 901 Links: 1 2023-11-16T02:28:34.805 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-16T02:28:34.806 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2023-11-16 02:21:34.550510136 +0000 2023-11-16T02:28:34.806 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2023-11-16 02:21:34.130514189 +0000 2023-11-16T02:28:34.806 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2023-11-16 02:21:34.130514189 +0000 2023-11-16T02:28:34.806 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: - 2023-11-16T02:28:34.806 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-16T02:28:34.859 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2023-11-16T02:28:34.859 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2023-11-16T02:28:34.860 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.000224271 s, 2.3 MB/s 2023-11-16T02:28:34.861 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-16T02:28:34.911 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_3 2023-11-16T02:28:34.959 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-16T02:28:34.959 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-16T02:28:34.959 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 920 Links: 1 2023-11-16T02:28:34.959 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-16T02:28:34.959 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2023-11-16 02:21:35.150504344 +0000 2023-11-16T02:28:34.960 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2023-11-16 02:21:34.782507897 +0000 2023-11-16T02:28:34.960 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2023-11-16 02:21:34.782507897 +0000 2023-11-16T02:28:34.960 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: - 2023-11-16T02:28:34.960 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-16T02:28:35.012 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2023-11-16T02:28:35.012 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2023-11-16T02:28:35.012 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.000351777 s, 1.5 MB/s 2023-11-16T02:28:35.013 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-16T02:28:35.063 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_4 2023-11-16T02:28:35.110 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-16T02:28:35.110 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-16T02:28:35.110 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 930 Links: 1 2023-11-16T02:28:35.110 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-16T02:28:35.110 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2023-11-16 02:21:35.750498555 +0000 2023-11-16T02:28:35.110 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2023-11-16 02:21:35.370502222 +0000 2023-11-16T02:28:35.110 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2023-11-16 02:21:35.370502222 +0000 2023-11-16T02:28:35.110 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: - 2023-11-16T02:28:35.111 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-16T02:28:35.163 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2023-11-16T02:28:35.163 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2023-11-16T02:28:35.163 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.000219119 s, 2.3 MB/s 2023-11-16T02:28:35.164 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-16T02:28:35.215 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-16T02:28:35.215 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-16T02:28:35.215 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/scratch_devs of=/dev/stdout 2023-11-16T02:28:35.221 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-16T02:28:35.221 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_1 2023-11-16T02:28:35.267 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-16T02:28:35.267 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-16T02:28:35.267 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 878 Links: 1 2023-11-16T02:28:35.267 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-16T02:28:35.267 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2023-11-16 02:21:33.820956742 +0000 2023-11-16T02:28:35.268 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2023-11-16 02:21:33.444960100 +0000 2023-11-16T02:28:35.268 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2023-11-16 02:21:33.444960100 +0000 2023-11-16T02:28:35.268 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2023-11-16T02:28:35.268 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-16T02:28:35.321 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-16T02:28:35.321 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-16T02:28:35.321 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000318542 s, 1.6 MB/s 2023-11-16T02:28:35.322 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-16T02:28:35.372 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_2 2023-11-16T02:28:35.420 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-16T02:28:35.420 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-16T02:28:35.421 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 899 Links: 1 2023-11-16T02:28:35.421 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-16T02:28:35.421 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2023-11-16 02:21:34.036954812 +0000 2023-11-16T02:28:35.421 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2023-11-16 02:21:34.032954848 +0000 2023-11-16T02:28:35.421 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2023-11-16 02:21:34.032954848 +0000 2023-11-16T02:28:35.422 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2023-11-16T02:28:35.422 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-16T02:28:35.473 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-16T02:28:35.473 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-16T02:28:35.474 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000303493 s, 1.7 MB/s 2023-11-16T02:28:35.475 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-16T02:28:35.525 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_3 2023-11-16T02:28:35.572 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-16T02:28:35.572 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-16T02:28:35.572 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 915 Links: 1 2023-11-16T02:28:35.572 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-16T02:28:35.572 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2023-11-16 02:21:34.964946524 +0000 2023-11-16T02:28:35.572 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2023-11-16 02:21:34.600949774 +0000 2023-11-16T02:28:35.572 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2023-11-16 02:21:34.600949774 +0000 2023-11-16T02:28:35.572 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2023-11-16T02:28:35.573 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-16T02:28:35.626 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-16T02:28:35.626 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-16T02:28:35.626 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000261285 s, 2.0 MB/s 2023-11-16T02:28:35.627 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-16T02:28:35.675 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_4 2023-11-16T02:28:35.722 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-16T02:28:35.722 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-16T02:28:35.722 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 929 Links: 1 2023-11-16T02:28:35.722 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-16T02:28:35.723 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2023-11-16 02:21:35.616940700 +0000 2023-11-16T02:28:35.723 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2023-11-16 02:21:35.212944309 +0000 2023-11-16T02:28:35.723 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2023-11-16 02:21:35.212944309 +0000 2023-11-16T02:28:35.723 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2023-11-16T02:28:35.723 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-16T02:28:35.779 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2023-11-16T02:28:35.779 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2023-11-16T02:28:35.779 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000207941 s, 2.5 MB/s 2023-11-16T02:28:35.779 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-16T02:28:35.831 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-16T02:28:35.831 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi028.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-16T02:28:35.832 INFO:tasks.ceph:Generating config... 2023-11-16T02:28:35.833 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-16T02:28:35.833 INFO:tasks.ceph:[client] debug client = 20 2023-11-16T02:28:35.834 INFO:tasks.ceph:[client] debug ms = 1 2023-11-16T02:28:35.834 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-16T02:28:35.834 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-16T02:28:35.834 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-11-16T02:28:35.834 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-16T02:28:35.834 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-16T02:28:35.834 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-16T02:28:35.834 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-16T02:28:35.834 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-16T02:28:35.834 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-16T02:28:35.835 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-16T02:28:35.835 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-16T02:28:35.835 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-16T02:28:35.835 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-16T02:28:35.835 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-16T02:28:35.835 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-16T02:28:35.835 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-16T02:28:35.835 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-16T02:28:35.835 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-16T02:28:35.835 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-16T02:28:35.835 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-16T02:28:35.835 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-16T02:28:35.835 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-16T02:28:35.836 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-16T02:28:35.836 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-16T02:28:35.836 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-16T02:28:35.836 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-16T02:28:35.836 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-16T02:28:35.836 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-16T02:28:35.836 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-16T02:28:35.836 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-16T02:28:35.836 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-16T02:28:35.836 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-16T02:28:35.837 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-16T02:28:35.837 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-16T02:28:35.837 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-16T02:28:35.837 INFO:tasks.ceph:Setting up mon.a... 2023-11-16T02:28:35.837 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-16T02:28:35.871 INFO:teuthology.orchestra.run.smithi028.stdout:creating /etc/ceph/ceph.keyring 2023-11-16T02:28:35.893 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-16T02:28:35.971 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-16T02:28:36.024 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.28'), ('mon.b', '172.21.15.70'), ('mon.c', '[v2:172.21.15.70:3301,v1:172.21.15.70:6790]')] 2023-11-16T02:28:36.025 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.28,172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790]', 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-16T02:28:36.025 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-16T02:28:36.026 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-16T02:28:36.073 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.28 --add b 172.21.15.70 --addv c '[v2:172.21.15.70:3301,v1:172.21.15.70:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-16T02:28:36.161 INFO:teuthology.orchestra.run.smithi028.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-16T02:28:36.161 INFO:teuthology.orchestra.run.smithi028.stdout:monmaptool: generated fsid 1325a234-ab9e-4632-9a6e-98afbef8ae76 2023-11-16T02:28:36.161 INFO:teuthology.orchestra.run.smithi028.stdout:setting min_mon_release = pacific 2023-11-16T02:28:36.161 INFO:teuthology.orchestra.run.smithi028.stdout:epoch 0 2023-11-16T02:28:36.161 INFO:teuthology.orchestra.run.smithi028.stdout:fsid 1325a234-ab9e-4632-9a6e-98afbef8ae76 2023-11-16T02:28:36.161 INFO:teuthology.orchestra.run.smithi028.stdout:last_changed 2023-11-16T02:28:36.164888+0000 2023-11-16T02:28:36.162 INFO:teuthology.orchestra.run.smithi028.stdout:created 2023-11-16T02:28:36.164888+0000 2023-11-16T02:28:36.162 INFO:teuthology.orchestra.run.smithi028.stdout:min_mon_release 16 (pacific) 2023-11-16T02:28:36.162 INFO:teuthology.orchestra.run.smithi028.stdout:election_strategy: 1 2023-11-16T02:28:36.162 INFO:teuthology.orchestra.run.smithi028.stdout:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2023-11-16T02:28:36.162 INFO:teuthology.orchestra.run.smithi028.stdout:1: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.b 2023-11-16T02:28:36.162 INFO:teuthology.orchestra.run.smithi028.stdout:2: [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] mon.c 2023-11-16T02:28:36.162 INFO:teuthology.orchestra.run.smithi028.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-16T02:28:36.164 DEBUG:teuthology.orchestra.run.smithi028:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-16T02:28:36.210 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1325a234-ab9e-4632-9a6e-98afbef8ae76... 2023-11-16T02:28:36.211 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-16T02:28:36.255 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-16T02:28:36.257 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-16T02:28:36.283 INFO:teuthology.orchestra.run.smithi028.stdout:[global] 2023-11-16T02:28:36.283 INFO:teuthology.orchestra.run.smithi028.stdout: chdir = "" 2023-11-16T02:28:36.283 INFO:teuthology.orchestra.run.smithi028.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-16T02:28:36.283 INFO:teuthology.orchestra.run.smithi028.stdout: auth supported = cephx 2023-11-16T02:28:36.284 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.284 INFO:teuthology.orchestra.run.smithi028.stdout: filestore xattr use omap = true 2023-11-16T02:28:36.284 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.284 INFO:teuthology.orchestra.run.smithi028.stdout: mon clock drift allowed = 1.000 2023-11-16T02:28:36.284 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.284 INFO:teuthology.orchestra.run.smithi028.stdout: osd crush chooseleaf type = 0 2023-11-16T02:28:36.284 INFO:teuthology.orchestra.run.smithi028.stdout: auth debug = true 2023-11-16T02:28:36.284 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.284 INFO:teuthology.orchestra.run.smithi028.stdout: ms die on old message = true 2023-11-16T02:28:36.284 INFO:teuthology.orchestra.run.smithi028.stdout: ms die on bug = true 2023-11-16T02:28:36.284 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.284 INFO:teuthology.orchestra.run.smithi028.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-16T02:28:36.285 INFO:teuthology.orchestra.run.smithi028.stdout: mon pg warn max object skew = 0 2023-11-16T02:28:36.285 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.285 INFO:teuthology.orchestra.run.smithi028.stdout: # disable pg_autoscaler by default for new pools 2023-11-16T02:28:36.285 INFO:teuthology.orchestra.run.smithi028.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-16T02:28:36.285 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.285 INFO:teuthology.orchestra.run.smithi028.stdout: osd pool default size = 2 2023-11-16T02:28:36.285 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.285 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd allow primary affinity = true 2023-11-16T02:28:36.285 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd allow pg remap = true 2023-11-16T02:28:36.285 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on legacy crush tunables = false 2023-11-16T02:28:36.285 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on crush straw calc version zero = false 2023-11-16T02:28:36.286 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on no sortbitwise = false 2023-11-16T02:28:36.286 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on osd down out interval zero = false 2023-11-16T02:28:36.286 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on too few osds = false 2023-11-16T02:28:36.286 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-16T02:28:36.286 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-16T02:28:36.286 INFO:teuthology.orchestra.run.smithi028.stdout: mon_allow_pool_size_one = true 2023-11-16T02:28:36.286 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.286 INFO:teuthology.orchestra.run.smithi028.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-16T02:28:36.286 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.286 INFO:teuthology.orchestra.run.smithi028.stdout: osd default data pool replay window = 5 2023-11-16T02:28:36.286 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.286 INFO:teuthology.orchestra.run.smithi028.stdout: mon allow pool delete = true 2023-11-16T02:28:36.286 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.287 INFO:teuthology.orchestra.run.smithi028.stdout: mon cluster log file level = debug 2023-11-16T02:28:36.287 INFO:teuthology.orchestra.run.smithi028.stdout: debug asserts on shutdown = true 2023-11-16T02:28:36.287 INFO:teuthology.orchestra.run.smithi028.stdout: mon health detail to clog = false 2023-11-16T02:28:36.287 INFO:teuthology.orchestra.run.smithi028.stdout: mon host = "172.21.15.28,172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790]" 2023-11-16T02:28:36.287 INFO:teuthology.orchestra.run.smithi028.stdout: mon pg warn min per osd = 0 2023-11-16T02:28:36.287 INFO:teuthology.orchestra.run.smithi028.stdout: fsid = 1325a234-ab9e-4632-9a6e-98afbef8ae76 2023-11-16T02:28:36.287 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.287 INFO:teuthology.orchestra.run.smithi028.stdout:[osd] 2023-11-16T02:28:36.287 INFO:teuthology.orchestra.run.smithi028.stdout: osd journal size = 100 2023-11-16T02:28:36.287 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.287 INFO:teuthology.orchestra.run.smithi028.stdout: osd scrub load threshold = 5.0 2023-11-16T02:28:36.287 INFO:teuthology.orchestra.run.smithi028.stdout: osd scrub max interval = 600 2023-11-16T02:28:36.288 INFO:teuthology.orchestra.run.smithi028.stdout: osd mclock profile = high_recovery_ops 2023-11-16T02:28:36.288 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.288 INFO:teuthology.orchestra.run.smithi028.stdout: osd recover clone overlap = true 2023-11-16T02:28:36.288 INFO:teuthology.orchestra.run.smithi028.stdout: osd recovery max chunk = 1048576 2023-11-16T02:28:36.288 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.288 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug shutdown = true 2023-11-16T02:28:36.288 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug op order = true 2023-11-16T02:28:36.288 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug verify stray on activate = true 2023-11-16T02:28:36.288 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.288 INFO:teuthology.orchestra.run.smithi028.stdout: osd open classes on start = true 2023-11-16T02:28:36.288 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug pg log writeout = true 2023-11-16T02:28:36.288 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.288 INFO:teuthology.orchestra.run.smithi028.stdout: osd deep scrub update digest min age = 30 2023-11-16T02:28:36.289 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.289 INFO:teuthology.orchestra.run.smithi028.stdout: osd map max advance = 10 2023-11-16T02:28:36.289 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.289 INFO:teuthology.orchestra.run.smithi028.stdout: journal zero on create = true 2023-11-16T02:28:36.289 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.289 INFO:teuthology.orchestra.run.smithi028.stdout: filestore ondisk finisher threads = 3 2023-11-16T02:28:36.289 INFO:teuthology.orchestra.run.smithi028.stdout: filestore apply finisher threads = 3 2023-11-16T02:28:36.289 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.289 INFO:teuthology.orchestra.run.smithi028.stdout: bdev debug aio = true 2023-11-16T02:28:36.289 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug misdirected ops = true 2023-11-16T02:28:36.289 INFO:teuthology.orchestra.run.smithi028.stdout: bdev async discard = True 2023-11-16T02:28:36.289 INFO:teuthology.orchestra.run.smithi028.stdout: bdev enable discard = True 2023-11-16T02:28:36.290 INFO:teuthology.orchestra.run.smithi028.stdout: bluestore allocator = bitmap 2023-11-16T02:28:36.290 INFO:teuthology.orchestra.run.smithi028.stdout: bluestore block size = 96636764160 2023-11-16T02:28:36.290 INFO:teuthology.orchestra.run.smithi028.stdout: bluestore fsck on mount = True 2023-11-16T02:28:36.290 INFO:teuthology.orchestra.run.smithi028.stdout: debug bluefs = 1/20 2023-11-16T02:28:36.290 INFO:teuthology.orchestra.run.smithi028.stdout: debug bluestore = 1/20 2023-11-16T02:28:36.290 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2023-11-16T02:28:36.290 INFO:teuthology.orchestra.run.smithi028.stdout: debug osd = 20 2023-11-16T02:28:36.290 INFO:teuthology.orchestra.run.smithi028.stdout: debug rocksdb = 4/10 2023-11-16T02:28:36.290 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd backfillfull_ratio = 0.85 2023-11-16T02:28:36.290 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd full ratio = 0.9 2023-11-16T02:28:36.290 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd nearfull ratio = 0.8 2023-11-16T02:28:36.290 INFO:teuthology.orchestra.run.smithi028.stdout: osd failsafe full ratio = 0.95 2023-11-16T02:28:36.290 INFO:teuthology.orchestra.run.smithi028.stdout: osd objectstore = bluestore 2023-11-16T02:28:36.291 INFO:teuthology.orchestra.run.smithi028.stdout: osd op complaint time = 180 2023-11-16T02:28:36.291 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.291 INFO:teuthology.orchestra.run.smithi028.stdout:[mgr] 2023-11-16T02:28:36.291 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2023-11-16T02:28:36.291 INFO:teuthology.orchestra.run.smithi028.stdout: debug mgr = 20 2023-11-16T02:28:36.291 INFO:teuthology.orchestra.run.smithi028.stdout: debug mon = 20 2023-11-16T02:28:36.291 INFO:teuthology.orchestra.run.smithi028.stdout: debug auth = 20 2023-11-16T02:28:36.291 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min pgs per osd = 4 2023-11-16T02:28:36.291 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min bytes per osd = 10 2023-11-16T02:28:36.291 INFO:teuthology.orchestra.run.smithi028.stdout: mgr/telemetry/nag = false 2023-11-16T02:28:36.291 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.291 INFO:teuthology.orchestra.run.smithi028.stdout:[mon] 2023-11-16T02:28:36.292 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2023-11-16T02:28:36.292 INFO:teuthology.orchestra.run.smithi028.stdout: debug mon = 20 2023-11-16T02:28:36.292 INFO:teuthology.orchestra.run.smithi028.stdout: debug paxos = 20 2023-11-16T02:28:36.292 INFO:teuthology.orchestra.run.smithi028.stdout: debug auth = 20 2023-11-16T02:28:36.292 INFO:teuthology.orchestra.run.smithi028.stdout: mon data avail warn = 5 2023-11-16T02:28:36.292 INFO:teuthology.orchestra.run.smithi028.stdout: mon mgr mkfs grace = 240 2023-11-16T02:28:36.292 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min pgs per osd = 4 2023-11-16T02:28:36.292 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd reporter subtree level = osd 2023-11-16T02:28:36.292 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd prime pg temp = true 2023-11-16T02:28:36.292 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min bytes per osd = 10 2023-11-16T02:28:36.292 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.292 INFO:teuthology.orchestra.run.smithi028.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-16T02:28:36.292 INFO:teuthology.orchestra.run.smithi028.stdout: auth mon ticket ttl = 660 # 11m 2023-11-16T02:28:36.293 INFO:teuthology.orchestra.run.smithi028.stdout: auth service ticket ttl = 240 # 4m 2023-11-16T02:28:36.293 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.293 INFO:teuthology.orchestra.run.smithi028.stdout: # don't complain about insecure global_id in the test suite 2023-11-16T02:28:36.293 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-16T02:28:36.293 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-16T02:28:36.293 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.293 INFO:teuthology.orchestra.run.smithi028.stdout: # 1m isn't quite enough 2023-11-16T02:28:36.293 INFO:teuthology.orchestra.run.smithi028.stdout: mon_down_mkfs_grace = 2m 2023-11-16T02:28:36.293 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.293 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_filestore_osds = false 2023-11-16T02:28:36.293 INFO:teuthology.orchestra.run.smithi028.stdout: mon op complaint time = 120 2023-11-16T02:28:36.293 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:28:36.293 INFO:teuthology.orchestra.run.smithi028.stdout:[client] 2023-11-16T02:28:36.294 INFO:teuthology.orchestra.run.smithi028.stdout: rgw cache enabled = true 2023-11-16T02:28:36.294 INFO:teuthology.orchestra.run.smithi028.stdout: rgw enable ops log = true 2023-11-16T02:28:36.294 INFO:teuthology.orchestra.run.smithi028.stdout: rgw enable usage log = true 2023-11-16T02:28:36.294 INFO:teuthology.orchestra.run.smithi028.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-16T02:28:36.294 INFO:teuthology.orchestra.run.smithi028.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-16T02:28:36.294 INFO:teuthology.orchestra.run.smithi028.stdout: client mount timeout = 600 2023-11-16T02:28:36.294 INFO:teuthology.orchestra.run.smithi028.stdout: debug client = 20 2023-11-16T02:28:36.294 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2023-11-16T02:28:36.294 INFO:teuthology.orchestra.run.smithi028.stdout: rados mon op timeout = 900 2023-11-16T02:28:36.294 INFO:teuthology.orchestra.run.smithi028.stdout: rados osd op timeout = 900 2023-11-16T02:28:36.294 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.a] 2023-11-16T02:28:36.294 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.b] 2023-11-16T02:28:36.294 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.c] 2023-11-16T02:28:36.295 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.a] 2023-11-16T02:28:36.295 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.c] 2023-11-16T02:28:36.295 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.b] 2023-11-16T02:28:36.295 INFO:teuthology.orchestra.run.smithi028.stdout:[mds] 2023-11-16T02:28:36.295 INFO:teuthology.orchestra.run.smithi028.stdout: debug mds = 20 2023-11-16T02:28:36.295 INFO:teuthology.orchestra.run.smithi028.stdout: debug mds balancer = 20 2023-11-16T02:28:36.295 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2023-11-16T02:28:36.295 INFO:teuthology.orchestra.run.smithi028.stdout: mds debug frag = True 2023-11-16T02:28:36.295 INFO:teuthology.orchestra.run.smithi028.stdout: mds debug scatterstat = True 2023-11-16T02:28:36.295 INFO:teuthology.orchestra.run.smithi028.stdout: mds op complaint time = 180 2023-11-16T02:28:36.295 INFO:teuthology.orchestra.run.smithi028.stdout: mds verify scatter = True 2023-11-16T02:28:36.295 INFO:teuthology.orchestra.run.smithi028.stdout: osd op complaint time = 180 2023-11-16T02:28:36.296 INFO:teuthology.orchestra.run.smithi028.stdout: rados mon op timeout = 900 2023-11-16T02:28:36.296 INFO:teuthology.orchestra.run.smithi028.stdout: rados osd op timeout = 900 2023-11-16T02:28:36.297 INFO:teuthology.orchestra.run.smithi070.stdout:[global] 2023-11-16T02:28:36.297 INFO:teuthology.orchestra.run.smithi070.stdout: chdir = "" 2023-11-16T02:28:36.297 INFO:teuthology.orchestra.run.smithi070.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-16T02:28:36.297 INFO:teuthology.orchestra.run.smithi070.stdout: auth supported = cephx 2023-11-16T02:28:36.298 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.298 INFO:teuthology.orchestra.run.smithi070.stdout: filestore xattr use omap = true 2023-11-16T02:28:36.298 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.298 INFO:teuthology.orchestra.run.smithi070.stdout: mon clock drift allowed = 1.000 2023-11-16T02:28:36.298 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.298 INFO:teuthology.orchestra.run.smithi070.stdout: osd crush chooseleaf type = 0 2023-11-16T02:28:36.298 INFO:teuthology.orchestra.run.smithi070.stdout: auth debug = true 2023-11-16T02:28:36.298 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.298 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on old message = true 2023-11-16T02:28:36.298 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on bug = true 2023-11-16T02:28:36.298 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.298 INFO:teuthology.orchestra.run.smithi070.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-16T02:28:36.299 INFO:teuthology.orchestra.run.smithi070.stdout: mon pg warn max object skew = 0 2023-11-16T02:28:36.299 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.299 INFO:teuthology.orchestra.run.smithi070.stdout: # disable pg_autoscaler by default for new pools 2023-11-16T02:28:36.299 INFO:teuthology.orchestra.run.smithi070.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-16T02:28:36.299 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.299 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default size = 2 2023-11-16T02:28:36.299 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.299 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow primary affinity = true 2023-11-16T02:28:36.299 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow pg remap = true 2023-11-16T02:28:36.299 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on legacy crush tunables = false 2023-11-16T02:28:36.299 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on crush straw calc version zero = false 2023-11-16T02:28:36.299 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on no sortbitwise = false 2023-11-16T02:28:36.299 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on osd down out interval zero = false 2023-11-16T02:28:36.300 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on too few osds = false 2023-11-16T02:28:36.300 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-16T02:28:36.300 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-16T02:28:36.300 INFO:teuthology.orchestra.run.smithi070.stdout: mon_allow_pool_size_one = true 2023-11-16T02:28:36.300 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.300 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-16T02:28:36.300 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.300 INFO:teuthology.orchestra.run.smithi070.stdout: osd default data pool replay window = 5 2023-11-16T02:28:36.300 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.300 INFO:teuthology.orchestra.run.smithi070.stdout: mon allow pool delete = true 2023-11-16T02:28:36.300 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.300 INFO:teuthology.orchestra.run.smithi070.stdout: mon cluster log file level = debug 2023-11-16T02:28:36.300 INFO:teuthology.orchestra.run.smithi070.stdout: debug asserts on shutdown = true 2023-11-16T02:28:36.301 INFO:teuthology.orchestra.run.smithi070.stdout: mon health detail to clog = false 2023-11-16T02:28:36.301 INFO:teuthology.orchestra.run.smithi070.stdout: mon host = "172.21.15.28,172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790]" 2023-11-16T02:28:36.301 INFO:teuthology.orchestra.run.smithi070.stdout: mon pg warn min per osd = 0 2023-11-16T02:28:36.301 INFO:teuthology.orchestra.run.smithi070.stdout: fsid = 1325a234-ab9e-4632-9a6e-98afbef8ae76 2023-11-16T02:28:36.301 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.301 INFO:teuthology.orchestra.run.smithi070.stdout:[osd] 2023-11-16T02:28:36.301 INFO:teuthology.orchestra.run.smithi070.stdout: osd journal size = 100 2023-11-16T02:28:36.301 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.301 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub load threshold = 5.0 2023-11-16T02:28:36.301 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub max interval = 600 2023-11-16T02:28:36.301 INFO:teuthology.orchestra.run.smithi070.stdout: osd mclock profile = high_recovery_ops 2023-11-16T02:28:36.301 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.301 INFO:teuthology.orchestra.run.smithi070.stdout: osd recover clone overlap = true 2023-11-16T02:28:36.302 INFO:teuthology.orchestra.run.smithi070.stdout: osd recovery max chunk = 1048576 2023-11-16T02:28:36.302 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.302 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug shutdown = true 2023-11-16T02:28:36.302 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug op order = true 2023-11-16T02:28:36.302 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug verify stray on activate = true 2023-11-16T02:28:36.302 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.302 INFO:teuthology.orchestra.run.smithi070.stdout: osd open classes on start = true 2023-11-16T02:28:36.302 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug pg log writeout = true 2023-11-16T02:28:36.302 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.302 INFO:teuthology.orchestra.run.smithi070.stdout: osd deep scrub update digest min age = 30 2023-11-16T02:28:36.302 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.302 INFO:teuthology.orchestra.run.smithi070.stdout: osd map max advance = 10 2023-11-16T02:28:36.302 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.303 INFO:teuthology.orchestra.run.smithi070.stdout: journal zero on create = true 2023-11-16T02:28:36.303 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.303 INFO:teuthology.orchestra.run.smithi070.stdout: filestore ondisk finisher threads = 3 2023-11-16T02:28:36.303 INFO:teuthology.orchestra.run.smithi070.stdout: filestore apply finisher threads = 3 2023-11-16T02:28:36.303 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.303 INFO:teuthology.orchestra.run.smithi070.stdout: bdev debug aio = true 2023-11-16T02:28:36.303 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug misdirected ops = true 2023-11-16T02:28:36.303 INFO:teuthology.orchestra.run.smithi070.stdout: bdev async discard = True 2023-11-16T02:28:36.303 INFO:teuthology.orchestra.run.smithi070.stdout: bdev enable discard = True 2023-11-16T02:28:36.303 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore allocator = bitmap 2023-11-16T02:28:36.303 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore block size = 96636764160 2023-11-16T02:28:36.303 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore fsck on mount = True 2023-11-16T02:28:36.304 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluefs = 1/20 2023-11-16T02:28:36.304 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluestore = 1/20 2023-11-16T02:28:36.304 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2023-11-16T02:28:36.304 INFO:teuthology.orchestra.run.smithi070.stdout: debug osd = 20 2023-11-16T02:28:36.304 INFO:teuthology.orchestra.run.smithi070.stdout: debug rocksdb = 4/10 2023-11-16T02:28:36.304 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd backfillfull_ratio = 0.85 2023-11-16T02:28:36.304 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd full ratio = 0.9 2023-11-16T02:28:36.304 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd nearfull ratio = 0.8 2023-11-16T02:28:36.304 INFO:teuthology.orchestra.run.smithi070.stdout: osd failsafe full ratio = 0.95 2023-11-16T02:28:36.304 INFO:teuthology.orchestra.run.smithi070.stdout: osd objectstore = bluestore 2023-11-16T02:28:36.304 INFO:teuthology.orchestra.run.smithi070.stdout: osd op complaint time = 180 2023-11-16T02:28:36.304 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.304 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr] 2023-11-16T02:28:36.305 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2023-11-16T02:28:36.305 INFO:teuthology.orchestra.run.smithi070.stdout: debug mgr = 20 2023-11-16T02:28:36.305 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2023-11-16T02:28:36.305 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2023-11-16T02:28:36.305 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2023-11-16T02:28:36.305 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2023-11-16T02:28:36.305 INFO:teuthology.orchestra.run.smithi070.stdout: mgr/telemetry/nag = false 2023-11-16T02:28:36.305 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.305 INFO:teuthology.orchestra.run.smithi070.stdout:[mon] 2023-11-16T02:28:36.305 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2023-11-16T02:28:36.305 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2023-11-16T02:28:36.305 INFO:teuthology.orchestra.run.smithi070.stdout: debug paxos = 20 2023-11-16T02:28:36.305 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2023-11-16T02:28:36.306 INFO:teuthology.orchestra.run.smithi070.stdout: mon data avail warn = 5 2023-11-16T02:28:36.306 INFO:teuthology.orchestra.run.smithi070.stdout: mon mgr mkfs grace = 240 2023-11-16T02:28:36.306 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2023-11-16T02:28:36.306 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd reporter subtree level = osd 2023-11-16T02:28:36.306 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd prime pg temp = true 2023-11-16T02:28:36.306 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2023-11-16T02:28:36.306 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.306 INFO:teuthology.orchestra.run.smithi070.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-16T02:28:36.306 INFO:teuthology.orchestra.run.smithi070.stdout: auth mon ticket ttl = 660 # 11m 2023-11-16T02:28:36.306 INFO:teuthology.orchestra.run.smithi070.stdout: auth service ticket ttl = 240 # 4m 2023-11-16T02:28:36.306 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.306 INFO:teuthology.orchestra.run.smithi070.stdout: # don't complain about insecure global_id in the test suite 2023-11-16T02:28:36.307 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-16T02:28:36.307 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-16T02:28:36.307 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.307 INFO:teuthology.orchestra.run.smithi070.stdout: # 1m isn't quite enough 2023-11-16T02:28:36.307 INFO:teuthology.orchestra.run.smithi070.stdout: mon_down_mkfs_grace = 2m 2023-11-16T02:28:36.307 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.307 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_filestore_osds = false 2023-11-16T02:28:36.307 INFO:teuthology.orchestra.run.smithi070.stdout: mon op complaint time = 120 2023-11-16T02:28:36.307 INFO:teuthology.orchestra.run.smithi070.stdout: 2023-11-16T02:28:36.307 INFO:teuthology.orchestra.run.smithi070.stdout:[client] 2023-11-16T02:28:36.307 INFO:teuthology.orchestra.run.smithi070.stdout: rgw cache enabled = true 2023-11-16T02:28:36.307 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable ops log = true 2023-11-16T02:28:36.307 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable usage log = true 2023-11-16T02:28:36.308 INFO:teuthology.orchestra.run.smithi070.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-16T02:28:36.308 INFO:teuthology.orchestra.run.smithi070.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-16T02:28:36.308 INFO:teuthology.orchestra.run.smithi070.stdout: client mount timeout = 600 2023-11-16T02:28:36.308 INFO:teuthology.orchestra.run.smithi070.stdout: debug client = 20 2023-11-16T02:28:36.308 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2023-11-16T02:28:36.308 INFO:teuthology.orchestra.run.smithi070.stdout: rados mon op timeout = 900 2023-11-16T02:28:36.308 INFO:teuthology.orchestra.run.smithi070.stdout: rados osd op timeout = 900 2023-11-16T02:28:36.308 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.a] 2023-11-16T02:28:36.308 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.b] 2023-11-16T02:28:36.308 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.c] 2023-11-16T02:28:36.308 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.a] 2023-11-16T02:28:36.308 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.c] 2023-11-16T02:28:36.308 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.b] 2023-11-16T02:28:36.309 INFO:teuthology.orchestra.run.smithi070.stdout:[mds] 2023-11-16T02:28:36.309 INFO:teuthology.orchestra.run.smithi070.stdout: debug mds = 20 2023-11-16T02:28:36.309 INFO:teuthology.orchestra.run.smithi070.stdout: debug mds balancer = 20 2023-11-16T02:28:36.309 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2023-11-16T02:28:36.309 INFO:teuthology.orchestra.run.smithi070.stdout: mds debug frag = True 2023-11-16T02:28:36.309 INFO:teuthology.orchestra.run.smithi070.stdout: mds debug scatterstat = True 2023-11-16T02:28:36.309 INFO:teuthology.orchestra.run.smithi070.stdout: mds op complaint time = 180 2023-11-16T02:28:36.309 INFO:teuthology.orchestra.run.smithi070.stdout: mds verify scatter = True 2023-11-16T02:28:36.309 INFO:teuthology.orchestra.run.smithi070.stdout: osd op complaint time = 180 2023-11-16T02:28:36.309 INFO:teuthology.orchestra.run.smithi070.stdout: rados mon op timeout = 900 2023-11-16T02:28:36.309 INFO:teuthology.orchestra.run.smithi070.stdout: rados osd op timeout = 900 2023-11-16T02:28:36.310 INFO:teuthology.orchestra.run.smithi204.stdout:[global] 2023-11-16T02:28:36.310 INFO:teuthology.orchestra.run.smithi204.stdout: chdir = "" 2023-11-16T02:28:36.310 INFO:teuthology.orchestra.run.smithi204.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-16T02:28:36.310 INFO:teuthology.orchestra.run.smithi204.stdout: auth supported = cephx 2023-11-16T02:28:36.310 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.310 INFO:teuthology.orchestra.run.smithi204.stdout: filestore xattr use omap = true 2023-11-16T02:28:36.310 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.311 INFO:teuthology.orchestra.run.smithi204.stdout: mon clock drift allowed = 1.000 2023-11-16T02:28:36.311 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.311 INFO:teuthology.orchestra.run.smithi204.stdout: osd crush chooseleaf type = 0 2023-11-16T02:28:36.311 INFO:teuthology.orchestra.run.smithi204.stdout: auth debug = true 2023-11-16T02:28:36.311 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.311 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on old message = true 2023-11-16T02:28:36.311 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on bug = true 2023-11-16T02:28:36.311 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.311 INFO:teuthology.orchestra.run.smithi204.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-16T02:28:36.311 INFO:teuthology.orchestra.run.smithi204.stdout: mon pg warn max object skew = 0 2023-11-16T02:28:36.311 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.311 INFO:teuthology.orchestra.run.smithi204.stdout: # disable pg_autoscaler by default for new pools 2023-11-16T02:28:36.312 INFO:teuthology.orchestra.run.smithi204.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-16T02:28:36.312 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.312 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default size = 2 2023-11-16T02:28:36.312 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.312 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow primary affinity = true 2023-11-16T02:28:36.312 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow pg remap = true 2023-11-16T02:28:36.312 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on legacy crush tunables = false 2023-11-16T02:28:36.312 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on crush straw calc version zero = false 2023-11-16T02:28:36.312 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on no sortbitwise = false 2023-11-16T02:28:36.312 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on osd down out interval zero = false 2023-11-16T02:28:36.312 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on too few osds = false 2023-11-16T02:28:36.312 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-16T02:28:36.312 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-16T02:28:36.313 INFO:teuthology.orchestra.run.smithi204.stdout: mon_allow_pool_size_one = true 2023-11-16T02:28:36.313 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.313 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-16T02:28:36.313 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.313 INFO:teuthology.orchestra.run.smithi204.stdout: osd default data pool replay window = 5 2023-11-16T02:28:36.313 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.313 INFO:teuthology.orchestra.run.smithi204.stdout: mon allow pool delete = true 2023-11-16T02:28:36.313 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.313 INFO:teuthology.orchestra.run.smithi204.stdout: mon cluster log file level = debug 2023-11-16T02:28:36.313 INFO:teuthology.orchestra.run.smithi204.stdout: debug asserts on shutdown = true 2023-11-16T02:28:36.313 INFO:teuthology.orchestra.run.smithi204.stdout: mon health detail to clog = false 2023-11-16T02:28:36.313 INFO:teuthology.orchestra.run.smithi204.stdout: mon host = "172.21.15.28,172.21.15.70,[v2:172.21.15.70:3301,v1:172.21.15.70:6790]" 2023-11-16T02:28:36.313 INFO:teuthology.orchestra.run.smithi204.stdout: mon pg warn min per osd = 0 2023-11-16T02:28:36.314 INFO:teuthology.orchestra.run.smithi204.stdout: fsid = 1325a234-ab9e-4632-9a6e-98afbef8ae76 2023-11-16T02:28:36.314 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.314 INFO:teuthology.orchestra.run.smithi204.stdout:[osd] 2023-11-16T02:28:36.314 INFO:teuthology.orchestra.run.smithi204.stdout: osd journal size = 100 2023-11-16T02:28:36.314 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.314 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub load threshold = 5.0 2023-11-16T02:28:36.314 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub max interval = 600 2023-11-16T02:28:36.314 INFO:teuthology.orchestra.run.smithi204.stdout: osd mclock profile = high_recovery_ops 2023-11-16T02:28:36.314 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.314 INFO:teuthology.orchestra.run.smithi204.stdout: osd recover clone overlap = true 2023-11-16T02:28:36.314 INFO:teuthology.orchestra.run.smithi204.stdout: osd recovery max chunk = 1048576 2023-11-16T02:28:36.314 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.315 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug shutdown = true 2023-11-16T02:28:36.315 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug op order = true 2023-11-16T02:28:36.315 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug verify stray on activate = true 2023-11-16T02:28:36.315 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.315 INFO:teuthology.orchestra.run.smithi204.stdout: osd open classes on start = true 2023-11-16T02:28:36.315 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug pg log writeout = true 2023-11-16T02:28:36.315 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.315 INFO:teuthology.orchestra.run.smithi204.stdout: osd deep scrub update digest min age = 30 2023-11-16T02:28:36.315 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.315 INFO:teuthology.orchestra.run.smithi204.stdout: osd map max advance = 10 2023-11-16T02:28:36.315 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.315 INFO:teuthology.orchestra.run.smithi204.stdout: journal zero on create = true 2023-11-16T02:28:36.315 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.316 INFO:teuthology.orchestra.run.smithi204.stdout: filestore ondisk finisher threads = 3 2023-11-16T02:28:36.316 INFO:teuthology.orchestra.run.smithi204.stdout: filestore apply finisher threads = 3 2023-11-16T02:28:36.316 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.316 INFO:teuthology.orchestra.run.smithi204.stdout: bdev debug aio = true 2023-11-16T02:28:36.316 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug misdirected ops = true 2023-11-16T02:28:36.316 INFO:teuthology.orchestra.run.smithi204.stdout: bdev async discard = True 2023-11-16T02:28:36.316 INFO:teuthology.orchestra.run.smithi204.stdout: bdev enable discard = True 2023-11-16T02:28:36.316 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore allocator = bitmap 2023-11-16T02:28:36.316 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore block size = 96636764160 2023-11-16T02:28:36.316 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore fsck on mount = True 2023-11-16T02:28:36.316 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluefs = 1/20 2023-11-16T02:28:36.316 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluestore = 1/20 2023-11-16T02:28:36.316 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2023-11-16T02:28:36.317 INFO:teuthology.orchestra.run.smithi204.stdout: debug osd = 20 2023-11-16T02:28:36.317 INFO:teuthology.orchestra.run.smithi204.stdout: debug rocksdb = 4/10 2023-11-16T02:28:36.317 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd backfillfull_ratio = 0.85 2023-11-16T02:28:36.317 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd full ratio = 0.9 2023-11-16T02:28:36.317 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd nearfull ratio = 0.8 2023-11-16T02:28:36.317 INFO:teuthology.orchestra.run.smithi204.stdout: osd failsafe full ratio = 0.95 2023-11-16T02:28:36.317 INFO:teuthology.orchestra.run.smithi204.stdout: osd objectstore = bluestore 2023-11-16T02:28:36.317 INFO:teuthology.orchestra.run.smithi204.stdout: osd op complaint time = 180 2023-11-16T02:28:36.317 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.317 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr] 2023-11-16T02:28:36.317 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2023-11-16T02:28:36.317 INFO:teuthology.orchestra.run.smithi204.stdout: debug mgr = 20 2023-11-16T02:28:36.318 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2023-11-16T02:28:36.318 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2023-11-16T02:28:36.318 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2023-11-16T02:28:36.318 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2023-11-16T02:28:36.318 INFO:teuthology.orchestra.run.smithi204.stdout: mgr/telemetry/nag = false 2023-11-16T02:28:36.318 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.318 INFO:teuthology.orchestra.run.smithi204.stdout:[mon] 2023-11-16T02:28:36.318 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2023-11-16T02:28:36.318 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2023-11-16T02:28:36.318 INFO:teuthology.orchestra.run.smithi204.stdout: debug paxos = 20 2023-11-16T02:28:36.318 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2023-11-16T02:28:36.318 INFO:teuthology.orchestra.run.smithi204.stdout: mon data avail warn = 5 2023-11-16T02:28:36.319 INFO:teuthology.orchestra.run.smithi204.stdout: mon mgr mkfs grace = 240 2023-11-16T02:28:36.319 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2023-11-16T02:28:36.319 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd reporter subtree level = osd 2023-11-16T02:28:36.319 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd prime pg temp = true 2023-11-16T02:28:36.319 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2023-11-16T02:28:36.319 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.319 INFO:teuthology.orchestra.run.smithi204.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-16T02:28:36.319 INFO:teuthology.orchestra.run.smithi204.stdout: auth mon ticket ttl = 660 # 11m 2023-11-16T02:28:36.319 INFO:teuthology.orchestra.run.smithi204.stdout: auth service ticket ttl = 240 # 4m 2023-11-16T02:28:36.319 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.319 INFO:teuthology.orchestra.run.smithi204.stdout: # don't complain about insecure global_id in the test suite 2023-11-16T02:28:36.319 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-16T02:28:36.320 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-16T02:28:36.320 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.320 INFO:teuthology.orchestra.run.smithi204.stdout: # 1m isn't quite enough 2023-11-16T02:28:36.320 INFO:teuthology.orchestra.run.smithi204.stdout: mon_down_mkfs_grace = 2m 2023-11-16T02:28:36.320 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.320 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_filestore_osds = false 2023-11-16T02:28:36.320 INFO:teuthology.orchestra.run.smithi204.stdout: mon op complaint time = 120 2023-11-16T02:28:36.320 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:28:36.320 INFO:teuthology.orchestra.run.smithi204.stdout:[client] 2023-11-16T02:28:36.320 INFO:teuthology.orchestra.run.smithi204.stdout: rgw cache enabled = true 2023-11-16T02:28:36.320 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable ops log = true 2023-11-16T02:28:36.320 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable usage log = true 2023-11-16T02:28:36.320 INFO:teuthology.orchestra.run.smithi204.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-16T02:28:36.321 INFO:teuthology.orchestra.run.smithi204.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-16T02:28:36.321 INFO:teuthology.orchestra.run.smithi204.stdout: client mount timeout = 600 2023-11-16T02:28:36.321 INFO:teuthology.orchestra.run.smithi204.stdout: debug client = 20 2023-11-16T02:28:36.321 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2023-11-16T02:28:36.321 INFO:teuthology.orchestra.run.smithi204.stdout: rados mon op timeout = 900 2023-11-16T02:28:36.321 INFO:teuthology.orchestra.run.smithi204.stdout: rados osd op timeout = 900 2023-11-16T02:28:36.321 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.a] 2023-11-16T02:28:36.321 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.b] 2023-11-16T02:28:36.321 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.c] 2023-11-16T02:28:36.321 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.a] 2023-11-16T02:28:36.321 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.c] 2023-11-16T02:28:36.321 INFO:teuthology.orchestra.run.smithi204.stdout:[mds.b] 2023-11-16T02:28:36.321 INFO:teuthology.orchestra.run.smithi204.stdout:[mds] 2023-11-16T02:28:36.322 INFO:teuthology.orchestra.run.smithi204.stdout: debug mds = 20 2023-11-16T02:28:36.322 INFO:teuthology.orchestra.run.smithi204.stdout: debug mds balancer = 20 2023-11-16T02:28:36.322 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2023-11-16T02:28:36.322 INFO:teuthology.orchestra.run.smithi204.stdout: mds debug frag = True 2023-11-16T02:28:36.322 INFO:teuthology.orchestra.run.smithi204.stdout: mds debug scatterstat = True 2023-11-16T02:28:36.322 INFO:teuthology.orchestra.run.smithi204.stdout: mds op complaint time = 180 2023-11-16T02:28:36.322 INFO:teuthology.orchestra.run.smithi204.stdout: mds verify scatter = True 2023-11-16T02:28:36.322 INFO:teuthology.orchestra.run.smithi204.stdout: osd op complaint time = 180 2023-11-16T02:28:36.322 INFO:teuthology.orchestra.run.smithi204.stdout: rados mon op timeout = 900 2023-11-16T02:28:36.322 INFO:teuthology.orchestra.run.smithi204.stdout: rados osd op timeout = 900 2023-11-16T02:28:36.323 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-16T02:28:36.323 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-16T02:28:36.389 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-16T02:28:36.389 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-16T02:28:36.390 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-16T02:28:36.394 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-16T02:28:36.398 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-16T02:28:36.442 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi028.front.sepia.ceph.com 2023-11-16T02:28:36.442 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-16T02:28:36.442 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-16T02:28:36.442 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-16T02:28:36.505 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-16T02:28:36.505 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-16T02:28:36.554 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi070.front.sepia.ceph.com 2023-11-16T02:28:36.555 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-16T02:28:36.555 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-16T02:28:36.555 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-16T02:28:36.578 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-16T02:28:36.578 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-16T02:28:36.627 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi204.front.sepia.ceph.com 2023-11-16T02:28:36.627 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-16T02:28:36.627 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-16T02:28:36.627 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-16T02:28:36.663 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-16T02:28:36.663 DEBUG:teuthology.orchestra.run.smithi204:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-16T02:28:36.713 INFO:tasks.ceph:Setting up mon nodes... 2023-11-16T02:28:36.714 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-16T02:28:36.714 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-16T02:28:36.761 INFO:teuthology.orchestra.run.smithi028.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-16T02:28:36.764 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-16T02:28:36.807 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-16T02:28:36.818 INFO:tasks.ceph:Setting up mds nodes... 2023-11-16T02:28:36.818 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-16T02:28:36.861 INFO:teuthology.orchestra.run.smithi028.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-16T02:28:36.863 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-16T02:28:36.917 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-16T02:28:37.002 INFO:teuthology.orchestra.run.smithi028.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-16T02:28:37.005 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-16T02:28:37.060 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-16T02:28:37.103 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-16T02:28:37.107 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-16T02:28:37.162 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-16T02:28:37.163 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-16T02:28:37.210 INFO:teuthology.orchestra.run.smithi204.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-16T02:28:37.239 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-16T02:28:37.240 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi028.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-16T02:28:37.240 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-16T02:28:37.254 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-16T02:28:37.254 INFO:tasks.ceph:role: osd.0 2023-11-16T02:28:37.254 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi028.front.sepia.ceph.com 2023-11-16T02:28:37.254 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-16T02:28:37.313 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-16T02:28:37.314 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-16T02:28:37.314 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-16T02:28:37.314 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-16T02:28:37.314 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-16T02:28:37.314 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2023-11-16T02:28:37.314 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-16T02:28:37.314 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-16T02:28:37.314 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-16T02:28:37.314 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-16T02:28:37.339 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2023-11-16T02:28:37.342 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2023-11-16T02:28:37.342 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-16T02:28:37.401 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-16T02:28:37.453 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-16T02:28:37.454 INFO:teuthology.orchestra.run.smithi028.stderr:sudo: /sbin/restorecon: command not found 2023-11-16T02:28:37.457 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-16T02:28:37.510 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-16T02:28:37.510 INFO:tasks.ceph:role: osd.1 2023-11-16T02:28:37.510 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi028.front.sepia.ceph.com 2023-11-16T02:28:37.510 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-16T02:28:37.565 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-16T02:28:37.566 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-16T02:28:37.566 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-16T02:28:37.566 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-16T02:28:37.566 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-16T02:28:37.566 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2023-11-16T02:28:37.566 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-16T02:28:37.566 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-16T02:28:37.566 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-16T02:28:37.566 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-16T02:28:37.590 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2023-11-16T02:28:37.591 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2023-11-16T02:28:37.591 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-16T02:28:37.650 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-16T02:28:37.701 INFO:teuthology.orchestra.run.smithi028.stderr:sudo: /sbin/restorecon: command not found 2023-11-16T02:28:37.702 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-16T02:28:37.702 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-16T02:28:37.756 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-16T02:28:37.756 INFO:tasks.ceph:role: osd.2 2023-11-16T02:28:37.756 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi028.front.sepia.ceph.com 2023-11-16T02:28:37.756 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-16T02:28:37.813 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-16T02:28:37.813 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-16T02:28:37.813 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-16T02:28:37.813 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-16T02:28:37.814 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-16T02:28:37.814 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2023-11-16T02:28:37.814 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-16T02:28:37.814 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-16T02:28:37.814 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-16T02:28:37.814 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-16T02:28:37.837 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2023-11-16T02:28:37.839 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2023-11-16T02:28:37.839 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-16T02:28:37.900 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-16T02:28:37.956 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-16T02:28:37.956 INFO:teuthology.orchestra.run.smithi028.stderr:sudo: /sbin/restorecon: command not found 2023-11-16T02:28:37.957 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-16T02:28:38.013 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-16T02:28:38.013 INFO:tasks.ceph:role: osd.3 2023-11-16T02:28:38.013 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi028.front.sepia.ceph.com 2023-11-16T02:28:38.013 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-16T02:28:38.069 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-16T02:28:38.069 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-16T02:28:38.069 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-16T02:28:38.069 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-16T02:28:38.069 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-16T02:28:38.069 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2023-11-16T02:28:38.069 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-16T02:28:38.069 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-16T02:28:38.069 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-16T02:28:38.069 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-16T02:28:38.094 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2023-11-16T02:28:38.096 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2023-11-16T02:28:38.096 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-16T02:28:38.162 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-16T02:28:38.213 INFO:teuthology.orchestra.run.smithi028.stderr:sudo: /sbin/restorecon: command not found 2023-11-16T02:28:38.214 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-16T02:28:38.215 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-16T02:28:38.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:28:38.321+0000 7f768d31d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-16T02:28:38.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:28:38.321+0000 7f768d31d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-16T02:28:38.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:28:38.321+0000 7f768d31d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-16T02:28:38.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:28:38.321+0000 7f768d31d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-16T02:28:38.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:28:38.321+0000 7f768d31d640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-16T02:28:38.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:28:38.321+0000 7f768d31d640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-16T02:28:41.325 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-16T02:28:41.340 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-16T02:28:41.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:28:41.425+0000 7f94f7cea640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-16T02:28:41.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:28:41.425+0000 7f94f7cea640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-16T02:28:41.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:28:41.425+0000 7f94f7cea640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-16T02:28:41.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:28:41.425+0000 7f94f7cea640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-16T02:28:41.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:28:41.425+0000 7f94f7cea640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-16T02:28:41.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:28:41.425+0000 7f94f7cea640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-16T02:28:44.434 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-16T02:28:44.490 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-16T02:28:44.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:28:44.569+0000 7f7e8c151640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-16T02:28:44.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:28:44.573+0000 7f7e8c151640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-16T02:28:44.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:28:44.573+0000 7f7e8c151640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-16T02:28:44.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:28:44.573+0000 7f7e8c151640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-16T02:28:44.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:28:44.573+0000 7f7e8c151640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-16T02:28:44.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:28:44.573+0000 7f7e8c151640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-16T02:28:47.584 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-16T02:28:47.638 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-16T02:28:47.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:28:47.721+0000 7f2d8a37f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-16T02:28:47.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:28:47.721+0000 7f2d8a37f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-16T02:28:47.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:28:47.721+0000 7f2d8a37f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-16T02:28:47.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:28:47.721+0000 7f2d8a37f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-16T02:28:47.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:28:47.721+0000 7f2d8a37f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-16T02:28:47.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:28:47.721+0000 7f2d8a37f640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-16T02:28:50.769 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-16T02:28:50.826 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-16T02:28:50.840 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-16T02:28:50.840 INFO:tasks.ceph:role: osd.4 2023-11-16T02:28:50.840 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com 2023-11-16T02:28:50.840 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-16T02:28:50.898 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-16T02:28:50.898 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-16T02:28:50.898 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-16T02:28:50.898 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-16T02:28:50.898 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-16T02:28:50.898 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2023-11-16T02:28:50.898 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-16T02:28:50.899 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-16T02:28:50.899 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-16T02:28:50.899 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-16T02:28:50.922 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2023-11-16T02:28:50.924 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2023-11-16T02:28:50.924 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-16T02:28:50.984 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-16T02:28:51.035 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-16T02:28:51.036 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2023-11-16T02:28:51.036 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-16T02:28:51.089 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-16T02:28:51.089 INFO:tasks.ceph:role: osd.5 2023-11-16T02:28:51.089 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi070.front.sepia.ceph.com 2023-11-16T02:28:51.089 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-16T02:28:51.141 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-16T02:28:51.141 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-16T02:28:51.142 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-16T02:28:51.142 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-16T02:28:51.142 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-16T02:28:51.143 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2023-11-16T02:28:51.143 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-16T02:28:51.143 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-16T02:28:51.143 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-16T02:28:51.143 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-16T02:28:51.165 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2023-11-16T02:28:51.167 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2023-11-16T02:28:51.167 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-16T02:28:51.225 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-16T02:28:51.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-16T02:28:51.279 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2023-11-16T02:28:51.279 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-16T02:28:51.333 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-16T02:28:51.333 INFO:tasks.ceph:role: osd.6 2023-11-16T02:28:51.333 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi070.front.sepia.ceph.com 2023-11-16T02:28:51.334 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-16T02:28:51.390 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-16T02:28:51.390 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-16T02:28:51.390 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-16T02:28:51.390 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-16T02:28:51.390 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-16T02:28:51.391 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2023-11-16T02:28:51.391 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-16T02:28:51.391 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-16T02:28:51.391 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-16T02:28:51.391 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-16T02:28:51.414 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2023-11-16T02:28:51.416 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2023-11-16T02:28:51.416 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-16T02:28:51.473 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-16T02:28:51.527 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-16T02:28:51.527 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2023-11-16T02:28:51.528 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-16T02:28:51.583 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-16T02:28:51.583 INFO:tasks.ceph:role: osd.7 2023-11-16T02:28:51.583 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi070.front.sepia.ceph.com 2023-11-16T02:28:51.583 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-16T02:28:51.637 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-16T02:28:51.637 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-16T02:28:51.637 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-16T02:28:51.637 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-16T02:28:51.637 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-16T02:28:51.637 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2023-11-16T02:28:51.638 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-16T02:28:51.638 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-16T02:28:51.638 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-16T02:28:51.638 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-16T02:28:51.661 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2023-11-16T02:28:51.662 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2023-11-16T02:28:51.663 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-16T02:28:51.726 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-16T02:28:51.778 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-16T02:28:51.779 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2023-11-16T02:28:51.779 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-16T02:28:51.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:28:51.894+0000 7f160c7ff640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-16T02:28:51.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:28:51.894+0000 7f160c7ff640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-16T02:28:51.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:28:51.894+0000 7f160c7ff640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-16T02:28:51.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:28:51.894+0000 7f160c7ff640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-16T02:28:51.897 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:28:51.894+0000 7f160c7ff640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-16T02:28:51.898 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:28:51.894+0000 7f160c7ff640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-16T02:28:54.888 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-16T02:28:56.651 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-16T02:28:56.738 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:28:56.734+0000 7f3a64f69640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-16T02:28:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:28:56.734+0000 7f3a64f69640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-16T02:28:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:28:56.734+0000 7f3a64f69640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-16T02:28:56.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:28:56.734+0000 7f3a64f69640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-16T02:28:56.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:28:56.734+0000 7f3a64f69640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-16T02:28:56.740 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:28:56.734+0000 7f3a64f69640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-16T02:28:59.730 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-16T02:28:59.787 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-16T02:28:59.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:28:59.870+0000 7ffaf52df640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-16T02:28:59.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:28:59.870+0000 7ffaf52df640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-16T02:28:59.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:28:59.870+0000 7ffaf52df640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-16T02:28:59.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:28:59.870+0000 7ffaf52df640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-16T02:28:59.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:28:59.870+0000 7ffaf52df640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-16T02:28:59.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:28:59.870+0000 7ffaf52df640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-16T02:29:02.870 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-16T02:29:02.926 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-16T02:29:03.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:03.006+0000 7f2750e03640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-16T02:29:03.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:03.006+0000 7f2750e03640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-16T02:29:03.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:03.006+0000 7f2750e03640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-16T02:29:03.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:03.006+0000 7f2750e03640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-16T02:29:03.007 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:03.006+0000 7f2750e03640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-16T02:29:03.008 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:03.006+0000 7f2750e03640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-16T02:29:04.496 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:29:04.499 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:29:04.501 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:29:06.019 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-16T02:29:06.033 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-16T02:29:06.033 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-16T02:29:06.033 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-16T02:29:06.047 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-16T02:29:06.048 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-16T02:29:06.102 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-16T02:29:06.102 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-16T02:29:06.157 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-16T02:29:06.157 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-16T02:29:06.213 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-16T02:29:06.213 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-16T02:29:06.269 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-16T02:29:06.269 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-16T02:29:06.326 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-16T02:29:06.326 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-16T02:29:06.382 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-16T02:29:06.382 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-16T02:29:06.396 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-16T02:29:06.397 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-16T02:29:06.453 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-16T02:29:06.454 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-16T02:29:06.510 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-16T02:29:06.510 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-16T02:29:06.566 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-16T02:29:06.566 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-16T02:29:06.622 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-16T02:29:06.622 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-16T02:29:06.677 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-16T02:29:06.678 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-16T02:29:06.689 INFO:tasks.ceph:Adding keys to all mons... 2023-11-16T02:29:06.690 DEBUG:teuthology.orchestra.run.smithi028:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-16T02:29:06.692 DEBUG:teuthology.orchestra.run.smithi070:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-16T02:29:06.724 INFO:teuthology.orchestra.run.smithi028.stdout:[mgr.y] 2023-11-16T02:29:06.724 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBUflVl3zeeLRAAucjaGZ6mcrghNmwmpurSJQ== 2023-11-16T02:29:06.724 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.a] 2023-11-16T02:29:06.724 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBUflVljiWUMxAA+sE7u7qHhK7hDwKgtVxb6g== 2023-11-16T02:29:06.724 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.c] 2023-11-16T02:29:06.724 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBVflVlBYhhABAA7jEAy16KdHWtJ5/qz/IAng== 2023-11-16T02:29:06.724 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.0] 2023-11-16T02:29:06.725 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBWflVlM/B9ExAAu7SJYp5M6O2OvenymzoHVw== 2023-11-16T02:29:06.725 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.1] 2023-11-16T02:29:06.725 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBZflVlJ1uuGRAAKCxqUgMnSi/p3iAAURnb7Q== 2023-11-16T02:29:06.725 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.2] 2023-11-16T02:29:06.725 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBcflVlcdBmIhAARpMHKX07S4dUI0J4Wkmx2A== 2023-11-16T02:29:06.725 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.3] 2023-11-16T02:29:06.725 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBfflVlcBJOKxAAfjVg3ry29k5y9EasXHKDWw== 2023-11-16T02:29:06.725 INFO:teuthology.orchestra.run.smithi028.stdout:[mgr.x] 2023-11-16T02:29:06.725 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBUflVlCH4rMBAAQffwun5A4cYlRyJZSV5ZGg== 2023-11-16T02:29:06.725 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.b] 2023-11-16T02:29:06.725 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBVflVlUEdGBhAANpvXXd/EtwwYy6Ko+T0NFQ== 2023-11-16T02:29:06.725 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.4] 2023-11-16T02:29:06.726 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBjflVlqamPNRAAMHO6wtCJ0Rs+m3YufYtpoQ== 2023-11-16T02:29:06.726 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.5] 2023-11-16T02:29:06.726 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBoflVlKtzaKxAAltnkDv0/qsyMY9+z1lgAgg== 2023-11-16T02:29:06.726 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.6] 2023-11-16T02:29:06.726 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBrflVlARn8MxAAs7740VTYxmaXjLTEj78B3g== 2023-11-16T02:29:06.726 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.7] 2023-11-16T02:29:06.726 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBvflVlBqaGABAAw0/Ul/uJhGBfFmIxjp7iVw== 2023-11-16T02:29:06.726 INFO:teuthology.orchestra.run.smithi028.stdout:[client.0] 2023-11-16T02:29:06.726 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBVflVlOOSiDBAA3p61o2obsK9XJScqqKRstA== 2023-11-16T02:29:06.731 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.y] 2023-11-16T02:29:06.731 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBUflVl3zeeLRAAucjaGZ6mcrghNmwmpurSJQ== 2023-11-16T02:29:06.731 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.a] 2023-11-16T02:29:06.731 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBUflVljiWUMxAA+sE7u7qHhK7hDwKgtVxb6g== 2023-11-16T02:29:06.731 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.c] 2023-11-16T02:29:06.731 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBVflVlBYhhABAA7jEAy16KdHWtJ5/qz/IAng== 2023-11-16T02:29:06.732 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.0] 2023-11-16T02:29:06.732 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBWflVlM/B9ExAAu7SJYp5M6O2OvenymzoHVw== 2023-11-16T02:29:06.732 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.1] 2023-11-16T02:29:06.732 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBZflVlJ1uuGRAAKCxqUgMnSi/p3iAAURnb7Q== 2023-11-16T02:29:06.732 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.2] 2023-11-16T02:29:06.732 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBcflVlcdBmIhAARpMHKX07S4dUI0J4Wkmx2A== 2023-11-16T02:29:06.732 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.3] 2023-11-16T02:29:06.732 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBfflVlcBJOKxAAfjVg3ry29k5y9EasXHKDWw== 2023-11-16T02:29:06.732 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.x] 2023-11-16T02:29:06.732 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBUflVlCH4rMBAAQffwun5A4cYlRyJZSV5ZGg== 2023-11-16T02:29:06.732 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.b] 2023-11-16T02:29:06.732 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBVflVlUEdGBhAANpvXXd/EtwwYy6Ko+T0NFQ== 2023-11-16T02:29:06.733 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.4] 2023-11-16T02:29:06.733 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBjflVlqamPNRAAMHO6wtCJ0Rs+m3YufYtpoQ== 2023-11-16T02:29:06.733 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.5] 2023-11-16T02:29:06.733 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBoflVlKtzaKxAAltnkDv0/qsyMY9+z1lgAgg== 2023-11-16T02:29:06.733 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.6] 2023-11-16T02:29:06.733 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBrflVlARn8MxAAs7740VTYxmaXjLTEj78B3g== 2023-11-16T02:29:06.733 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.7] 2023-11-16T02:29:06.733 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBvflVlBqaGABAAw0/Ul/uJhGBfFmIxjp7iVw== 2023-11-16T02:29:06.733 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2023-11-16T02:29:06.733 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQBVflVlOOSiDBAA3p61o2obsK9XJScqqKRstA== 2023-11-16T02:29:06.734 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-16T02:29:06.771 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-16T02:29:06.822 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-16T02:29:06.825 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-16T02:29:06.871 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-16T02:29:06.915 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-16T02:29:06.965 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-16T02:29:06.967 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-16T02:29:07.009 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-16T02:29:07.051 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-16T02:29:07.096 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-16T02:29:07.135 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-16T02:29:07.175 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-16T02:29:07.219 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-16T02:29:07.264 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-16T02:29:07.304 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-16T02:29:07.350 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-16T02:29:07.387 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-16T02:29:07.439 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-16T02:29:07.441 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-16T02:29:07.480 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-16T02:29:07.523 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-16T02:29:07.563 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-16T02:29:07.607 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-16T02:29:07.651 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-16T02:29:07.654 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-16T02:29:07.729 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-16T02:29:07.741 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-16T02:29:07.816 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-16T02:29:07.816 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-16T02:29:07.835 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-16T02:29:07.931 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-16T02:29:07.941 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-16T02:29:07.955 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-16T02:29:08.054 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-16T02:29:08.064 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-16T02:29:08.114 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-16T02:29:08.206 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-16T02:29:08.217 DEBUG:teuthology.orchestra.run.smithi028:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-16T02:29:08.219 DEBUG:teuthology.orchestra.run.smithi070:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-16T02:29:08.261 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-16T02:29:08.262 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-16T02:29:08.262 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-16T02:29:08.267 INFO:tasks.ceph.mon.a:Started 2023-11-16T02:29:08.267 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-16T02:29:08.267 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-16T02:29:08.307 INFO:tasks.ceph.mon.b:Started 2023-11-16T02:29:08.307 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-16T02:29:08.307 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-16T02:29:08.309 INFO:tasks.ceph.mon.c:Started 2023-11-16T02:29:08.309 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-16T02:29:08.310 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-16T02:29:08.310 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-16T02:29:08.312 INFO:tasks.ceph.mgr.y:Started 2023-11-16T02:29:08.312 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-16T02:29:08.312 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-16T02:29:08.314 INFO:tasks.ceph.mgr.x:Started 2023-11-16T02:29:08.315 INFO:tasks.ceph:Setting crush tunables to default 2023-11-16T02:29:08.315 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --cluster ceph osd crush tunables default 2023-11-16T02:29:08.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.431+0000 7f6614c71640 1 Processor -- start 2023-11-16T02:29:08.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.431+0000 7f6614c71640 1 -- start start 2023-11-16T02:29:08.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.431+0000 7f6614c71640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f661006d8c0 0x7f661014e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:08.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.431+0000 7f6614c71640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 0x7f661006b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:08.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.431+0000 7f6614c71640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f661006cc40 0x7f661014ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:08.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.431+0000 7f6614c71640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f661006bbd0 con 0x7f661006d8c0 2023-11-16T02:29:08.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.431+0000 7f6614c71640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f661006b850 con 0x7f661006cc40 2023-11-16T02:29:08.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.431+0000 7f6614c71640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661006ae80 con 0x7f66100ba600 2023-11-16T02:29:08.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.431+0000 7f660e59c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f661006d8c0 0x7f661014e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:08.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.431+0000 7f660e59c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f661006d8c0 0x7f661014e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48740/0 (socket says 172.21.15.28:48740) 2023-11-16T02:29:08.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.431+0000 7f660e59c640 1 -- 172.21.15.28:0/245012778 learned_addr learned my addr 172.21.15.28:0/245012778 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:08.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.431+0000 7f660e59c640 1 -- 172.21.15.28:0/245012778 >> v2:172.21.15.28:3300/0 conn(0x7f661006d8c0 msgr2=0x7f661014e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-16T02:29:08.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.431+0000 7f660e59c640 1 -- 172.21.15.28:0/245012778 >> v2:172.21.15.28:3300/0 conn(0x7f661006d8c0 msgr2=0x7f661014e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-16T02:29:08.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.431+0000 7f660e59c640 1 --2- 172.21.15.28:0/245012778 >> v2:172.21.15.28:3300/0 conn(0x7f661006d8c0 0x7f661014e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-16T02:29:08.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.431+0000 7f660e59c640 1 --2- 172.21.15.28:0/245012778 >> v2:172.21.15.28:3300/0 conn(0x7f661006d8c0 0x7f661014e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-16T02:29:08.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.431+0000 7f660ed9d640 1 --2- 172.21.15.28:0/245012778 >> v2:172.21.15.70:3300/0 conn(0x7f661006cc40 0x7f661014ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:08.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.431+0000 7f660dd9b640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 0x7f661006b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:08.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.431+0000 7f660ed9d640 1 -- 172.21.15.28:0/245012778 >> v2:172.21.15.70:3300/0 conn(0x7f661006cc40 msgr2=0x7f661014ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-16T02:29:08.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.431+0000 7f660ed9d640 1 -- 172.21.15.28:0/245012778 >> v2:172.21.15.70:3300/0 conn(0x7f661006cc40 msgr2=0x7f661014ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-16T02:29:08.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.431+0000 7f660ed9d640 1 --2- 172.21.15.28:0/245012778 >> v2:172.21.15.70:3300/0 conn(0x7f661006cc40 0x7f661014ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-16T02:29:08.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.431+0000 7f660ed9d640 1 --2- 172.21.15.28:0/245012778 >> v2:172.21.15.70:3300/0 conn(0x7f661006cc40 0x7f661014ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-16T02:29:08.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.431+0000 7f660dd9b640 1 -- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 msgr2=0x7f661006b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-16T02:29:08.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.431+0000 7f660dd9b640 1 -- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 msgr2=0x7f661006b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-16T02:29:08.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.431+0000 7f660dd9b640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 0x7f661006b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-16T02:29:08.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.431+0000 7f660dd9b640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 0x7f661006b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-16T02:29:08.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.635+0000 7f660e59c640 1 --2- 172.21.15.28:0/245012778 >> v2:172.21.15.28:3300/0 conn(0x7f661006d8c0 0x7f661014e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:08.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.635+0000 7f660ed9d640 1 --2- 172.21.15.28:0/245012778 >> v2:172.21.15.70:3300/0 conn(0x7f661006cc40 0x7f661014ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:08.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.635+0000 7f660dd9b640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 0x7f661006b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:08.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.635+0000 7f660e59c640 1 -- 172.21.15.28:0/245012778 >> v2:172.21.15.28:3300/0 conn(0x7f661006d8c0 msgr2=0x7f661014e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-16T02:29:08.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.635+0000 7f660e59c640 1 -- 172.21.15.28:0/245012778 >> v2:172.21.15.28:3300/0 conn(0x7f661006d8c0 msgr2=0x7f661014e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-16T02:29:08.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.635+0000 7f660e59c640 1 --2- 172.21.15.28:0/245012778 >> v2:172.21.15.28:3300/0 conn(0x7f661006d8c0 0x7f661014e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-16T02:29:08.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.635+0000 7f660e59c640 1 --2- 172.21.15.28:0/245012778 >> v2:172.21.15.28:3300/0 conn(0x7f661006d8c0 0x7f661014e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-16T02:29:08.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.635+0000 7f660ed9d640 1 -- 172.21.15.28:0/245012778 >> v2:172.21.15.70:3300/0 conn(0x7f661006cc40 msgr2=0x7f661014ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-16T02:29:08.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.635+0000 7f660ed9d640 1 -- 172.21.15.28:0/245012778 >> v2:172.21.15.70:3300/0 conn(0x7f661006cc40 msgr2=0x7f661014ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-16T02:29:08.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.635+0000 7f660ed9d640 1 --2- 172.21.15.28:0/245012778 >> v2:172.21.15.70:3300/0 conn(0x7f661006cc40 0x7f661014ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-16T02:29:08.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.635+0000 7f660ed9d640 1 --2- 172.21.15.28:0/245012778 >> v2:172.21.15.70:3300/0 conn(0x7f661006cc40 0x7f661014ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-16T02:29:08.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.635+0000 7f660dd9b640 1 -- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 msgr2=0x7f661006b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-16T02:29:08.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.635+0000 7f660dd9b640 1 -- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 msgr2=0x7f661006b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-16T02:29:08.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.635+0000 7f660dd9b640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 0x7f661006b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-16T02:29:08.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:08.635+0000 7f660dd9b640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 0x7f661006b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-16T02:29:09.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.039+0000 7f660e59c640 1 --2- 172.21.15.28:0/245012778 >> v2:172.21.15.28:3300/0 conn(0x7f661006d8c0 0x7f661014e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:09.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.039+0000 7f660ed9d640 1 --2- 172.21.15.28:0/245012778 >> v2:172.21.15.70:3300/0 conn(0x7f661006cc40 0x7f661014ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:09.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.039+0000 7f660dd9b640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 0x7f661006b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:09.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.039+0000 7f660e59c640 1 -- 172.21.15.28:0/245012778 >> v2:172.21.15.28:3300/0 conn(0x7f661006d8c0 msgr2=0x7f661014e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-16T02:29:09.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.039+0000 7f660e59c640 1 -- 172.21.15.28:0/245012778 >> v2:172.21.15.28:3300/0 conn(0x7f661006d8c0 msgr2=0x7f661014e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-16T02:29:09.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.039+0000 7f660e59c640 1 --2- 172.21.15.28:0/245012778 >> v2:172.21.15.28:3300/0 conn(0x7f661006d8c0 0x7f661014e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-16T02:29:09.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.039+0000 7f660ed9d640 1 -- 172.21.15.28:0/245012778 >> v2:172.21.15.70:3300/0 conn(0x7f661006cc40 msgr2=0x7f661014ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-16T02:29:09.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.039+0000 7f660ed9d640 1 -- 172.21.15.28:0/245012778 >> v2:172.21.15.70:3300/0 conn(0x7f661006cc40 msgr2=0x7f661014ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-16T02:29:09.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.039+0000 7f660e59c640 1 --2- 172.21.15.28:0/245012778 >> v2:172.21.15.28:3300/0 conn(0x7f661006d8c0 0x7f661014e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-16T02:29:09.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.039+0000 7f660ed9d640 1 --2- 172.21.15.28:0/245012778 >> v2:172.21.15.70:3300/0 conn(0x7f661006cc40 0x7f661014ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-16T02:29:09.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.039+0000 7f660ed9d640 1 --2- 172.21.15.28:0/245012778 >> v2:172.21.15.70:3300/0 conn(0x7f661006cc40 0x7f661014ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-16T02:29:09.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.039+0000 7f660dd9b640 1 -- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 msgr2=0x7f661006b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-16T02:29:09.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.039+0000 7f660dd9b640 1 -- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 msgr2=0x7f661006b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-16T02:29:09.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.039+0000 7f660dd9b640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 0x7f661006b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-16T02:29:09.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.039+0000 7f660dd9b640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 0x7f661006b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-16T02:29:09.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.843+0000 7f660e59c640 1 --2- 172.21.15.28:0/245012778 >> v2:172.21.15.28:3300/0 conn(0x7f661006d8c0 0x7f661014e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:09.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.843+0000 7f660dd9b640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 0x7f661006b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:09.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.843+0000 7f660ed9d640 1 --2- 172.21.15.28:0/245012778 >> v2:172.21.15.70:3300/0 conn(0x7f661006cc40 0x7f661014ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:09.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.843+0000 7f660e59c640 1 -- 172.21.15.28:0/245012778 >> v2:172.21.15.28:3300/0 conn(0x7f661006d8c0 msgr2=0x7f661014e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-16T02:29:09.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.843+0000 7f660e59c640 1 -- 172.21.15.28:0/245012778 >> v2:172.21.15.28:3300/0 conn(0x7f661006d8c0 msgr2=0x7f661014e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-16T02:29:09.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.843+0000 7f660e59c640 1 --2- 172.21.15.28:0/245012778 >> v2:172.21.15.28:3300/0 conn(0x7f661006d8c0 0x7f661014e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-16T02:29:09.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.843+0000 7f660e59c640 1 --2- 172.21.15.28:0/245012778 >> v2:172.21.15.28:3300/0 conn(0x7f661006d8c0 0x7f661014e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-16T02:29:09.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.843+0000 7f660dd9b640 1 -- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 msgr2=0x7f661006b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-16T02:29:09.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.843+0000 7f660dd9b640 1 -- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 msgr2=0x7f661006b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-16T02:29:09.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.843+0000 7f660dd9b640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 0x7f661006b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-16T02:29:09.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.843+0000 7f660dd9b640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 0x7f661006b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-16T02:29:09.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.843+0000 7f660ed9d640 1 -- 172.21.15.28:0/245012778 >> v2:172.21.15.70:3300/0 conn(0x7f661006cc40 msgr2=0x7f661014ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-16T02:29:09.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.843+0000 7f660ed9d640 1 -- 172.21.15.28:0/245012778 >> v2:172.21.15.70:3300/0 conn(0x7f661006cc40 msgr2=0x7f661014ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-16T02:29:09.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.843+0000 7f660ed9d640 1 --2- 172.21.15.28:0/245012778 >> v2:172.21.15.70:3300/0 conn(0x7f661006cc40 0x7f661014ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-16T02:29:09.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:09.843+0000 7f660ed9d640 1 --2- 172.21.15.28:0/245012778 >> v2:172.21.15.70:3300/0 conn(0x7f661006cc40 0x7f661014ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-16T02:29:11.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:11.431+0000 7f65fffff640 1 -- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 msgr2=0x7f661006b310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-16T02:29:11.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:11.431+0000 7f65fffff640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 0x7f661006b310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:11.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:11.431+0000 7f65fffff640 1 -- 172.21.15.28:0/245012778 >> v2:172.21.15.70:3300/0 conn(0x7f661006cc40 msgr2=0x7f661014ab70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-16T02:29:11.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:11.431+0000 7f65fffff640 1 --2- 172.21.15.28:0/245012778 >> v2:172.21.15.70:3300/0 conn(0x7f661006cc40 0x7f661014ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:11.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:11.431+0000 7f65fffff640 1 -- 172.21.15.28:0/245012778 >> v2:172.21.15.28:3300/0 conn(0x7f661006d8c0 msgr2=0x7f661014e0b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-16T02:29:11.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:11.431+0000 7f65fffff640 1 --2- 172.21.15.28:0/245012778 >> v2:172.21.15.28:3300/0 conn(0x7f661006d8c0 0x7f661014e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:11.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:11.431+0000 7f65fffff640 1 -- 172.21.15.28:0/245012778 --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66100b5340 con 0x7f65f8003680 2023-11-16T02:29:11.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:11.431+0000 7f65fffff640 1 -- 172.21.15.28:0/245012778 --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f800c110 con 0x7f65f80073a0 2023-11-16T02:29:13.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.735+0000 7f660d59a640 1 -- 172.21.15.28:0/245012778 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497029440 0 0) 0x7f66100b5340 con 0x7f65f8003680 2023-11-16T02:29:13.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.735+0000 7f660d59a640 1 -- 172.21.15.28:0/245012778 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65f0003530 con 0x7f65f8003680 2023-11-16T02:29:13.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.739+0000 7f660d59a640 1 -- 172.21.15.28:0/245012778 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930863653 0 0) 0x7f65f800c110 con 0x7f65f80073a0 2023-11-16T02:29:13.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.739+0000 7f660d59a640 1 -- 172.21.15.28:0/245012778 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66100b5340 con 0x7f65f80073a0 2023-11-16T02:29:13.739 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.739+0000 7f660d59a640 1 -- 172.21.15.28:0/245012778 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2485965318 0 0) 0x7f65f0003530 con 0x7f65f8003680 2023-11-16T02:29:13.739 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.739+0000 7f660d59a640 1 -- 172.21.15.28:0/245012778 >> v1:172.21.15.70:6789/0 conn(0x7f65f80073a0 legacy=0x7f65f8009860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:13.739 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.739+0000 7f660d59a640 1 -- 172.21.15.28:0/245012778 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f800d310 con 0x7f65f8003680 2023-11-16T02:29:13.739 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.739+0000 7f660d59a640 1 -- 172.21.15.28:0/245012778 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7f660000c570 con 0x7f65f8003680 2023-11-16T02:29:13.739 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.739+0000 7f660d59a640 1 -- 172.21.15.28:0/245012778 >> v1:172.21.15.28:6789/0 conn(0x7f65f8003680 legacy=0x7f65f8005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:13.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.739+0000 7f660d59a640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 0x7f65f0003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:13.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.739+0000 7f660ed9d640 1 -- 172.21.15.28:0/245012778 reap_dead start 2023-11-16T02:29:13.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.739+0000 7f660d59a640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65f0004120 0x7f65f00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:13.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.739+0000 7f660d59a640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65f0004f10 0x7f65f000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:13.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.739+0000 7f660d59a640 1 -- 172.21.15.28:0/245012778 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f000bed0 con 0x7f65f0004f10 2023-11-16T02:29:13.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.739+0000 7f660d59a640 1 -- 172.21.15.28:0/245012778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f000c010 con 0x7f65f0004120 2023-11-16T02:29:13.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.739+0000 7f660d59a640 1 -- 172.21.15.28:0/245012778 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f000c150 con 0x7f66100ba600 2023-11-16T02:29:13.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.739+0000 7f660dd9b640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65f0004120 0x7f65f00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:13.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.739+0000 7f660e59c640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 0x7f65f0003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:13.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.739+0000 7f660ed9d640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65f0004f10 0x7f65f000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:13.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.739+0000 7f660dd9b640 1 -- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 msgr2=0x7f65f0003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:13.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.739+0000 7f660dd9b640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 0x7f65f0003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:13.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.739+0000 7f660dd9b640 1 -- 172.21.15.28:0/245012778 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65f0004f10 msgr2=0x7f65f000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:13.742 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.739+0000 7f660dd9b640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65f0004f10 0x7f65f000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:13.742 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.739+0000 7f660dd9b640 1 -- 172.21.15.28:0/245012778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f0003530 con 0x7f65f0004120 2023-11-16T02:29:13.742 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.739+0000 7f660e59c640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 0x7f65f0003b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-16T02:29:13.742 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.739+0000 7f660ed9d640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65f0004f10 0x7f65f000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-16T02:29:13.746 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.747+0000 7f660dd9b640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65f0004120 0x7f65f00047d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6604000ee0 tx=0x7f660401f980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a282398f9d1bc5dd server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:13.749 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.747+0000 7f660d59a640 1 -- 172.21.15.28:0/245012778 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66040ae630 con 0x7f65f0004120 2023-11-16T02:29:13.749 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.747+0000 7f660d59a640 1 -- 172.21.15.28:0/245012778 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660400c040 con 0x7f65f0004120 2023-11-16T02:29:13.749 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.747+0000 7f660d59a640 1 -- 172.21.15.28:0/245012778 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66040ae9f0 con 0x7f65f0004120 2023-11-16T02:29:13.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.751+0000 7f6614c71640 1 -- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65f0004120 msgr2=0x7f65f00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:13.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.751+0000 7f6614c71640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65f0004120 0x7f65f00047d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6604000ee0 tx=0x7f660401f980 comp rx=0 tx=0).stop 2023-11-16T02:29:13.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.751+0000 7f6614c71640 1 -- 172.21.15.28:0/245012778 shutdown_connections 2023-11-16T02:29:13.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.751+0000 7f6614c71640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65f0004f10 0x7f65f000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:13.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.751+0000 7f6614c71640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65f0004120 0x7f65f00047d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:13.752 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.751+0000 7f6614c71640 1 --2- 172.21.15.28:0/245012778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f66100ba600 0x7f65f0003b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:13.752 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.751+0000 7f6614c71640 1 -- 172.21.15.28:0/245012778 >> 172.21.15.28:0/245012778 conn(0x7f66100bac40 msgr2=0x7f66100bb050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:13.752 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.751+0000 7f6614c71640 1 -- 172.21.15.28:0/245012778 shutdown_connections 2023-11-16T02:29:13.752 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.751+0000 7f6614c71640 1 -- 172.21.15.28:0/245012778 wait complete. 2023-11-16T02:29:13.755 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.755+0000 7f6614c71640 1 Processor -- start 2023-11-16T02:29:13.755 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.755+0000 7f6614c71640 1 -- start start 2023-11-16T02:29:13.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.755+0000 7f6614c71640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f65f0004120 0x7f661014d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:13.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.755+0000 7f6614c71640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65f0004f10 0x7f6610149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:13.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.755+0000 7f6614c71640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66100ba600 0x7f66101e3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:13.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.755+0000 7f6614c71640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661014dad0 con 0x7f65f0004f10 2023-11-16T02:29:13.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.755+0000 7f6614c71640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661014abb0 con 0x7f66100ba600 2023-11-16T02:29:13.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.755+0000 7f6614c71640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66101489c0 con 0x7f65f0004120 2023-11-16T02:29:13.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.755+0000 7f660dd9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65f0004f10 0x7f6610149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:13.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.755+0000 7f660dd9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65f0004f10 0x7f6610149130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33116/0 (socket says 172.21.15.28:33116) 2023-11-16T02:29:13.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.755+0000 7f660dd9b640 1 -- 172.21.15.28:0/3331562120 learned_addr learned my addr 172.21.15.28:0/3331562120 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:13.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.755+0000 7f660ed9d640 1 --2- 172.21.15.28:0/3331562120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66100ba600 0x7f66101e3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:13.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.755+0000 7f660e59c640 1 --2- 172.21.15.28:0/3331562120 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f65f0004120 0x7f661014d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:13.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.755+0000 7f660dd9b640 1 -- 172.21.15.28:0/3331562120 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f65f0004120 msgr2=0x7f661014d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:13.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.755+0000 7f660dd9b640 1 --2- 172.21.15.28:0/3331562120 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f65f0004120 0x7f661014d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:13.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.755+0000 7f660dd9b640 1 -- 172.21.15.28:0/3331562120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66100ba600 msgr2=0x7f66101e3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:13.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.755+0000 7f660dd9b640 1 --2- 172.21.15.28:0/3331562120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66100ba600 0x7f66101e3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:13.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.755+0000 7f660dd9b640 1 -- 172.21.15.28:0/3331562120 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661014b8b0 con 0x7f65f0004f10 2023-11-16T02:29:13.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.759+0000 7f660dd9b640 1 --2- 172.21.15.28:0/3331562120 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65f0004f10 0x7f6610149130 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f660401f7b0 tx=0x7f65f0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:13.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.759+0000 7f65feffd640 1 -- 172.21.15.28:0/3331562120 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66040038e0 con 0x7f65f0004f10 2023-11-16T02:29:13.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.759+0000 7f65feffd640 1 -- 172.21.15.28:0/3331562120 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6604003a40 con 0x7f65f0004f10 2023-11-16T02:29:13.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.759+0000 7f6614c71640 1 -- 172.21.15.28:0/3331562120 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f661014a5f0 con 0x7f65f0004f10 2023-11-16T02:29:13.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.759+0000 7f65feffd640 1 -- 172.21.15.28:0/3331562120 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6604003dd0 con 0x7f65f0004f10 2023-11-16T02:29:13.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.759+0000 7f6614c71640 1 -- 172.21.15.28:0/3331562120 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6610148c10 con 0x7f65f0004f10 2023-11-16T02:29:13.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.759+0000 7f65feffd640 1 -- 172.21.15.28:0/3331562120 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f66040c8740 con 0x7f65f0004f10 2023-11-16T02:29:13.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.759+0000 7f65feffd640 1 -- 172.21.15.28:0/3331562120 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f66040bf9f0 con 0x7f65f0004f10 2023-11-16T02:29:13.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.759+0000 7f6614c71640 1 -- 172.21.15.28:0/3331562120 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f661004e8a0 con 0x7f65f0004f10 2023-11-16T02:29:13.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.775+0000 7f65feffd640 1 -- 172.21.15.28:0/3331562120 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f660400f040 con 0x7f65f0004f10 2023-11-16T02:29:13.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.843+0000 7f6614c71640 1 -- 172.21.15.28:0/3331562120 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f661004e8a0 con 0x7f65f0004f10 2023-11-16T02:29:13.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.851+0000 7f65feffd640 1 -- 172.21.15.28:0/3331562120 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f66040c8b80 con 0x7f65f0004f10 2023-11-16T02:29:13.850 INFO:teuthology.orchestra.run.smithi028.stderr:adjusted tunables profile to default 2023-11-16T02:29:13.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.851+0000 7f6614c71640 1 -- 172.21.15.28:0/3331562120 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65f0004f10 msgr2=0x7f6610149130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:13.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.851+0000 7f6614c71640 1 --2- 172.21.15.28:0/3331562120 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65f0004f10 0x7f6610149130 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f660401f7b0 tx=0x7f65f0005800 comp rx=0 tx=0).stop 2023-11-16T02:29:13.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.851+0000 7f6614c71640 1 -- 172.21.15.28:0/3331562120 shutdown_connections 2023-11-16T02:29:13.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.851+0000 7f6614c71640 1 --2- 172.21.15.28:0/3331562120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66100ba600 0x7f66101e3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:13.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.851+0000 7f6614c71640 1 --2- 172.21.15.28:0/3331562120 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f65f0004f10 0x7f6610149130 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:13.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.851+0000 7f6614c71640 1 --2- 172.21.15.28:0/3331562120 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f65f0004120 0x7f661014d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:13.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.851+0000 7f6614c71640 1 -- 172.21.15.28:0/3331562120 >> 172.21.15.28:0/3331562120 conn(0x7f66100bac40 msgr2=0x7f66100bb540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:13.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.851+0000 7f6614c71640 1 -- 172.21.15.28:0/3331562120 shutdown_connections 2023-11-16T02:29:13.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:13.851+0000 7f6614c71640 1 -- 172.21.15.28:0/3331562120 wait complete. 2023-11-16T02:29:13.875 INFO:tasks.ceph:check_enable_crimson: False 2023-11-16T02:29:13.875 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-16T02:29:13.875 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-16T02:29:13.875 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-16T02:29:13.889 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-16T02:29:13.889 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-16T02:29:13.941 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-16T02:29:13.941 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-16T02:29:13.975 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-16T02:29:13.975+0000 7f056ebda180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-16T02:29:13.986 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-16T02:29:13.986 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-16T02:29:14.045 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-16T02:29:14.045 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-16T02:29:14.059 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-16T02:29:14.059 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-16T02:29:14.115 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-16T02:29:14.115 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-16T02:29:14.174 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2023-11-16T02:29:14.174 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-16T02:29:14.230 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new dfa8b58d-3481-4e68-86e8-21873d31d0c3 0 2023-11-16T02:29:14.403 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.401+0000 7fe27a1aa640 1 Processor -- start 2023-11-16T02:29:14.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.401+0000 7fe27a1aa640 1 -- start start 2023-11-16T02:29:14.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.401+0000 7fe27a1aa640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe27406a170 0x7fe2740b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:14.404 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.401+0000 7fe27a1aa640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe274071800 con 0x7fe2740b7c60 2023-11-16T02:29:14.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.401+0000 7fe27a1aa640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2740b5ec0 con 0x7fe27406a550 2023-11-16T02:29:14.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.401+0000 7fe27a1aa640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2740b6350 con 0x7fe27406a170 2023-11-16T02:29:14.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.401+0000 7fe272ffd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fe27406a550 0x7fe274148a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:33278/0 (socket says 172.21.15.70:33278) 2023-11-16T02:29:14.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.401+0000 7fe272ffd640 1 -- 172.21.15.70:0/3985274481 learned_addr learned my addr 172.21.15.70:0/3985274481 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-16T02:29:14.405 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.401+0000 7fe2737fe640 1 --2- 172.21.15.70:0/3985274481 >> v2:172.21.15.28:3300/0 conn(0x7fe27406a170 0x7fe2740b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:14.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.401+0000 7fe2727fc640 1 -- 172.21.15.70:0/3985274481 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3521811696 0 0) 0x7fe2740b5ec0 con 0x7fe27406a550 2023-11-16T02:29:14.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.401+0000 7fe2727fc640 1 -- 172.21.15.70:0/3985274481 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe25c003530 con 0x7fe27406a550 2023-11-16T02:29:14.414 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.401+0000 7fe2727fc640 1 -- 172.21.15.70:0/3985274481 <== mon.1 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3656657833 0 0) 0x7fe25c003530 con 0x7fe27406a550 2023-11-16T02:29:14.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.401+0000 7fe2727fc640 1 -- 172.21.15.70:0/3985274481 >> v2:172.21.15.28:3300/0 conn(0x7fe27406a170 msgr2=0x7fe2740b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:14.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.401+0000 7fe2727fc640 1 --2- 172.21.15.70:0/3985274481 >> v2:172.21.15.28:3300/0 conn(0x7fe27406a170 0x7fe2740b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.401+0000 7fe2727fc640 1 -- 172.21.15.70:0/3985274481 >> v1:172.21.15.28:6789/0 conn(0x7fe2740b7c60 legacy=0x7fe274153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:14.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.401+0000 7fe2727fc640 1 -- 172.21.15.70:0/3985274481 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2740b5870 con 0x7fe27406a550 2023-11-16T02:29:14.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.401+0000 7fe2727fc640 1 -- 172.21.15.70:0/3985274481 <== mon.1 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7fe268001680 con 0x7fe27406a550 2023-11-16T02:29:14.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.401+0000 7fe2727fc640 1 -- 172.21.15.70:0/3985274481 >> v1:172.21.15.70:6789/0 conn(0x7fe27406a550 legacy=0x7fe274148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:14.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.401+0000 7fe2727fc640 1 --2- 172.21.15.70:0/3985274481 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe25c003980 0x7fe25c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:14.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe2727fc640 1 --2- 172.21.15.70:0/3985274481 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe25c0047d0 0x7fe25c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:14.415 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe2727fc640 1 --2- 172.21.15.70:0/3985274481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe25c005190 0x7fe25c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:14.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe2727fc640 1 -- 172.21.15.70:0/3985274481 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2740b6350 con 0x7fe25c003980 2023-11-16T02:29:14.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe2727fc640 1 -- 172.21.15.70:0/3985274481 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c00c130 con 0x7fe25c005190 2023-11-16T02:29:14.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe2727fc640 1 -- 172.21.15.70:0/3985274481 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c00c2f0 con 0x7fe25c0047d0 2023-11-16T02:29:14.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe272ffd640 1 --2- 172.21.15.70:0/3985274481 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe25c0047d0 0x7fe25c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:14.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe273fff640 1 --2- 172.21.15.70:0/3985274481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe25c005190 0x7fe25c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:14.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe2737fe640 1 --2- 172.21.15.70:0/3985274481 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe25c003980 0x7fe25c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:14.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe272ffd640 1 -- 172.21.15.70:0/3985274481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe25c005190 msgr2=0x7fe25c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:14.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe272ffd640 1 --2- 172.21.15.70:0/3985274481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe25c005190 0x7fe25c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.416 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe272ffd640 1 -- 172.21.15.70:0/3985274481 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe25c003980 msgr2=0x7fe25c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:14.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe272ffd640 1 --2- 172.21.15.70:0/3985274481 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe25c003980 0x7fe25c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe272ffd640 1 -- 172.21.15.70:0/3985274481 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25c003530 con 0x7fe25c0047d0 2023-11-16T02:29:14.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe2737fe640 1 --2- 172.21.15.70:0/3985274481 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe25c003980 0x7fe25c003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:29:14.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe273fff640 1 --2- 172.21.15.70:0/3985274481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe25c005190 0x7fe25c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-16T02:29:14.417 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe273fff640 1 -- 172.21.15.70:0/3985274481 reap_dead start 2023-11-16T02:29:14.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe272ffd640 1 --2- 172.21.15.70:0/3985274481 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe25c0047d0 0x7fe25c004c50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe26800c1c0 tx=0x7fe26801cbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b3f0975e210de2e server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:14.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe2727fc640 1 -- 172.21.15.70:0/3985274481 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe268005ae0 con 0x7fe25c0047d0 2023-11-16T02:29:14.418 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe2727fc640 1 -- 172.21.15.70:0/3985274481 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe268005c40 con 0x7fe25c0047d0 2023-11-16T02:29:14.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe2727fc640 1 -- 172.21.15.70:0/3985274481 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2680a5a10 con 0x7fe25c0047d0 2023-11-16T02:29:14.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe27a1aa640 1 -- 172.21.15.70:0/3985274481 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe25c0047d0 msgr2=0x7fe25c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:14.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe27a1aa640 1 --2- 172.21.15.70:0/3985274481 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe25c0047d0 0x7fe25c004c50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe26800c1c0 tx=0x7fe26801cbe0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe27a1aa640 1 -- 172.21.15.70:0/3985274481 shutdown_connections 2023-11-16T02:29:14.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe27a1aa640 1 --2- 172.21.15.70:0/3985274481 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe25c0047d0 0x7fe25c004c50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe27a1aa640 1 -- 172.21.15.70:0/3985274481 >> 172.21.15.70:0/3985274481 conn(0x7fe2740bc5a0 msgr2=0x7fe2740bc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:14.419 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe27a1aa640 1 -- 172.21.15.70:0/3985274481 shutdown_connections 2023-11-16T02:29:14.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.405+0000 7fe27a1aa640 1 -- 172.21.15.70:0/3985274481 wait complete. 2023-11-16T02:29:14.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe27a1aa640 1 Processor -- start 2023-11-16T02:29:14.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe27a1aa640 1 -- start start 2023-11-16T02:29:14.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe27a1aa640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe25c0047d0 0x7fe27414b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:14.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe27a1aa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe27414ac70 0x7fe274149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:14.420 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe27a1aa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2741e0de0 0x7fe2741e1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:14.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe27a1aa640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe274140580 con 0x7fe27414ac70 2023-11-16T02:29:14.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe27a1aa640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27414bb50 con 0x7fe2741e0de0 2023-11-16T02:29:14.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe27a1aa640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27414a820 con 0x7fe25c0047d0 2023-11-16T02:29:14.421 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe273fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2741e0de0 0x7fe2741e1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:14.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe2737fe640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe25c0047d0 0x7fe27414b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:14.422 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe273fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2741e0de0 0x7fe2741e1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43156/0 (socket says 172.21.15.70:43156) 2023-11-16T02:29:14.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe273fff640 1 -- 172.21.15.70:0/2812019407 learned_addr learned my addr 172.21.15.70:0/2812019407 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-16T02:29:14.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe272ffd640 1 --2- 172.21.15.70:0/2812019407 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe27414ac70 0x7fe274149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:14.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe273fff640 1 -- 172.21.15.70:0/2812019407 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe25c0047d0 msgr2=0x7fe27414b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:14.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe273fff640 1 --2- 172.21.15.70:0/2812019407 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe25c0047d0 0x7fe27414b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe273fff640 1 -- 172.21.15.70:0/2812019407 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe27414ac70 msgr2=0x7fe274149bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:14.423 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe273fff640 1 --2- 172.21.15.70:0/2812019407 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe27414ac70 0x7fe274149bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe273fff640 1 -- 172.21.15.70:0/2812019407 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27413d470 con 0x7fe2741e0de0 2023-11-16T02:29:14.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe2737fe640 1 --2- 172.21.15.70:0/2812019407 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe25c0047d0 0x7fe27414b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-16T02:29:14.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe273fff640 1 --2- 172.21.15.70:0/2812019407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2741e0de0 0x7fe2741e1260 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe2740b89d0 tx=0x7fe26c00f9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:14.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe25bfff640 1 -- 172.21.15.70:0/2812019407 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26c0052e0 con 0x7fe2741e0de0 2023-11-16T02:29:14.424 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe25bfff640 1 -- 172.21.15.70:0/2812019407 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26c005440 con 0x7fe2741e0de0 2023-11-16T02:29:14.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe25bfff640 1 -- 172.21.15.70:0/2812019407 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26c003840 con 0x7fe2741e0de0 2023-11-16T02:29:14.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe27a1aa640 1 -- 172.21.15.70:0/2812019407 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe27413fd20 con 0x7fe2741e0de0 2023-11-16T02:29:14.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe27a1aa640 1 -- 172.21.15.70:0/2812019407 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2741d5e80 con 0x7fe2741e0de0 2023-11-16T02:29:14.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe25bfff640 1 -- 172.21.15.70:0/2812019407 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe26c003ca0 con 0x7fe2741e0de0 2023-11-16T02:29:14.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe25bfff640 1 -- 172.21.15.70:0/2812019407 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe26c01dd50 con 0x7fe2741e0de0 2023-11-16T02:29:14.425 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.409+0000 7fe27a1aa640 1 -- 172.21.15.70:0/2812019407 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe27404e8a0 con 0x7fe2741e0de0 2023-11-16T02:29:14.426 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.413+0000 7fe25bfff640 1 -- 172.21.15.70:0/2812019407 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fe274071800 con 0x7fe2741e0de0 2023-11-16T02:29:14.483 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.481+0000 7fe27a1aa640 1 -- 172.21.15.70:0/2812019407 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dfa8b58d-3481-4e68-86e8-21873d31d0c3", "id": 0} v 0) v1 -- 0x7fe2740ba170 con 0x7fe2741e0de0 2023-11-16T02:29:14.490 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.489+0000 7fe25bfff640 1 -- 172.21.15.70:0/2812019407 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dfa8b58d-3481-4e68-86e8-21873d31d0c3", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe26c01d460 con 0x7fe2741e0de0 2023-11-16T02:29:14.490 INFO:teuthology.orchestra.run.smithi070.stdout:0 2023-11-16T02:29:14.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.489+0000 7fe27a1aa640 1 -- 172.21.15.70:0/2812019407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2741e0de0 msgr2=0x7fe2741e1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:14.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.489+0000 7fe27a1aa640 1 --2- 172.21.15.70:0/2812019407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2741e0de0 0x7fe2741e1260 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe2740b89d0 tx=0x7fe26c00f9d0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.489+0000 7fe27a1aa640 1 -- 172.21.15.70:0/2812019407 shutdown_connections 2023-11-16T02:29:14.491 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.489+0000 7fe27a1aa640 1 --2- 172.21.15.70:0/2812019407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2741e0de0 0x7fe2741e1260 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.489+0000 7fe27a1aa640 1 --2- 172.21.15.70:0/2812019407 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe27414ac70 0x7fe274149bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.489+0000 7fe27a1aa640 1 --2- 172.21.15.70:0/2812019407 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe25c0047d0 0x7fe27414b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.489+0000 7fe27a1aa640 1 -- 172.21.15.70:0/2812019407 >> 172.21.15.70:0/2812019407 conn(0x7fe2740bc5a0 msgr2=0x7fe274142590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:14.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.489+0000 7fe27a1aa640 1 -- 172.21.15.70:0/2812019407 shutdown_connections 2023-11-16T02:29:14.492 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.489+0000 7fe27a1aa640 1 -- 172.21.15.70:0/2812019407 wait complete. 2023-11-16T02:29:14.494 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-16T02:29:14.491+0000 7f056ebda180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-16T02:29:14.508 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new 1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c 1 2023-11-16T02:29:14.620 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-11-16T02:29:14.617+0000 7f1e919f3180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-16T02:29:14.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.621+0000 7f05a4181640 1 Processor -- start 2023-11-16T02:29:14.624 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.621+0000 7f05a4181640 1 -- start start 2023-11-16T02:29:14.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.625+0000 7f05a4181640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f059c065b90 0x7f059c06af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:14.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.625+0000 7f05a4181640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f059c1448a0 0x7f059c144d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:14.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.625+0000 7f05a4181640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f059c071060 con 0x7f059c14e490 2023-11-16T02:29:14.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.625+0000 7f05a4181640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f059c0705c0 con 0x7f059c065b90 2023-11-16T02:29:14.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.625+0000 7f05a4181640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c145240 con 0x7f059c1448a0 2023-11-16T02:29:14.626 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.625+0000 7f05a171c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f059c1448a0 0x7f059c144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:14.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.625+0000 7f05a171c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f059c1448a0 0x7f059c144d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:41730/0 (socket says 172.21.15.70:41730) 2023-11-16T02:29:14.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.625+0000 7f05a171c640 1 -- 172.21.15.70:0/2498557624 learned_addr learned my addr 172.21.15.70:0/2498557624 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-16T02:29:14.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.625+0000 7f05a1f1d640 1 --2- 172.21.15.70:0/2498557624 >> v2:172.21.15.28:3300/0 conn(0x7f059c065b90 0x7f059c06af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:14.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.625+0000 7f05a171c640 1 -- 172.21.15.70:0/2498557624 >> v2:172.21.15.28:3300/0 conn(0x7f059c065b90 msgr2=0x7f059c06af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:14.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.625+0000 7f05a171c640 1 --2- 172.21.15.70:0/2498557624 >> v2:172.21.15.28:3300/0 conn(0x7f059c065b90 0x7f059c06af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.625+0000 7f05a171c640 1 -- 172.21.15.70:0/2498557624 >> v1:172.21.15.28:6789/0 conn(0x7f059c14e490 legacy=0x7f059c14e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:14.627 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.625+0000 7f05a171c640 1 -- 172.21.15.70:0/2498557624 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c0707c0 con 0x7f059c1448a0 2023-11-16T02:29:14.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.625+0000 7f05a171c640 1 --2- 172.21.15.70:0/2498557624 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f059c1448a0 0x7f059c144d00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0598009870 tx=0x7f059801ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91b44fe1e3021e54 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:14.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.625+0000 7f05a0f1b640 1 -- 172.21.15.70:0/2498557624 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05980a89b0 con 0x7f059c1448a0 2023-11-16T02:29:14.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.625+0000 7f05a0f1b640 1 -- 172.21.15.70:0/2498557624 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05980a8b10 con 0x7f059c1448a0 2023-11-16T02:29:14.629 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.625+0000 7f05a0f1b640 1 -- 172.21.15.70:0/2498557624 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05980a8ea0 con 0x7f059c1448a0 2023-11-16T02:29:14.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a4181640 1 -- 172.21.15.70:0/2498557624 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f059c1448a0 msgr2=0x7f059c144d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:14.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a4181640 1 --2- 172.21.15.70:0/2498557624 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f059c1448a0 0x7f059c144d00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0598009870 tx=0x7f059801ecf0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a4181640 1 -- 172.21.15.70:0/2498557624 shutdown_connections 2023-11-16T02:29:14.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a4181640 1 --2- 172.21.15.70:0/2498557624 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f059c1448a0 0x7f059c144d00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.630 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a4181640 1 --2- 172.21.15.70:0/2498557624 >> v2:172.21.15.28:3300/0 conn(0x7f059c065b90 0x7f059c06af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a4181640 1 -- 172.21.15.70:0/2498557624 >> 172.21.15.70:0/2498557624 conn(0x7f059c069d70 msgr2=0x7f059c06a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:14.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a4181640 1 -- 172.21.15.70:0/2498557624 shutdown_connections 2023-11-16T02:29:14.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a4181640 1 -- 172.21.15.70:0/2498557624 wait complete. 2023-11-16T02:29:14.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a4181640 1 Processor -- start 2023-11-16T02:29:14.631 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a4181640 1 -- start start 2023-11-16T02:29:14.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a4181640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f059c065b90 0x7f059c1e0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:14.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a4181640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f059c1448a0 0x7f059c1e2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:14.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a4181640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f059c14e490 0x7f059c0b8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:14.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a4181640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0b8d60 con 0x7f059c065b90 2023-11-16T02:29:14.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a4181640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c1e3e10 con 0x7f059c14e490 2023-11-16T02:29:14.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a4181640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c1dfa20 con 0x7f059c1448a0 2023-11-16T02:29:14.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a171c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f059c1448a0 0x7f059c1e2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:14.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a271e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f059c14e490 0x7f059c0b8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:14.634 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a171c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f059c1448a0 0x7f059c1e2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:41732/0 (socket says 172.21.15.70:41732) 2023-11-16T02:29:14.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a171c640 1 -- 172.21.15.70:0/2563490193 learned_addr learned my addr 172.21.15.70:0/2563490193 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-16T02:29:14.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a271e640 1 --2- 172.21.15.70:0/2563490193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f059c14e490 0x7f059c0b8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43168/0 (socket says 172.21.15.70:43168) 2023-11-16T02:29:14.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a1f1d640 1 --2- 172.21.15.70:0/2563490193 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f059c065b90 0x7f059c1e0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:14.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a171c640 1 -- 172.21.15.70:0/2563490193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f059c14e490 msgr2=0x7f059c0b8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:14.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a171c640 1 --2- 172.21.15.70:0/2563490193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f059c14e490 0x7f059c0b8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a171c640 1 -- 172.21.15.70:0/2563490193 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f059c065b90 msgr2=0x7f059c1e0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:14.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a171c640 1 --2- 172.21.15.70:0/2563490193 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f059c065b90 0x7f059c1e0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a171c640 1 -- 172.21.15.70:0/2563490193 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05980094d0 con 0x7f059c1448a0 2023-11-16T02:29:14.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a171c640 1 --2- 172.21.15.70:0/2563490193 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f059c1448a0 0x7f059c1e2e80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f05980b3040 tx=0x7f059801ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:14.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05927fc640 1 -- 172.21.15.70:0/2563490193 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05980a89b0 con 0x7f059c1448a0 2023-11-16T02:29:14.635 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05927fc640 1 -- 172.21.15.70:0/2563490193 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05980bb480 con 0x7f059c1448a0 2023-11-16T02:29:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a4181640 1 -- 172.21.15.70:0/2563490193 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059c1dfd00 con 0x7f059c1448a0 2023-11-16T02:29:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05927fc640 1 -- 172.21.15.70:0/2563490193 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05980bb830 con 0x7f059c1448a0 2023-11-16T02:29:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05a4181640 1 -- 172.21.15.70:0/2563490193 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059c0b6370 con 0x7f059c1448a0 2023-11-16T02:29:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05927fc640 1 -- 172.21.15.70:0/2563490193 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f05980bbc90 con 0x7f059c1448a0 2023-11-16T02:29:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.629+0000 7f05927fc640 1 -- 172.21.15.70:0/2563490193 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f05980ba3e0 con 0x7f059c1448a0 2023-11-16T02:29:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.633+0000 7f05a4181640 1 -- 172.21.15.70:0/2563490193 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059c04e8a0 con 0x7f059c1448a0 2023-11-16T02:29:14.653 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.649+0000 7f05927fc640 1 -- 172.21.15.70:0/2563490193 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f05980b5070 con 0x7f059c1448a0 2023-11-16T02:29:14.704 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-16T02:29:14.703+0000 7f056ebda180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-16T02:29:14.721 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.717+0000 7f05a4181640 1 -- 172.21.15.70:0/2563490193 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c", "id": 1} v 0) v1 -- 0x7f059c14ba60 con 0x7f059c1448a0 2023-11-16T02:29:14.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.725+0000 7f05927fc640 1 -- 172.21.15.70:0/2563490193 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f059c071060 con 0x7f059c1448a0 2023-11-16T02:29:14.728 INFO:teuthology.orchestra.run.smithi070.stdout:1 2023-11-16T02:29:14.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.725+0000 7f05a4181640 1 -- 172.21.15.70:0/2563490193 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f059c1448a0 msgr2=0x7f059c1e2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:14.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.725+0000 7f05a4181640 1 --2- 172.21.15.70:0/2563490193 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f059c1448a0 0x7f059c1e2e80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f05980b3040 tx=0x7f059801ba90 comp rx=0 tx=0).stop 2023-11-16T02:29:14.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.725+0000 7f05a4181640 1 -- 172.21.15.70:0/2563490193 shutdown_connections 2023-11-16T02:29:14.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.725+0000 7f05a4181640 1 --2- 172.21.15.70:0/2563490193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f059c14e490 0x7f059c0b8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.725+0000 7f05a4181640 1 --2- 172.21.15.70:0/2563490193 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f059c1448a0 0x7f059c1e2e80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.725+0000 7f05a4181640 1 --2- 172.21.15.70:0/2563490193 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f059c065b90 0x7f059c1e0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.725+0000 7f05a4181640 1 -- 172.21.15.70:0/2563490193 >> 172.21.15.70:0/2563490193 conn(0x7f059c069d70 msgr2=0x7f059c0ba630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:14.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.725+0000 7f05a4181640 1 -- 172.21.15.70:0/2563490193 shutdown_connections 2023-11-16T02:29:14.730 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.725+0000 7f05a4181640 1 -- 172.21.15.70:0/2563490193 wait complete. 2023-11-16T02:29:14.747 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new e18f39cd-6a35-4d36-9eed-3877794bf2d3 2 2023-11-16T02:29:14.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.865+0000 7f6aa338d640 1 Processor -- start 2023-11-16T02:29:14.867 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.865+0000 7f6aa338d640 1 -- start start 2023-11-16T02:29:14.868 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.865+0000 7f6aa338d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6a9c06a170 0x7f6a9c0b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.865+0000 7f6aa338d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6a9c06a550 0x7f6a9c148a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.865+0000 7f6aa338d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9c071800 con 0x7f6a9c148fa0 2023-11-16T02:29:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.865+0000 7f6aa338d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9c0b5ec0 con 0x7f6a9c06a170 2023-11-16T02:29:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.865+0000 7f6aa338d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c0b6350 con 0x7f6a9c06a550 2023-11-16T02:29:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.865+0000 7f6aa0928640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6a9c06a550 0x7f6a9c148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.865+0000 7f6aa0928640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6a9c06a550 0x7f6a9c148a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:41734/0 (socket says 172.21.15.70:41734) 2023-11-16T02:29:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.865+0000 7f6aa0928640 1 -- 172.21.15.70:0/76468195 learned_addr learned my addr 172.21.15.70:0/76468195 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-16T02:29:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.865+0000 7f6aa192a640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f6a9c148fa0 0x7f6a9c0b7c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:33288/0 (socket says 172.21.15.70:33288) 2023-11-16T02:29:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.865+0000 7f6aa1129640 1 --2- 172.21.15.70:0/76468195 >> v2:172.21.15.28:3300/0 conn(0x7f6a9c06a170 0x7f6a9c0b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.865+0000 7f6aa0928640 1 -- 172.21.15.70:0/76468195 >> v2:172.21.15.28:3300/0 conn(0x7f6a9c06a170 msgr2=0x7f6a9c0b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:14.869 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.865+0000 7f6aa0928640 1 --2- 172.21.15.70:0/76468195 >> v2:172.21.15.28:3300/0 conn(0x7f6a9c06a170 0x7f6a9c0b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.865+0000 7f6aa0928640 1 -- 172.21.15.70:0/76468195 >> v1:172.21.15.70:6789/0 conn(0x7f6a9c148fa0 legacy=0x7f6a9c0b7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:14.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.865+0000 7f6aa0928640 1 -- 172.21.15.70:0/76468195 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c0b5870 con 0x7f6a9c06a550 2023-11-16T02:29:14.870 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.869+0000 7f6aa0928640 1 --2- 172.21.15.70:0/76468195 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6a9c06a550 0x7f6a9c148a60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c009870 tx=0x7f6a8c01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b37e155967692d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:14.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.869+0000 7f6a93fff640 1 -- 172.21.15.70:0/76468195 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c0ab650 con 0x7f6a9c06a550 2023-11-16T02:29:14.871 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.869+0000 7f6a93fff640 1 -- 172.21.15.70:0/76468195 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8c0ab7b0 con 0x7f6a9c06a550 2023-11-16T02:29:14.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.869+0000 7f6a93fff640 1 -- 172.21.15.70:0/76468195 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c0abb40 con 0x7f6a9c06a550 2023-11-16T02:29:14.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.869+0000 7f6aa338d640 1 -- 172.21.15.70:0/76468195 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6a9c06a550 msgr2=0x7f6a9c148a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:14.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.869+0000 7f6aa338d640 1 --2- 172.21.15.70:0/76468195 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6a9c06a550 0x7f6a9c148a60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c009870 tx=0x7f6a8c01c4b0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.869+0000 7f6aa338d640 1 -- 172.21.15.70:0/76468195 shutdown_connections 2023-11-16T02:29:14.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.869+0000 7f6aa338d640 1 --2- 172.21.15.70:0/76468195 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6a9c06a550 0x7f6a9c148a60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.869+0000 7f6aa338d640 1 --2- 172.21.15.70:0/76468195 >> v2:172.21.15.28:3300/0 conn(0x7f6a9c06a170 0x7f6a9c0b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.869+0000 7f6aa338d640 1 -- 172.21.15.70:0/76468195 >> 172.21.15.70:0/76468195 conn(0x7f6a9c0bc5a0 msgr2=0x7f6a9c0bc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:14.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.869+0000 7f6aa338d640 1 -- 172.21.15.70:0/76468195 shutdown_connections 2023-11-16T02:29:14.872 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.869+0000 7f6aa338d640 1 -- 172.21.15.70:0/76468195 wait complete. 2023-11-16T02:29:14.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.869+0000 7f6aa338d640 1 Processor -- start 2023-11-16T02:29:14.874 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.869+0000 7f6aa338d640 1 -- start start 2023-11-16T02:29:14.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.869+0000 7f6aa338d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a9c06a170 0x7f6a9c14ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:14.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.869+0000 7f6aa338d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a9c06a550 0x7f6a9c13a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:14.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.869+0000 7f6aa338d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6a9c148fa0 0x7f6a9c1da8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:14.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.869+0000 7f6aa338d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c13a620 con 0x7f6a9c06a550 2023-11-16T02:29:14.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.869+0000 7f6aa338d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c14a130 con 0x7f6a9c06a170 2023-11-16T02:29:14.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.869+0000 7f6aa338d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c1dadf0 con 0x7f6a9c148fa0 2023-11-16T02:29:14.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.869+0000 7f6aa1129640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a9c06a170 0x7f6a9c14ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:14.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.869+0000 7f6aa192a640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6a9c148fa0 0x7f6a9c1da8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:14.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.869+0000 7f6aa1129640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a9c06a170 0x7f6a9c14ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43170/0 (socket says 172.21.15.70:43170) 2023-11-16T02:29:14.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.869+0000 7f6aa1129640 1 -- 172.21.15.70:0/639474334 learned_addr learned my addr 172.21.15.70:0/639474334 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-16T02:29:14.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.873+0000 7f6aa0928640 1 --2- 172.21.15.70:0/639474334 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a9c06a550 0x7f6a9c13a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:14.875 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.873+0000 7f6aa192a640 1 -- 172.21.15.70:0/639474334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a9c06a170 msgr2=0x7f6a9c14ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:14.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.873+0000 7f6aa192a640 1 --2- 172.21.15.70:0/639474334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a9c06a170 0x7f6a9c14ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.873+0000 7f6aa192a640 1 -- 172.21.15.70:0/639474334 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a9c06a550 msgr2=0x7f6a9c13a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:14.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.873+0000 7f6aa192a640 1 --2- 172.21.15.70:0/639474334 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a9c06a550 0x7f6a9c13a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.873+0000 7f6aa192a640 1 -- 172.21.15.70:0/639474334 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c0094d0 con 0x7f6a9c148fa0 2023-11-16T02:29:14.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.873+0000 7f6aa192a640 1 --2- 172.21.15.70:0/639474334 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6a9c148fa0 0x7f6a9c1da8b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6a9400c730 tx=0x7f6a9400cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:14.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.873+0000 7f6a91ffb640 1 -- 172.21.15.70:0/639474334 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9400ce40 con 0x7f6a9c148fa0 2023-11-16T02:29:14.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.873+0000 7f6a91ffb640 1 -- 172.21.15.70:0/639474334 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9400a640 con 0x7f6a9c148fa0 2023-11-16T02:29:14.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.873+0000 7f6aa338d640 1 -- 172.21.15.70:0/639474334 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9c149e90 con 0x7f6a9c148fa0 2023-11-16T02:29:14.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.873+0000 7f6a91ffb640 1 -- 172.21.15.70:0/639474334 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9400a9b0 con 0x7f6a9c148fa0 2023-11-16T02:29:14.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.873+0000 7f6aa338d640 1 -- 172.21.15.70:0/639474334 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9c14a900 con 0x7f6a9c148fa0 2023-11-16T02:29:14.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.873+0000 7f6a91ffb640 1 -- 172.21.15.70:0/639474334 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6a940070f0 con 0x7f6a9c148fa0 2023-11-16T02:29:14.876 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.873+0000 7f6a91ffb640 1 -- 172.21.15.70:0/639474334 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f6a9401c860 con 0x7f6a9c148fa0 2023-11-16T02:29:14.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.873+0000 7f6aa338d640 1 -- 172.21.15.70:0/639474334 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a9c14aaf0 con 0x7f6a9c148fa0 2023-11-16T02:29:14.878 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.873+0000 7f6a91ffb640 1 -- 172.21.15.70:0/639474334 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f6a94021060 con 0x7f6a9c148fa0 2023-11-16T02:29:14.945 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.941+0000 7f6aa338d640 1 -- 172.21.15.70:0/639474334 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e18f39cd-6a35-4d36-9eed-3877794bf2d3", "id": 2} v 0) v1 -- 0x7f6a9c04e8a0 con 0x7f6a9c148fa0 2023-11-16T02:29:14.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.949+0000 7f6a91ffb640 1 -- 172.21.15.70:0/639474334 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e18f39cd-6a35-4d36-9eed-3877794bf2d3", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6a94017070 con 0x7f6a9c148fa0 2023-11-16T02:29:14.953 INFO:teuthology.orchestra.run.smithi070.stdout:2 2023-11-16T02:29:14.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.949+0000 7f6aa338d640 1 -- 172.21.15.70:0/639474334 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6a9c148fa0 msgr2=0x7f6a9c1da8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:14.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.949+0000 7f6aa338d640 1 --2- 172.21.15.70:0/639474334 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6a9c148fa0 0x7f6a9c1da8b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6a9400c730 tx=0x7f6a9400cbf0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.949+0000 7f6aa338d640 1 -- 172.21.15.70:0/639474334 shutdown_connections 2023-11-16T02:29:14.955 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.949+0000 7f6aa338d640 1 --2- 172.21.15.70:0/639474334 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6a9c148fa0 0x7f6a9c1da8b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.949+0000 7f6aa338d640 1 --2- 172.21.15.70:0/639474334 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a9c06a550 0x7f6a9c13a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.949+0000 7f6aa338d640 1 --2- 172.21.15.70:0/639474334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a9c06a170 0x7f6a9c14ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:14.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.949+0000 7f6aa338d640 1 -- 172.21.15.70:0/639474334 >> 172.21.15.70:0/639474334 conn(0x7f6a9c0bc5a0 msgr2=0x7f6a9c0b78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:14.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.953+0000 7f6aa338d640 1 -- 172.21.15.70:0/639474334 shutdown_connections 2023-11-16T02:29:14.956 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:14.953+0000 7f6aa338d640 1 -- 172.21.15.70:0/639474334 wait complete. 2023-11-16T02:29:14.969 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new 303d0728-409d-47d7-b7a6-6eb273f602fe 3 2023-11-16T02:29:15.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.081+0000 7f240600e640 1 Processor -- start 2023-11-16T02:29:15.084 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.081+0000 7f240600e640 1 -- start start 2023-11-16T02:29:15.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.081+0000 7f240600e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2400141b40 0x7f240006ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:15.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.081+0000 7f240600e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f240006fea0 0x7f2400070300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:15.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.081+0000 7f240600e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24000b4270 con 0x7f240014aec0 2023-11-16T02:29:15.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.081+0000 7f240600e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2400070840 con 0x7f2400141b40 2023-11-16T02:29:15.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.081+0000 7f240600e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2400071c70 con 0x7f240006fea0 2023-11-16T02:29:15.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.085+0000 7f23feffd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f240006fea0 0x7f2400070300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:15.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.085+0000 7f23feffd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f240006fea0 0x7f2400070300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:41760/0 (socket says 172.21.15.70:41760) 2023-11-16T02:29:15.086 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.085+0000 7f23feffd640 1 -- 172.21.15.70:0/1832167070 learned_addr learned my addr 172.21.15.70:0/1832167070 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-16T02:29:15.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.085+0000 7f23ff7fe640 1 --2- 172.21.15.70:0/1832167070 >> v2:172.21.15.28:3300/0 conn(0x7f2400141b40 0x7f240006ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:15.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.085+0000 7f23feffd640 1 -- 172.21.15.70:0/1832167070 >> v2:172.21.15.28:3300/0 conn(0x7f2400141b40 msgr2=0x7f240006ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:15.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.085+0000 7f23feffd640 1 --2- 172.21.15.70:0/1832167070 >> v2:172.21.15.28:3300/0 conn(0x7f2400141b40 0x7f240006ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.085+0000 7f23feffd640 1 -- 172.21.15.70:0/1832167070 >> v1:172.21.15.28:6789/0 conn(0x7f240014aec0 legacy=0x7f240014b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:15.087 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.085+0000 7f23feffd640 1 -- 172.21.15.70:0/1832167070 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2400141f20 con 0x7f240006fea0 2023-11-16T02:29:15.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.085+0000 7f23feffd640 1 --2- 172.21.15.70:0/1832167070 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f240006fea0 0x7f2400070300 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009870 tx=0x7f23f401ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=238da0b6402e3e60 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:15.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.085+0000 7f23fe7fc640 1 -- 172.21.15.70:0/1832167070 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f40a89b0 con 0x7f240006fea0 2023-11-16T02:29:15.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.085+0000 7f23fe7fc640 1 -- 172.21.15.70:0/1832167070 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f40a8b10 con 0x7f240006fea0 2023-11-16T02:29:15.088 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.085+0000 7f23fe7fc640 1 -- 172.21.15.70:0/1832167070 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f40a8ea0 con 0x7f240006fea0 2023-11-16T02:29:15.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.085+0000 7f240600e640 1 -- 172.21.15.70:0/1832167070 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f240006fea0 msgr2=0x7f2400070300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:15.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.085+0000 7f240600e640 1 --2- 172.21.15.70:0/1832167070 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f240006fea0 0x7f2400070300 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009870 tx=0x7f23f401ecf0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.085+0000 7f240600e640 1 -- 172.21.15.70:0/1832167070 shutdown_connections 2023-11-16T02:29:15.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.085+0000 7f240600e640 1 --2- 172.21.15.70:0/1832167070 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f240006fea0 0x7f2400070300 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.085+0000 7f240600e640 1 --2- 172.21.15.70:0/1832167070 >> v2:172.21.15.28:3300/0 conn(0x7f2400141b40 0x7f240006ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.089 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.085+0000 7f240600e640 1 -- 172.21.15.70:0/1832167070 >> 172.21.15.70:0/1832167070 conn(0x7f24000bd310 msgr2=0x7f24000bd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:15.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.085+0000 7f240600e640 1 -- 172.21.15.70:0/1832167070 shutdown_connections 2023-11-16T02:29:15.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.085+0000 7f240600e640 1 -- 172.21.15.70:0/1832167070 wait complete. 2023-11-16T02:29:15.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f240600e640 1 Processor -- start 2023-11-16T02:29:15.090 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f240600e640 1 -- start start 2023-11-16T02:29:15.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f240600e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f240006fea0 0x7f24001e1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:15.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f240600e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2400141b40 0x7f24001dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:15.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f240600e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f240014aec0 0x7f24000b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:15.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f240600e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24000b7400 con 0x7f240014aec0 2023-11-16T02:29:15.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f240600e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24001e09d0 con 0x7f2400141b40 2023-11-16T02:29:15.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f240600e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24001e0c40 con 0x7f240006fea0 2023-11-16T02:29:15.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f23ff7fe640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f240006fea0 0x7f24001e1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:15.092 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f23ff7fe640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f240006fea0 0x7f24001e1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:41774/0 (socket says 172.21.15.70:41774) 2023-11-16T02:29:15.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f23ff7fe640 1 -- 172.21.15.70:0/1950774506 learned_addr learned my addr 172.21.15.70:0/1950774506 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-16T02:29:15.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f23feffd640 1 --2- 172.21.15.70:0/1950774506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2400141b40 0x7f24001dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:15.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f23fffff640 1 --2- 172.21.15.70:0/1950774506 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f240014aec0 0x7f24000b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:15.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f23ff7fe640 1 -- 172.21.15.70:0/1950774506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2400141b40 msgr2=0x7f24001dd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:15.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f23ff7fe640 1 --2- 172.21.15.70:0/1950774506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2400141b40 0x7f24001dd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f23ff7fe640 1 -- 172.21.15.70:0/1950774506 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f240014aec0 msgr2=0x7f24000b6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:15.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f23ff7fe640 1 --2- 172.21.15.70:0/1950774506 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f240014aec0 0x7f24000b6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f23ff7fe640 1 -- 172.21.15.70:0/1950774506 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f40094d0 con 0x7f240006fea0 2023-11-16T02:29:15.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f23ff7fe640 1 --2- 172.21.15.70:0/1950774506 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f240006fea0 0x7f24001e1440 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f23f000d800 tx=0x7f23f000dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:15.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f23e7fff640 1 -- 172.21.15.70:0/1950774506 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f000b6c0 con 0x7f240006fea0 2023-11-16T02:29:15.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f23e7fff640 1 -- 172.21.15.70:0/1950774506 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f000b820 con 0x7f240006fea0 2023-11-16T02:29:15.093 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f240600e640 1 -- 172.21.15.70:0/1950774506 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24001e0f20 con 0x7f240006fea0 2023-11-16T02:29:15.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f23e7fff640 1 -- 172.21.15.70:0/1950774506 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f000bb90 con 0x7f240006fea0 2023-11-16T02:29:15.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f240600e640 1 -- 172.21.15.70:0/1950774506 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2400148990 con 0x7f240006fea0 2023-11-16T02:29:15.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f23e7fff640 1 -- 172.21.15.70:0/1950774506 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f23f001e460 con 0x7f240006fea0 2023-11-16T02:29:15.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f23e7fff640 1 -- 172.21.15.70:0/1950774506 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f23f0014a00 con 0x7f240006fea0 2023-11-16T02:29:15.094 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.089+0000 7f240600e640 1 -- 172.21.15.70:0/1950774506 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f240004e8a0 con 0x7f240006fea0 2023-11-16T02:29:15.096 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.093+0000 7f23e7fff640 1 -- 172.21.15.70:0/1950774506 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f23f0014bc0 con 0x7f240006fea0 2023-11-16T02:29:15.165 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.161+0000 7f240600e640 1 -- 172.21.15.70:0/1950774506 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd new", "uuid": "303d0728-409d-47d7-b7a6-6eb273f602fe", "id": 3} v 0) v1 -- 0x7f240006c120 con 0x7f240006fea0 2023-11-16T02:29:15.173 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.169+0000 7f23e7fff640 1 -- 172.21.15.70:0/1950774506 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "303d0728-409d-47d7-b7a6-6eb273f602fe", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f23f0014570 con 0x7f240006fea0 2023-11-16T02:29:15.174 INFO:teuthology.orchestra.run.smithi070.stdout:3 2023-11-16T02:29:15.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.173+0000 7f240600e640 1 -- 172.21.15.70:0/1950774506 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f240006fea0 msgr2=0x7f24001e1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:15.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.173+0000 7f240600e640 1 --2- 172.21.15.70:0/1950774506 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f240006fea0 0x7f24001e1440 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f23f000d800 tx=0x7f23f000dcc0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.174 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.173+0000 7f240600e640 1 -- 172.21.15.70:0/1950774506 shutdown_connections 2023-11-16T02:29:15.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.173+0000 7f240600e640 1 --2- 172.21.15.70:0/1950774506 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f240014aec0 0x7f24000b6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.173+0000 7f240600e640 1 --2- 172.21.15.70:0/1950774506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2400141b40 0x7f24001dd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.173+0000 7f240600e640 1 --2- 172.21.15.70:0/1950774506 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f240006fea0 0x7f24001e1440 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.173+0000 7f240600e640 1 -- 172.21.15.70:0/1950774506 >> 172.21.15.70:0/1950774506 conn(0x7f24000bd310 msgr2=0x7f24000b79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:15.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.173+0000 7f240600e640 1 -- 172.21.15.70:0/1950774506 shutdown_connections 2023-11-16T02:29:15.175 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.173+0000 7f240600e640 1 -- 172.21.15.70:0/1950774506 wait complete. 2023-11-16T02:29:15.191 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new df0bf0ac-6efe-4964-ad27-7c1771a70c56 4 2023-11-16T02:29:15.193 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-11-16T02:29:15.189+0000 7f1e919f3180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-16T02:29:15.295 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-16T02:29:15.295+0000 7f056ebda180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-16T02:29:15.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.293+0000 7f3c4f33e640 1 Processor -- start 2023-11-16T02:29:15.297 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.297+0000 7f3c4f33e640 1 -- start start 2023-11-16T02:29:15.298 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.297+0000 7f3c4f33e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3c480b69b0 0x7f3c480b9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:15.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.297+0000 7f3c4f33e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3c48070560 0x7f3c48148970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:15.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.297+0000 7f3c4f33e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c480717d0 con 0x7f3c48071340 2023-11-16T02:29:15.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.297+0000 7f3c4f33e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c48070140 con 0x7f3c48070560 2023-11-16T02:29:15.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.297+0000 7f3c4f33e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c48148eb0 con 0x7f3c480b69b0 2023-11-16T02:29:15.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.297+0000 7f3c4d0da640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3c480b69b0 0x7f3c480b9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:15.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.297+0000 7f3c4d0da640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3c480b69b0 0x7f3c480b9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:41784/0 (socket says 172.21.15.70:41784) 2023-11-16T02:29:15.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.297+0000 7f3c4d0da640 1 -- 172.21.15.70:0/618705466 learned_addr learned my addr 172.21.15.70:0/618705466 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-16T02:29:15.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.297+0000 7f3c4d8db640 1 --2- 172.21.15.70:0/618705466 >> v2:172.21.15.28:3300/0 conn(0x7f3c48070560 0x7f3c48148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:15.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.297+0000 7f3c4d0da640 1 -- 172.21.15.70:0/618705466 >> v2:172.21.15.28:3300/0 conn(0x7f3c48070560 msgr2=0x7f3c48148970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:15.299 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.297+0000 7f3c4d0da640 1 --2- 172.21.15.70:0/618705466 >> v2:172.21.15.28:3300/0 conn(0x7f3c48070560 0x7f3c48148970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.297+0000 7f3c4d0da640 1 -- 172.21.15.70:0/618705466 >> v1:172.21.15.28:6789/0 conn(0x7f3c48071340 legacy=0x7f3c48142960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:15.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.297+0000 7f3c4d0da640 1 -- 172.21.15.70:0/618705466 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c48071ab0 con 0x7f3c480b69b0 2023-11-16T02:29:15.300 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.297+0000 7f3c4d0da640 1 --2- 172.21.15.70:0/618705466 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3c480b69b0 0x7f3c480b9570 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009870 tx=0x7f3c4401c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a10434e0b248dcbf server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:15.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.297+0000 7f3c3ffff640 1 -- 172.21.15.70:0/618705466 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c440ab600 con 0x7f3c480b69b0 2023-11-16T02:29:15.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.297+0000 7f3c3ffff640 1 -- 172.21.15.70:0/618705466 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c440a7050 con 0x7f3c480b69b0 2023-11-16T02:29:15.301 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.297+0000 7f3c3ffff640 1 -- 172.21.15.70:0/618705466 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c440ab980 con 0x7f3c480b69b0 2023-11-16T02:29:15.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.297+0000 7f3c4f33e640 1 -- 172.21.15.70:0/618705466 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3c480b69b0 msgr2=0x7f3c480b9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:15.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.297+0000 7f3c4f33e640 1 --2- 172.21.15.70:0/618705466 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3c480b69b0 0x7f3c480b9570 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009870 tx=0x7f3c4401c500 comp rx=0 tx=0).stop 2023-11-16T02:29:15.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.297+0000 7f3c4f33e640 1 -- 172.21.15.70:0/618705466 shutdown_connections 2023-11-16T02:29:15.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.297+0000 7f3c4f33e640 1 --2- 172.21.15.70:0/618705466 >> v2:172.21.15.28:3300/0 conn(0x7f3c48070560 0x7f3c48148970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c4f33e640 1 --2- 172.21.15.70:0/618705466 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3c480b69b0 0x7f3c480b9570 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c4f33e640 1 -- 172.21.15.70:0/618705466 >> 172.21.15.70:0/618705466 conn(0x7f3c480bd310 msgr2=0x7f3c480bd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:15.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c4f33e640 1 -- 172.21.15.70:0/618705466 shutdown_connections 2023-11-16T02:29:15.302 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c4f33e640 1 -- 172.21.15.70:0/618705466 wait complete. 2023-11-16T02:29:15.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c4f33e640 1 Processor -- start 2023-11-16T02:29:15.303 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c4f33e640 1 -- start start 2023-11-16T02:29:15.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c4f33e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3c48070560 0x7f3c4813b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:15.305 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c4f33e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c480b69b0 0x7f3c4813b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:15.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c4f33e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c481e1270 0x7f3c481e16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:15.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c4f33e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c481e0de0 con 0x7f3c480b69b0 2023-11-16T02:29:15.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c4f33e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c48143490 con 0x7f3c481e1270 2023-11-16T02:29:15.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c4f33e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c481e1c20 con 0x7f3c48070560 2023-11-16T02:29:15.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c4d0da640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3c48070560 0x7f3c4813b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:15.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c4d0da640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3c48070560 0x7f3c4813b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:41796/0 (socket says 172.21.15.70:41796) 2023-11-16T02:29:15.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c4d0da640 1 -- 172.21.15.70:0/3011381250 learned_addr learned my addr 172.21.15.70:0/3011381250 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-16T02:29:15.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c4d8db640 1 --2- 172.21.15.70:0/3011381250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c481e1270 0x7f3c481e16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:15.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c4c8d9640 1 --2- 172.21.15.70:0/3011381250 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c480b69b0 0x7f3c4813b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:15.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c4d0da640 1 -- 172.21.15.70:0/3011381250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c481e1270 msgr2=0x7f3c481e16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:15.306 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c4d0da640 1 --2- 172.21.15.70:0/3011381250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c481e1270 0x7f3c481e16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c4d0da640 1 -- 172.21.15.70:0/3011381250 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c480b69b0 msgr2=0x7f3c4813b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:15.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c4d0da640 1 --2- 172.21.15.70:0/3011381250 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c480b69b0 0x7f3c4813b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c4d0da640 1 -- 172.21.15.70:0/3011381250 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c440094d0 con 0x7f3c48070560 2023-11-16T02:29:15.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c4d0da640 1 --2- 172.21.15.70:0/3011381250 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3c48070560 0x7f3c4813b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3c440ae040 tx=0x7f3c440192a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:15.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c3dffb640 1 -- 172.21.15.70:0/3011381250 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c440ba070 con 0x7f3c48070560 2023-11-16T02:29:15.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c3dffb640 1 -- 172.21.15.70:0/3011381250 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c440ac030 con 0x7f3c48070560 2023-11-16T02:29:15.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c4f33e640 1 -- 172.21.15.70:0/3011381250 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4813adb0 con 0x7f3c48070560 2023-11-16T02:29:15.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c3dffb640 1 -- 172.21.15.70:0/3011381250 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c440b6440 con 0x7f3c48070560 2023-11-16T02:29:15.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c4f33e640 1 -- 172.21.15.70:0/3011381250 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c48139eb0 con 0x7f3c48070560 2023-11-16T02:29:15.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c3dffb640 1 -- 172.21.15.70:0/3011381250 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3c440b2040 con 0x7f3c48070560 2023-11-16T02:29:15.307 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.301+0000 7f3c3dffb640 1 -- 172.21.15.70:0/3011381250 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f3c440b49e0 con 0x7f3c48070560 2023-11-16T02:29:15.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.305+0000 7f3c4f33e640 1 -- 172.21.15.70:0/3011381250 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c481e0f90 con 0x7f3c48070560 2023-11-16T02:29:15.308 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.305+0000 7f3c3dffb640 1 -- 172.21.15.70:0/3011381250 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f3c481e0f90 con 0x7f3c48070560 2023-11-16T02:29:15.351 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-16T02:29:15.351+0000 7f056ebda180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-16T02:29:15.375 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.373+0000 7f3c4f33e640 1 -- 172.21.15.70:0/3011381250 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd new", "uuid": "df0bf0ac-6efe-4964-ad27-7c1771a70c56", "id": 4} v 0) v1 -- 0x7f3c4804e8a0 con 0x7f3c48070560 2023-11-16T02:29:15.379 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-11-16T02:29:15.377+0000 7f1e919f3180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-16T02:29:15.383 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.381+0000 7f3c3dffb640 1 -- 172.21.15.70:0/3011381250 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "df0bf0ac-6efe-4964-ad27-7c1771a70c56", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3c440b0070 con 0x7f3c48070560 2023-11-16T02:29:15.383 INFO:teuthology.orchestra.run.smithi070.stdout:4 2023-11-16T02:29:15.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.381+0000 7f3c4f33e640 1 -- 172.21.15.70:0/3011381250 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3c48070560 msgr2=0x7f3c4813b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:15.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.381+0000 7f3c4f33e640 1 --2- 172.21.15.70:0/3011381250 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3c48070560 0x7f3c4813b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3c440ae040 tx=0x7f3c440192a0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.381+0000 7f3c4f33e640 1 -- 172.21.15.70:0/3011381250 shutdown_connections 2023-11-16T02:29:15.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.381+0000 7f3c4f33e640 1 --2- 172.21.15.70:0/3011381250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c481e1270 0x7f3c481e16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.381+0000 7f3c4f33e640 1 --2- 172.21.15.70:0/3011381250 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c480b69b0 0x7f3c4813b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.384 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.381+0000 7f3c4f33e640 1 --2- 172.21.15.70:0/3011381250 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3c48070560 0x7f3c4813b480 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.381+0000 7f3c4f33e640 1 -- 172.21.15.70:0/3011381250 >> 172.21.15.70:0/3011381250 conn(0x7f3c480bd310 msgr2=0x7f3c4806af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:15.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.381+0000 7f3c4f33e640 1 -- 172.21.15.70:0/3011381250 shutdown_connections 2023-11-16T02:29:15.385 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.381+0000 7f3c4f33e640 1 -- 172.21.15.70:0/3011381250 wait complete. 2023-11-16T02:29:15.399 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new 84921219-65cb-4c4e-b9ed-a773db639034 5 2023-11-16T02:29:15.406 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-16T02:29:15.407+0000 7f056ebda180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-16T02:29:15.486 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-16T02:29:15.487+0000 7f056ebda180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-16T02:29:15.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.509+0000 7efde5834640 1 Processor -- start 2023-11-16T02:29:15.512 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.509+0000 7efde5834640 1 -- start start 2023-11-16T02:29:15.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.509+0000 7efde5834640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7efde00ba470 0x7efde0154270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:15.513 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.509+0000 7efde5834640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde006eef0 con 0x7efde006d8c0 2023-11-16T02:29:15.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.509+0000 7efde5834640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde006e6e0 con 0x7efde006dca0 2023-11-16T02:29:15.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.509+0000 7efde5834640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde00ba0e0 con 0x7efde00ba470 2023-11-16T02:29:15.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.509+0000 7efddf7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7efde00ba470 0x7efde0154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:15.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.509+0000 7efdde7fc640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7efde006dca0 0x7efde0148900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:33290/0 (socket says 172.21.15.70:33290) 2023-11-16T02:29:15.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.509+0000 7efdde7fc640 1 -- 172.21.15.70:0/535687938 learned_addr learned my addr 172.21.15.70:0/535687938 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-16T02:29:15.514 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.513+0000 7efddf7fe640 1 -- 172.21.15.70:0/535687938 >> v1:172.21.15.70:6789/0 conn(0x7efde006dca0 legacy=0x7efde0148900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:15.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.513+0000 7efddf7fe640 1 -- 172.21.15.70:0/535687938 >> v1:172.21.15.28:6789/0 conn(0x7efde006d8c0 legacy=0x7efde00a3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:15.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.513+0000 7efdddffb640 1 -- 172.21.15.70:0/535687938 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3766390187 0 0) 0x7efde006e6e0 con 0x7efde006dca0 2023-11-16T02:29:15.515 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.513+0000 7efddf7fe640 1 -- 172.21.15.70:0/535687938 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde006e930 con 0x7efde00ba470 2023-11-16T02:29:15.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.513+0000 7efddf7fe640 1 --2- 172.21.15.70:0/535687938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efde00ba470 0x7efde0154270 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efdd8009d90 tx=0x7efdd801f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cf3612e2915a4c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:15.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.513+0000 7efdddffb640 1 -- 172.21.15.70:0/535687938 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd80af600 con 0x7efde00ba470 2023-11-16T02:29:15.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.513+0000 7efdddffb640 1 -- 172.21.15.70:0/535687938 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd80ab050 con 0x7efde00ba470 2023-11-16T02:29:15.516 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.513+0000 7efdddffb640 1 -- 172.21.15.70:0/535687938 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd80af980 con 0x7efde00ba470 2023-11-16T02:29:15.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.513+0000 7efde5834640 1 -- 172.21.15.70:0/535687938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efde00ba470 msgr2=0x7efde0154270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:15.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.513+0000 7efde5834640 1 --2- 172.21.15.70:0/535687938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efde00ba470 0x7efde0154270 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efdd8009d90 tx=0x7efdd801f130 comp rx=0 tx=0).stop 2023-11-16T02:29:15.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.513+0000 7efde5834640 1 -- 172.21.15.70:0/535687938 shutdown_connections 2023-11-16T02:29:15.517 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.513+0000 7efde5834640 1 --2- 172.21.15.70:0/535687938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efde00ba470 0x7efde0154270 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.513+0000 7efde5834640 1 -- 172.21.15.70:0/535687938 >> 172.21.15.70:0/535687938 conn(0x7efde00bac40 msgr2=0x7efde00bb050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:15.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.513+0000 7efde5834640 1 -- 172.21.15.70:0/535687938 shutdown_connections 2023-11-16T02:29:15.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.513+0000 7efde5834640 1 -- 172.21.15.70:0/535687938 wait complete. 2023-11-16T02:29:15.518 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efde5834640 1 Processor -- start 2023-11-16T02:29:15.519 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efde5834640 1 -- start start 2023-11-16T02:29:15.522 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efde5834640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efde006d8c0 0x7efde013e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:15.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efde5834640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efde006dca0 0x7efde013fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:15.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efde5834640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efde00ba470 0x7efde01e1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:15.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efde5834640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde013f490 con 0x7efde00ba470 2023-11-16T02:29:15.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efde5834640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde0149f40 con 0x7efde006dca0 2023-11-16T02:29:15.523 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efde5834640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde014bd20 con 0x7efde006d8c0 2023-11-16T02:29:15.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efdde7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efde006dca0 0x7efde013fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:15.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efdde7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efde006dca0 0x7efde013fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43214/0 (socket says 172.21.15.70:43214) 2023-11-16T02:29:15.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efdde7fc640 1 -- 172.21.15.70:0/3124268854 learned_addr learned my addr 172.21.15.70:0/3124268854 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-16T02:29:15.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efddeffd640 1 --2- 172.21.15.70:0/3124268854 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efde006d8c0 0x7efde013e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:15.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efddf7fe640 1 --2- 172.21.15.70:0/3124268854 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efde00ba470 0x7efde01e1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:15.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efdde7fc640 1 -- 172.21.15.70:0/3124268854 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efde006d8c0 msgr2=0x7efde013e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:15.524 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efdde7fc640 1 --2- 172.21.15.70:0/3124268854 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efde006d8c0 0x7efde013e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efdde7fc640 1 -- 172.21.15.70:0/3124268854 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efde00ba470 msgr2=0x7efde01e1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:15.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efdde7fc640 1 --2- 172.21.15.70:0/3124268854 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efde00ba470 0x7efde01e1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efdde7fc640 1 -- 172.21.15.70:0/3124268854 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd8009a70 con 0x7efde006dca0 2023-11-16T02:29:15.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efddeffd640 1 --2- 172.21.15.70:0/3124268854 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efde006d8c0 0x7efde013e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-16T02:29:15.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efdde7fc640 1 --2- 172.21.15.70:0/3124268854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efde006dca0 0x7efde013fb30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efdd000c4a0 tx=0x7efdd000c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:15.525 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efdd7fff640 1 -- 172.21.15.70:0/3124268854 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd00074e0 con 0x7efde006dca0 2023-11-16T02:29:15.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efdd7fff640 1 -- 172.21.15.70:0/3124268854 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd0007640 con 0x7efde006dca0 2023-11-16T02:29:15.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efdd7fff640 1 -- 172.21.15.70:0/3124268854 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd0004a30 con 0x7efde006dca0 2023-11-16T02:29:15.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efde5834640 1 -- 172.21.15.70:0/3124268854 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde013f1b0 con 0x7efde006dca0 2023-11-16T02:29:15.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efde5834640 1 -- 172.21.15.70:0/3124268854 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde014c9f0 con 0x7efde006dca0 2023-11-16T02:29:15.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efdd7fff640 1 -- 172.21.15.70:0/3124268854 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efdd0012400 con 0x7efde006dca0 2023-11-16T02:29:15.526 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.517+0000 7efdd7fff640 1 -- 172.21.15.70:0/3124268854 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7efdd0012c30 con 0x7efde006dca0 2023-11-16T02:29:15.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.521+0000 7efde5834640 1 -- 172.21.15.70:0/3124268854 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde01e15c0 con 0x7efde006dca0 2023-11-16T02:29:15.527 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.521+0000 7efdd7fff640 1 -- 172.21.15.70:0/3124268854 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7efde01e15c0 con 0x7efde006dca0 2023-11-16T02:29:15.540 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-16T02:29:15.539+0000 7f056ebda180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-16T02:29:15.588 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.585+0000 7efde5834640 1 -- 172.21.15.70:0/3124268854 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd new", "uuid": "84921219-65cb-4c4e-b9ed-a773db639034", "id": 5} v 0) v1 -- 0x7efde004e8a0 con 0x7efde006dca0 2023-11-16T02:29:15.595 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.593+0000 7efdd7fff640 1 -- 172.21.15.70:0/3124268854 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "84921219-65cb-4c4e-b9ed-a773db639034", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7efdd0018070 con 0x7efde006dca0 2023-11-16T02:29:15.596 INFO:teuthology.orchestra.run.smithi070.stdout:5 2023-11-16T02:29:15.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.593+0000 7efde5834640 1 -- 172.21.15.70:0/3124268854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efde006dca0 msgr2=0x7efde013fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:15.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.593+0000 7efde5834640 1 --2- 172.21.15.70:0/3124268854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efde006dca0 0x7efde013fb30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efdd000c4a0 tx=0x7efdd000c960 comp rx=0 tx=0).stop 2023-11-16T02:29:15.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.593+0000 7efde5834640 1 -- 172.21.15.70:0/3124268854 shutdown_connections 2023-11-16T02:29:15.597 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.593+0000 7efde5834640 1 --2- 172.21.15.70:0/3124268854 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efde00ba470 0x7efde01e1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.593+0000 7efde5834640 1 --2- 172.21.15.70:0/3124268854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efde006dca0 0x7efde013fb30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.593+0000 7efde5834640 1 --2- 172.21.15.70:0/3124268854 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efde006d8c0 0x7efde013e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.593+0000 7efde5834640 1 -- 172.21.15.70:0/3124268854 >> 172.21.15.70:0/3124268854 conn(0x7efde00bac40 msgr2=0x7efde00b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:15.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.593+0000 7efde5834640 1 -- 172.21.15.70:0/3124268854 shutdown_connections 2023-11-16T02:29:15.598 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.593+0000 7efde5834640 1 -- 172.21.15.70:0/3124268854 wait complete. 2023-11-16T02:29:15.611 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc 6 2023-11-16T02:29:15.620 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-16T02:29:15.619+0000 7f056ebda180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-16T02:29:15.674 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-16T02:29:15.671+0000 7f056ebda180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-16T02:29:15.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.721+0000 7fb3996a9640 1 Processor -- start 2023-11-16T02:29:15.724 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.721+0000 7fb3996a9640 1 -- start start 2023-11-16T02:29:15.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.721+0000 7fb3996a9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb3941415b0 0x7fb3940ba410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:15.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.721+0000 7fb3996a9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb3940b8340 0x7fb3940b87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:15.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.721+0000 7fb3996a9640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb39414e0f0 0x7fb39414e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:15.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.721+0000 7fb3996a9640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3940ba060 con 0x7fb3940b8340 2023-11-16T02:29:15.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.721+0000 7fb3996a9640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3940b9390 con 0x7fb3941415b0 2023-11-16T02:29:15.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.721+0000 7fb3996a9640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3940b8d10 con 0x7fb39414e0f0 2023-11-16T02:29:15.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.721+0000 7fb392ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb3941415b0 0x7fb3940ba410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:15.726 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.721+0000 7fb392ffd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb3941415b0 0x7fb3940ba410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43216/0 (socket says 172.21.15.70:43216) 2023-11-16T02:29:15.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.721+0000 7fb392ffd640 1 -- 172.21.15.70:0/2742219331 learned_addr learned my addr 172.21.15.70:0/2742219331 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-16T02:29:15.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.721+0000 7fb3937fe640 1 --2- 172.21.15.70:0/2742219331 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb39414e0f0 0x7fb39414e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:15.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.721+0000 7fb3927fc640 1 --2- 172.21.15.70:0/2742219331 >> v2:172.21.15.28:3300/0 conn(0x7fb3940b8340 0x7fb3940b87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:15.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.725+0000 7fb392ffd640 1 -- 172.21.15.70:0/2742219331 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb39414e0f0 msgr2=0x7fb39414e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:15.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.725+0000 7fb392ffd640 1 --2- 172.21.15.70:0/2742219331 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb39414e0f0 0x7fb39414e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.725+0000 7fb392ffd640 1 -- 172.21.15.70:0/2742219331 >> v2:172.21.15.28:3300/0 conn(0x7fb3940b8340 msgr2=0x7fb3940b87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:15.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.725+0000 7fb392ffd640 1 --2- 172.21.15.70:0/2742219331 >> v2:172.21.15.28:3300/0 conn(0x7fb3940b8340 0x7fb3940b87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.727 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.725+0000 7fb392ffd640 1 -- 172.21.15.70:0/2742219331 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3940b78a0 con 0x7fb3941415b0 2023-11-16T02:29:15.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.725+0000 7fb392ffd640 1 --2- 172.21.15.70:0/2742219331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3941415b0 0x7fb3940ba410 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb3940697c0 tx=0x7fb38401c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da2bf61e0fa9eef3 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:15.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.725+0000 7fb391ffb640 1 -- 172.21.15.70:0/2742219331 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3840a5810 con 0x7fb3941415b0 2023-11-16T02:29:15.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.725+0000 7fb391ffb640 1 -- 172.21.15.70:0/2742219331 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3840a5970 con 0x7fb3941415b0 2023-11-16T02:29:15.729 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.725+0000 7fb391ffb640 1 -- 172.21.15.70:0/2742219331 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3840a5d00 con 0x7fb3941415b0 2023-11-16T02:29:15.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.725+0000 7fb3996a9640 1 -- 172.21.15.70:0/2742219331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3941415b0 msgr2=0x7fb3940ba410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:15.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.725+0000 7fb3996a9640 1 --2- 172.21.15.70:0/2742219331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3941415b0 0x7fb3940ba410 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb3940697c0 tx=0x7fb38401c9d0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb3996a9640 1 -- 172.21.15.70:0/2742219331 shutdown_connections 2023-11-16T02:29:15.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb3996a9640 1 --2- 172.21.15.70:0/2742219331 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb39414e0f0 0x7fb39414e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb3996a9640 1 --2- 172.21.15.70:0/2742219331 >> v2:172.21.15.28:3300/0 conn(0x7fb3940b8340 0x7fb3940b87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb3996a9640 1 --2- 172.21.15.70:0/2742219331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3941415b0 0x7fb3940ba410 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb3996a9640 1 -- 172.21.15.70:0/2742219331 >> 172.21.15.70:0/2742219331 conn(0x7fb39406b7e0 msgr2=0x7fb39406bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:15.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb3996a9640 1 -- 172.21.15.70:0/2742219331 shutdown_connections 2023-11-16T02:29:15.731 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb3996a9640 1 -- 172.21.15.70:0/2742219331 wait complete. 2023-11-16T02:29:15.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb3996a9640 1 Processor -- start 2023-11-16T02:29:15.732 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb3996a9640 1 -- start start 2023-11-16T02:29:15.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb3996a9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3940b8340 0x7fb394143e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:15.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb3996a9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3941415b0 0x7fb39413f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:15.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb3996a9640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb39414e0f0 0x7fb394142c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:15.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb3996a9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb394139a80 con 0x7fb3941415b0 2023-11-16T02:29:15.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb3996a9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb394140d40 con 0x7fb3940b8340 2023-11-16T02:29:15.734 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb3996a9640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb394142140 con 0x7fb39414e0f0 2023-11-16T02:29:15.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb3937fe640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb39414e0f0 0x7fb394142c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:15.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb3937fe640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb39414e0f0 0x7fb394142c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:41812/0 (socket says 172.21.15.70:41812) 2023-11-16T02:29:15.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb3937fe640 1 -- 172.21.15.70:0/1853036808 learned_addr learned my addr 172.21.15.70:0/1853036808 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-16T02:29:15.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb392ffd640 1 --2- 172.21.15.70:0/1853036808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3940b8340 0x7fb394143e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:15.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb392ffd640 1 -- 172.21.15.70:0/1853036808 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb39414e0f0 msgr2=0x7fb394142c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:15.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb3927fc640 1 --2- 172.21.15.70:0/1853036808 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3941415b0 0x7fb39413f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:15.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb392ffd640 1 --2- 172.21.15.70:0/1853036808 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb39414e0f0 0x7fb394142c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb392ffd640 1 -- 172.21.15.70:0/1853036808 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3941415b0 msgr2=0x7fb39413f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:15.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb392ffd640 1 --2- 172.21.15.70:0/1853036808 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3941415b0 0x7fb39413f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb392ffd640 1 -- 172.21.15.70:0/1853036808 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb384009b30 con 0x7fb3940b8340 2023-11-16T02:29:15.735 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb3937fe640 1 --2- 172.21.15.70:0/1853036808 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb39414e0f0 0x7fb394142c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-16T02:29:15.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb392ffd640 1 --2- 172.21.15.70:0/1853036808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3940b8340 0x7fb394143e90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb3840ab000 tx=0x7fb384019770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:15.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb38b7fe640 1 -- 172.21.15.70:0/1853036808 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb384009510 con 0x7fb3940b8340 2023-11-16T02:29:15.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb38b7fe640 1 -- 172.21.15.70:0/1853036808 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3840b8680 con 0x7fb3940b8340 2023-11-16T02:29:15.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb3996a9640 1 -- 172.21.15.70:0/1853036808 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3941407d0 con 0x7fb3940b8340 2023-11-16T02:29:15.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb38b7fe640 1 -- 172.21.15.70:0/1853036808 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3840b8a50 con 0x7fb3940b8340 2023-11-16T02:29:15.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb3996a9640 1 -- 172.21.15.70:0/1853036808 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3941443d0 con 0x7fb3940b8340 2023-11-16T02:29:15.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb38b7fe640 1 -- 172.21.15.70:0/1853036808 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb3840c1410 con 0x7fb3940b8340 2023-11-16T02:29:15.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.729+0000 7fb38b7fe640 1 -- 172.21.15.70:0/1853036808 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fb3840b6a30 con 0x7fb3940b8340 2023-11-16T02:29:15.736 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.733+0000 7fb3996a9640 1 -- 172.21.15.70:0/1853036808 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb39404e8a0 con 0x7fb3940b8340 2023-11-16T02:29:15.737 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.733+0000 7fb38b7fe640 1 -- 172.21.15.70:0/1853036808 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fb3840bc030 con 0x7fb3940b8340 2023-11-16T02:29:15.816 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.813+0000 7fb3996a9640 1 -- 172.21.15.70:0/1853036808 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc", "id": 6} v 0) v1 -- 0x7fb39414e880 con 0x7fb3940b8340 2023-11-16T02:29:15.820 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-16T02:29:15.819+0000 7f056ebda180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-16T02:29:15.823 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.821+0000 7fb38b7fe640 1 -- 172.21.15.70:0/1853036808 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb3840b6cc0 con 0x7fb3940b8340 2023-11-16T02:29:15.823 INFO:teuthology.orchestra.run.smithi070.stdout:6 2023-11-16T02:29:15.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.821+0000 7fb3996a9640 1 -- 172.21.15.70:0/1853036808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3940b8340 msgr2=0x7fb394143e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:15.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.821+0000 7fb3996a9640 1 --2- 172.21.15.70:0/1853036808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3940b8340 0x7fb394143e90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb3840ab000 tx=0x7fb384019770 comp rx=0 tx=0).stop 2023-11-16T02:29:15.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.821+0000 7fb3996a9640 1 -- 172.21.15.70:0/1853036808 shutdown_connections 2023-11-16T02:29:15.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.821+0000 7fb3996a9640 1 --2- 172.21.15.70:0/1853036808 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb39414e0f0 0x7fb394142c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.821+0000 7fb3996a9640 1 --2- 172.21.15.70:0/1853036808 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3941415b0 0x7fb39413f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.821+0000 7fb3996a9640 1 --2- 172.21.15.70:0/1853036808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3940b8340 0x7fb394143e90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.821+0000 7fb3996a9640 1 -- 172.21.15.70:0/1853036808 >> 172.21.15.70:0/1853036808 conn(0x7fb39406b7e0 msgr2=0x7fb3940ba410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:15.825 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.821+0000 7fb3996a9640 1 -- 172.21.15.70:0/1853036808 shutdown_connections 2023-11-16T02:29:15.826 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.821+0000 7fb3996a9640 1 -- 172.21.15.70:0/1853036808 wait complete. 2023-11-16T02:29:15.839 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd new e2cdd418-12ce-4eea-9b22-efdad83eb76d 7 2023-11-16T02:29:15.882 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-16T02:29:15.883+0000 7f056ebda180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-16T02:29:15.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.945+0000 7fdcc01f0640 1 Processor -- start 2023-11-16T02:29:15.947 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.945+0000 7fdcc01f0640 1 -- start start 2023-11-16T02:29:15.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.945+0000 7fdcc01f0640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdcb806d8c0 0x7fdcb80ba470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:15.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.945+0000 7fdcc01f0640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdcb8148900 0x7fdcb8153260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:15.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.945+0000 7fdcc01f0640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb806eef0 con 0x7fdcb806dca0 2023-11-16T02:29:15.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.945+0000 7fdcc01f0640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb80ba0e0 con 0x7fdcb806d8c0 2023-11-16T02:29:15.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.945+0000 7fdcc01f0640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb806e6e0 con 0x7fdcb8148900 2023-11-16T02:29:15.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.945+0000 7fdcbe78d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdcb8148900 0x7fdcb8153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:15.948 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.945+0000 7fdcbd78b640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fdcb806dca0 0x7fdcb80a3cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:33298/0 (socket says 172.21.15.70:33298) 2023-11-16T02:29:15.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.945+0000 7fdcbd78b640 1 -- 172.21.15.70:0/2780757277 learned_addr learned my addr 172.21.15.70:0/2780757277 (peer_addr_for_me v1:172.21.15.70:0/0) 2023-11-16T02:29:15.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.945+0000 7fdcbdf8c640 1 --2- 172.21.15.70:0/2780757277 >> v2:172.21.15.28:3300/0 conn(0x7fdcb806d8c0 0x7fdcb80ba470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:15.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.945+0000 7fdcbe78d640 1 -- 172.21.15.70:0/2780757277 >> v2:172.21.15.28:3300/0 conn(0x7fdcb806d8c0 msgr2=0x7fdcb80ba470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:15.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.945+0000 7fdcbe78d640 1 --2- 172.21.15.70:0/2780757277 >> v2:172.21.15.28:3300/0 conn(0x7fdcb806d8c0 0x7fdcb80ba470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.945+0000 7fdcbe78d640 1 -- 172.21.15.70:0/2780757277 >> v1:172.21.15.70:6789/0 conn(0x7fdcb806dca0 legacy=0x7fdcb80a3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:15.949 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.945+0000 7fdcbe78d640 1 -- 172.21.15.70:0/2780757277 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb806e930 con 0x7fdcb8148900 2023-11-16T02:29:15.952 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcbe78d640 1 --2- 172.21.15.70:0/2780757277 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdcb8148900 0x7fdcb8153260 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0009d90 tx=0x7fdcb001f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=741622df6240326d server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:15.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcbcf8a640 1 -- 172.21.15.70:0/2780757277 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb00af600 con 0x7fdcb8148900 2023-11-16T02:29:15.953 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcbcf8a640 1 -- 172.21.15.70:0/2780757277 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb00ab050 con 0x7fdcb8148900 2023-11-16T02:29:15.954 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcbcf8a640 1 -- 172.21.15.70:0/2780757277 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb00af980 con 0x7fdcb8148900 2023-11-16T02:29:15.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcc01f0640 1 -- 172.21.15.70:0/2780757277 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdcb8148900 msgr2=0x7fdcb8153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:15.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcc01f0640 1 --2- 172.21.15.70:0/2780757277 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdcb8148900 0x7fdcb8153260 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0009d90 tx=0x7fdcb001f130 comp rx=0 tx=0).stop 2023-11-16T02:29:15.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcc01f0640 1 -- 172.21.15.70:0/2780757277 shutdown_connections 2023-11-16T02:29:15.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcc01f0640 1 --2- 172.21.15.70:0/2780757277 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdcb8148900 0x7fdcb8153260 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.957 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcc01f0640 1 --2- 172.21.15.70:0/2780757277 >> v2:172.21.15.28:3300/0 conn(0x7fdcb806d8c0 0x7fdcb80ba470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcc01f0640 1 -- 172.21.15.70:0/2780757277 >> 172.21.15.70:0/2780757277 conn(0x7fdcb80bac40 msgr2=0x7fdcb80bb050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:15.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcc01f0640 1 -- 172.21.15.70:0/2780757277 shutdown_connections 2023-11-16T02:29:15.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcc01f0640 1 -- 172.21.15.70:0/2780757277 wait complete. 2023-11-16T02:29:15.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcc01f0640 1 Processor -- start 2023-11-16T02:29:15.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcc01f0640 1 -- start start 2023-11-16T02:29:15.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcc01f0640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdcb806d8c0 0x7fdcb80a2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:15.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcc01f0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdcb806dca0 0x7fdcb8143700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:15.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcc01f0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcb8148900 0x7fdcb80b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:15.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcc01f0640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb80a2940 con 0x7fdcb806dca0 2023-11-16T02:29:15.958 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcc01f0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb80b84f0 con 0x7fdcb8148900 2023-11-16T02:29:15.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcc01f0640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb8143c40 con 0x7fdcb806d8c0 2023-11-16T02:29:15.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcbdf8c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdcb806d8c0 0x7fdcb80a2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:15.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcbe78d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcb8148900 0x7fdcb80b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:15.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcbdf8c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdcb806d8c0 0x7fdcb80a2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.70:41830/0 (socket says 172.21.15.70:41830) 2023-11-16T02:29:15.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcbdf8c640 1 -- 172.21.15.70:0/1455381975 learned_addr learned my addr 172.21.15.70:0/1455381975 (peer_addr_for_me v2:172.21.15.70:0/0) 2023-11-16T02:29:15.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcbd78b640 1 --2- 172.21.15.70:0/1455381975 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdcb806dca0 0x7fdcb8143700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:15.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcbdf8c640 1 -- 172.21.15.70:0/1455381975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcb8148900 msgr2=0x7fdcb80b5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:15.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcbdf8c640 1 --2- 172.21.15.70:0/1455381975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcb8148900 0x7fdcb80b5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcbdf8c640 1 -- 172.21.15.70:0/1455381975 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdcb806dca0 msgr2=0x7fdcb8143700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:15.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcbdf8c640 1 --2- 172.21.15.70:0/1455381975 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdcb806dca0 0x7fdcb8143700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:15.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcbdf8c640 1 -- 172.21.15.70:0/1455381975 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb0009a70 con 0x7fdcb806d8c0 2023-11-16T02:29:15.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcbe78d640 1 --2- 172.21.15.70:0/1455381975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcb8148900 0x7fdcb80b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-16T02:29:15.959 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcbd78b640 1 --2- 172.21.15.70:0/1455381975 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdcb806dca0 0x7fdcb8143700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:15.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcbdf8c640 1 --2- 172.21.15.70:0/1455381975 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdcb806d8c0 0x7fdcb80a2400 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400d830 tx=0x7fdcb400dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:15.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcae7fc640 1 -- 172.21.15.70:0/1455381975 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb400b6c0 con 0x7fdcb806d8c0 2023-11-16T02:29:15.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcae7fc640 1 -- 172.21.15.70:0/1455381975 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb400b820 con 0x7fdcb806d8c0 2023-11-16T02:29:15.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcc01f0640 1 -- 172.21.15.70:0/1455381975 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb81de640 con 0x7fdcb806d8c0 2023-11-16T02:29:15.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.949+0000 7fdcae7fc640 1 -- 172.21.15.70:0/1455381975 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb400bb90 con 0x7fdcb806d8c0 2023-11-16T02:29:15.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.953+0000 7fdcc01f0640 1 -- 172.21.15.70:0/1455381975 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb81ddd10 con 0x7fdcb806d8c0 2023-11-16T02:29:15.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.953+0000 7fdcae7fc640 1 -- 172.21.15.70:0/1455381975 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdcb401e760 con 0x7fdcb806d8c0 2023-11-16T02:29:15.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.953+0000 7fdcae7fc640 1 -- 172.21.15.70:0/1455381975 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fdcb4014db0 con 0x7fdcb806d8c0 2023-11-16T02:29:15.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.953+0000 7fdcc01f0640 1 -- 172.21.15.70:0/1455381975 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb804e8a0 con 0x7fdcb806d8c0 2023-11-16T02:29:15.960 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:15.953+0000 7fdcae7fc640 1 -- 172.21.15.70:0/1455381975 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fdcb4014750 con 0x7fdcb806d8c0 2023-11-16T02:29:15.998 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-11-16T02:29:15.997+0000 7f1e919f3180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-16T02:29:16.020 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:16.017+0000 7fdcc01f0640 1 -- 172.21.15.70:0/1455381975 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e2cdd418-12ce-4eea-9b22-efdad83eb76d", "id": 7} v 0) v1 -- 0x7fdcb806e4c0 con 0x7fdcb806d8c0 2023-11-16T02:29:16.027 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:16.025+0000 7fdcae7fc640 1 -- 172.21.15.70:0/1455381975 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e2cdd418-12ce-4eea-9b22-efdad83eb76d", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdcb40148f0 con 0x7fdcb806d8c0 2023-11-16T02:29:16.028 INFO:teuthology.orchestra.run.smithi070.stdout:7 2023-11-16T02:29:16.028 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:16.025+0000 7fdcc01f0640 1 -- 172.21.15.70:0/1455381975 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdcb806d8c0 msgr2=0x7fdcb80a2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:16.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:16.025+0000 7fdcc01f0640 1 --2- 172.21.15.70:0/1455381975 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdcb806d8c0 0x7fdcb80a2400 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400d830 tx=0x7fdcb400dcf0 comp rx=0 tx=0).stop 2023-11-16T02:29:16.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:16.025+0000 7fdcc01f0640 1 -- 172.21.15.70:0/1455381975 shutdown_connections 2023-11-16T02:29:16.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:16.025+0000 7fdcc01f0640 1 --2- 172.21.15.70:0/1455381975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcb8148900 0x7fdcb80b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:16.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:16.025+0000 7fdcc01f0640 1 --2- 172.21.15.70:0/1455381975 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdcb806dca0 0x7fdcb8143700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:16.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:16.025+0000 7fdcc01f0640 1 --2- 172.21.15.70:0/1455381975 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdcb806d8c0 0x7fdcb80a2400 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:16.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:16.025+0000 7fdcc01f0640 1 -- 172.21.15.70:0/1455381975 >> 172.21.15.70:0/1455381975 conn(0x7fdcb80bac40 msgr2=0x7fdcb80731d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:16.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:16.025+0000 7fdcc01f0640 1 -- 172.21.15.70:0/1455381975 shutdown_connections 2023-11-16T02:29:16.029 INFO:teuthology.orchestra.run.smithi070.stderr:2023-11-16T02:29:16.025+0000 7fdcc01f0640 1 -- 172.21.15.70:0/1455381975 wait complete. 2023-11-16T02:29:16.043 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-16T02:29:16.044 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-16T02:29:16.046 INFO:tasks.ceph.osd.0:Started 2023-11-16T02:29:16.046 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-16T02:29:16.046 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-16T02:29:16.048 INFO:tasks.ceph.osd.1:Started 2023-11-16T02:29:16.049 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-16T02:29:16.049 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-16T02:29:16.051 INFO:tasks.ceph.osd.2:Started 2023-11-16T02:29:16.051 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-16T02:29:16.051 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-16T02:29:16.053 INFO:tasks.ceph.osd.3:Started 2023-11-16T02:29:16.053 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-16T02:29:16.053 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-16T02:29:16.056 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-11-16T02:29:16.053+0000 7f1e919f3180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-16T02:29:16.056 INFO:tasks.ceph.osd.4:Started 2023-11-16T02:29:16.056 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-16T02:29:16.057 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-16T02:29:16.058 INFO:tasks.ceph.osd.5:Started 2023-11-16T02:29:16.058 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-16T02:29:16.059 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-16T02:29:16.060 INFO:tasks.ceph.osd.6:Started 2023-11-16T02:29:16.060 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-16T02:29:16.061 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-16T02:29:16.063 INFO:tasks.ceph.osd.7:Started 2023-11-16T02:29:16.068 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-16T02:29:16.121 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-11-16T02:29:16.121+0000 7f1e919f3180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-16T02:29:16.205 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-11-16T02:29:16.201+0000 7f1e919f3180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-16T02:29:16.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.219+0000 7f7888e2b640 1 Processor -- start 2023-11-16T02:29:16.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.219+0000 7f7888e2b640 1 -- start start 2023-11-16T02:29:16.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.219+0000 7f7888e2b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f78840b5dc0 0x7f78840b8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:16.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.219+0000 7f7888e2b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78840b93f0 0x7f7884146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:16.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.219+0000 7f7888e2b640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788406ee20 con 0x7f78841470f0 2023-11-16T02:29:16.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.219+0000 7f7888e2b640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7884071290 con 0x7f78840b5dc0 2023-11-16T02:29:16.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.219+0000 7f7888e2b640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788406f9a0 con 0x7f78840b93f0 2023-11-16T02:29:16.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.219+0000 7f7882d9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f78841470f0 0x7f78840701b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:50328/0 (socket says 172.21.15.28:50328) 2023-11-16T02:29:16.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.219+0000 7f7882d9d640 1 -- 172.21.15.28:0/1495518204 learned_addr learned my addr 172.21.15.28:0/1495518204 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:16.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.219+0000 7f788259c640 1 --2- 172.21.15.28:0/1495518204 >> v2:172.21.15.70:3300/0 conn(0x7f78840b5dc0 0x7f78840b8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:16.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.219+0000 7f7881d9b640 1 --2- 172.21.15.28:0/1495518204 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78840b93f0 0x7f7884146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:16.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.219+0000 7f788159a640 1 -- 172.21.15.28:0/1495518204 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2864316059 0 0) 0x7f788406ee20 con 0x7f78841470f0 2023-11-16T02:29:16.222 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.219+0000 7f788159a640 1 -- 172.21.15.28:0/1495518204 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f786c005740 con 0x7f78841470f0 2023-11-16T02:29:16.226 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.219+0000 7f788159a640 1 -- 172.21.15.28:0/1495518204 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1329986508 0 0) 0x7f786c005740 con 0x7f78841470f0 2023-11-16T02:29:16.226 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.219+0000 7f788259c640 1 -- 172.21.15.28:0/1495518204 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78840b93f0 msgr2=0x7f7884146bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:16.226 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.219+0000 7f788259c640 1 --2- 172.21.15.28:0/1495518204 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78840b93f0 0x7f7884146bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:16.226 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.219+0000 7f788259c640 1 -- 172.21.15.28:0/1495518204 >> v1:172.21.15.28:6789/0 conn(0x7f78841470f0 legacy=0x7f78840701b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:16.226 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.219+0000 7f788259c640 1 -- 172.21.15.28:0/1495518204 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78841475a0 con 0x7f78840b5dc0 2023-11-16T02:29:16.226 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.227+0000 7f7881d9b640 1 --2- 172.21.15.28:0/1495518204 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78840b93f0 0x7f7884146bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:16.228 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.227+0000 7f788259c640 1 --2- 172.21.15.28:0/1495518204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78840b5dc0 0x7f78840b8eb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f78740097c0 tx=0x7f787401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8ef1fedd279d647 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:16.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.227+0000 7f788159a640 1 -- 172.21.15.28:0/1495518204 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c0051f0 con 0x7f78840b5dc0 2023-11-16T02:29:16.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.227+0000 7f788159a640 1 -- 172.21.15.28:0/1495518204 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78740aa450 con 0x7f78840b5dc0 2023-11-16T02:29:16.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.227+0000 7f788159a640 1 -- 172.21.15.28:0/1495518204 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78740aa7e0 con 0x7f78840b5dc0 2023-11-16T02:29:16.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.231+0000 7f7888e2b640 1 -- 172.21.15.28:0/1495518204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78840b5dc0 msgr2=0x7f78840b8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:16.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.231+0000 7f7888e2b640 1 --2- 172.21.15.28:0/1495518204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78840b5dc0 0x7f78840b8eb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f78740097c0 tx=0x7f787401c4a0 comp rx=0 tx=0).stop 2023-11-16T02:29:16.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.231+0000 7f7888e2b640 1 -- 172.21.15.28:0/1495518204 shutdown_connections 2023-11-16T02:29:16.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.231+0000 7f7888e2b640 1 --2- 172.21.15.28:0/1495518204 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78840b93f0 0x7f7884146bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:16.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.231+0000 7f7888e2b640 1 --2- 172.21.15.28:0/1495518204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78840b5dc0 0x7f78840b8eb0 secure :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f78740097c0 tx=0x7f787401c4a0 comp rx=0 tx=0).stop 2023-11-16T02:29:16.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.231+0000 7f7888e2b640 1 -- 172.21.15.28:0/1495518204 >> 172.21.15.28:0/1495518204 conn(0x7f7884069d70 msgr2=0x7f788406a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:16.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.231+0000 7f7888e2b640 1 -- 172.21.15.28:0/1495518204 shutdown_connections 2023-11-16T02:29:16.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.231+0000 7f7888e2b640 1 -- 172.21.15.28:0/1495518204 wait complete. 2023-11-16T02:29:16.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f7888e2b640 1 Processor -- start 2023-11-16T02:29:16.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f7888e2b640 1 -- start start 2023-11-16T02:29:16.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f7888e2b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78840b93f0 0x7f788413ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:16.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f7888e2b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78841470f0 0x7f78840bc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:16.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f7888e2b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78840bae10 0x7f7884135370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:16.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f7888e2b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788413bf40 con 0x7f78840b93f0 2023-11-16T02:29:16.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f7888e2b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78841e1d00 con 0x7f78841470f0 2023-11-16T02:29:16.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f7888e2b640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788414ac30 con 0x7f78840bae10 2023-11-16T02:29:16.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f788259c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78840b93f0 0x7f788413ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:16.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f788259c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78840b93f0 0x7f788413ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33132/0 (socket says 172.21.15.28:33132) 2023-11-16T02:29:16.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f788259c640 1 -- 172.21.15.28:0/150965713 learned_addr learned my addr 172.21.15.28:0/150965713 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:16.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f7881d9b640 1 --2- 172.21.15.28:0/150965713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78841470f0 0x7f78840bc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:16.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f7882d9d640 1 --2- 172.21.15.28:0/150965713 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78840bae10 0x7f7884135370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:16.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f788259c640 1 -- 172.21.15.28:0/150965713 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78840bae10 msgr2=0x7f7884135370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:16.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f788259c640 1 --2- 172.21.15.28:0/150965713 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78840bae10 0x7f7884135370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:16.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f788259c640 1 -- 172.21.15.28:0/150965713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78841470f0 msgr2=0x7f78840bc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:16.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f788259c640 1 --2- 172.21.15.28:0/150965713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78841470f0 0x7f78840bc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:16.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f788259c640 1 -- 172.21.15.28:0/150965713 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7874009420 con 0x7f78840b93f0 2023-11-16T02:29:16.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f7881d9b640 1 --2- 172.21.15.28:0/150965713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78841470f0 0x7f78840bc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:16.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f7882d9d640 1 --2- 172.21.15.28:0/150965713 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78840bae10 0x7f7884135370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:16.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f788259c640 1 --2- 172.21.15.28:0/150965713 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78840b93f0 0x7f788413ba00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f787401cd40 tx=0x7f787401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:16.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f7872ffd640 1 -- 172.21.15.28:0/150965713 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7874006e20 con 0x7f78840b93f0 2023-11-16T02:29:16.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f7872ffd640 1 -- 172.21.15.28:0/150965713 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78740b4610 con 0x7f78840b93f0 2023-11-16T02:29:16.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f7872ffd640 1 -- 172.21.15.28:0/150965713 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78740b49a0 con 0x7f78840b93f0 2023-11-16T02:29:16.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f7888e2b640 1 -- 172.21.15.28:0/150965713 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f788414a6b0 con 0x7f78840b93f0 2023-11-16T02:29:16.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f7888e2b640 1 -- 172.21.15.28:0/150965713 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78840bbb90 con 0x7f78840b93f0 2023-11-16T02:29:16.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f7872ffd640 1 -- 172.21.15.28:0/150965713 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f78740be410 con 0x7f78840b93f0 2023-11-16T02:29:16.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f7888e2b640 1 -- 172.21.15.28:0/150965713 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78840bbd80 con 0x7f78840b93f0 2023-11-16T02:29:16.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.235+0000 7f7872ffd640 1 -- 172.21.15.28:0/150965713 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f78740b3a60 con 0x7f78840b93f0 2023-11-16T02:29:16.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.239+0000 7f7872ffd640 1 -- 172.21.15.28:0/150965713 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f78740b3c70 con 0x7f78840b93f0 2023-11-16T02:29:16.257 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-11-16T02:29:16.253+0000 7f1e919f3180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-16T02:29:16.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.295+0000 7f7888e2b640 1 -- 172.21.15.28:0/150965713 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7884061980 con 0x7f78840b93f0 2023-11-16T02:29:16.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.295+0000 7f7872ffd640 1 -- 172.21.15.28:0/150965713 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f78740cd090 con 0x7f78840b93f0 2023-11-16T02:29:16.297 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:16.297 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":10,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","created":"2023-11-16T02:29:13.710567+0000","modified":"2023-11-16T02:29:16.024490+0000","last_up_change":"0.000000","last_in_change":"2023-11-16T02:29:16.024490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dfa8b58d-3481-4e68-86e8-21873d31d0c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e18f39cd-6a35-4d36-9eed-3877794bf2d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"303d0728-409d-47d7-b7a6-6eb273f602fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"df0bf0ac-6efe-4964-ad27-7c1771a70c56","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"84921219-65cb-4c4e-b9ed-a773db639034","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e2cdd418-12ce-4eea-9b22-efdad83eb76d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-16T02:29:16.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.295+0000 7f7888e2b640 1 -- 172.21.15.28:0/150965713 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78840b93f0 msgr2=0x7f788413ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:16.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.295+0000 7f7888e2b640 1 --2- 172.21.15.28:0/150965713 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78840b93f0 0x7f788413ba00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f787401cd40 tx=0x7f787401ace0 comp rx=0 tx=0).stop 2023-11-16T02:29:16.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.295+0000 7f7888e2b640 1 -- 172.21.15.28:0/150965713 shutdown_connections 2023-11-16T02:29:16.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.295+0000 7f7888e2b640 1 --2- 172.21.15.28:0/150965713 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f78840bae10 0x7f7884135370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:16.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.295+0000 7f7888e2b640 1 --2- 172.21.15.28:0/150965713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78841470f0 0x7f78840bc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:16.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.295+0000 7f7888e2b640 1 --2- 172.21.15.28:0/150965713 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78840b93f0 0x7f788413ba00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:16.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.295+0000 7f7888e2b640 1 -- 172.21.15.28:0/150965713 >> 172.21.15.28:0/150965713 conn(0x7f7884069d70 msgr2=0x7f7884144c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:16.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.295+0000 7f7888e2b640 1 -- 172.21.15.28:0/150965713 shutdown_connections 2023-11-16T02:29:16.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:16.299+0000 7f7888e2b640 1 -- 172.21.15.28:0/150965713 wait complete. 2023-11-16T02:29:16.313 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-16T02:29:16.313 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-16T02:29:16.333 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-11-16T02:29:16.329+0000 7f1e919f3180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-16T02:29:16.384 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-11-16T02:29:16.381+0000 7f1e919f3180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-16T02:29:16.415 INFO:tasks.ceph.osd.2.smithi028.stderr:2023-11-16T02:29:16.415+0000 7f11124bc640 -1 Falling back to public interface 2023-11-16T02:29:16.501 INFO:tasks.ceph.mgr.y.smithi028.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-16T02:29:16.501 INFO:tasks.ceph.mgr.y.smithi028.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-16T02:29:16.501 INFO:tasks.ceph.mgr.y.smithi028.stderr: from numpy import show_config as show_numpy_config 2023-11-16T02:29:16.523 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-11-16T02:29:16.521+0000 7f1e919f3180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-16T02:29:16.539 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-16T02:29:16.539+0000 7f056ebda180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-16T02:29:16.582 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-11-16T02:29:16.581+0000 7f1e919f3180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-16T02:29:16.667 INFO:tasks.ceph.osd.0.smithi028.stderr:2023-11-16T02:29:16.667+0000 7f16f93c0640 -1 Falling back to public interface 2023-11-16T02:29:16.677 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-16T02:29:16.675+0000 7f056ebda180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-16T02:29:16.679 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T02:29:16.677+0000 7fb4e22b9640 -1 Falling back to public interface 2023-11-16T02:29:16.684 INFO:tasks.ceph.osd.3.smithi028.stderr:2023-11-16T02:29:16.683+0000 7f7d0ff31640 -1 Falling back to public interface 2023-11-16T02:29:16.686 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T02:29:16.685+0000 7f04aecc0640 -1 Falling back to public interface 2023-11-16T02:29:16.687 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T02:29:16.685+0000 7fec4beac640 -1 Falling back to public interface 2023-11-16T02:29:16.687 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T02:29:16.685+0000 7f8aa2b58640 -1 Falling back to public interface 2023-11-16T02:29:16.687 INFO:tasks.ceph.osd.1.smithi028.stderr:2023-11-16T02:29:16.687+0000 7fb73a82f640 -1 Falling back to public interface 2023-11-16T02:29:16.846 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-16T02:29:16.847+0000 7f056ebda180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-16T02:29:16.917 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-16T02:29:16.915+0000 7f056ebda180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-16T02:29:17.054 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-16T02:29:17.055+0000 7f056ebda180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-16T02:29:17.119 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-16T02:29:17.234 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.231+0000 7f2be02f4640 1 Processor -- start 2023-11-16T02:29:17.234 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.235+0000 7f2be02f4640 1 -- start start 2023-11-16T02:29:17.235 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.235+0000 7f2be02f4640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2bd81449f0 0x7f2bd806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:17.235 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.235+0000 7f2be02f4640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2bd8144dd0 0x7f2bd8070940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:17.236 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.235+0000 7f2be02f4640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2bd814dfe0 0x7f2bd806acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:17.236 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.235+0000 7f2be02f4640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd80704f0 con 0x7f2bd8144dd0 2023-11-16T02:29:17.236 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.235+0000 7f2be02f4640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd8071f30 con 0x7f2bd81449f0 2023-11-16T02:29:17.236 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.235+0000 7f2be02f4640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd8071cc0 con 0x7f2bd814dfe0 2023-11-16T02:29:17.236 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.235+0000 7f2bdd88f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2bd8144dd0 0x7f2bd8070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:17.236 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.235+0000 7f2bdd88f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2bd8144dd0 0x7f2bd8070940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33138/0 (socket says 172.21.15.28:33138) 2023-11-16T02:29:17.236 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.235+0000 7f2bdd88f640 1 -- 172.21.15.28:0/931177116 learned_addr learned my addr 172.21.15.28:0/931177116 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:17.236 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.235+0000 7f2bde891640 1 --2- 172.21.15.28:0/931177116 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2bd814dfe0 0x7f2bd806acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:17.236 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.235+0000 7f2bde090640 1 --2- 172.21.15.28:0/931177116 >> v2:172.21.15.70:3300/0 conn(0x7f2bd81449f0 0x7f2bd806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:17.236 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.235+0000 7f2bdd88f640 1 -- 172.21.15.28:0/931177116 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2bd814dfe0 msgr2=0x7f2bd806acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:17.236 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.235+0000 7f2bdd88f640 1 --2- 172.21.15.28:0/931177116 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2bd814dfe0 0x7f2bd806acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:17.237 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.235+0000 7f2bdd88f640 1 -- 172.21.15.28:0/931177116 >> v2:172.21.15.70:3300/0 conn(0x7f2bd81449f0 msgr2=0x7f2bd806f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:17.237 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.235+0000 7f2bdd88f640 1 --2- 172.21.15.28:0/931177116 >> v2:172.21.15.70:3300/0 conn(0x7f2bd81449f0 0x7f2bd806f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:17.237 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.235+0000 7f2bdd88f640 1 -- 172.21.15.28:0/931177116 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd80b88e0 con 0x7f2bd8144dd0 2023-11-16T02:29:17.237 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.235+0000 7f2bdd88f640 1 --2- 172.21.15.28:0/931177116 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2bd8144dd0 0x7f2bd8070940 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2bd80bd830 tx=0x7f2bd401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0bba2de5a9babe server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:17.237 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.235+0000 7f2bdd08e640 1 -- 172.21.15.28:0/931177116 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40ab600 con 0x7f2bd8144dd0 2023-11-16T02:29:17.238 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.235+0000 7f2bdd08e640 1 -- 172.21.15.28:0/931177116 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd40ab760 con 0x7f2bd8144dd0 2023-11-16T02:29:17.238 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.235+0000 7f2bdd08e640 1 -- 172.21.15.28:0/931177116 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40abaf0 con 0x7f2bd8144dd0 2023-11-16T02:29:17.238 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2be02f4640 1 -- 172.21.15.28:0/931177116 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2bd8144dd0 msgr2=0x7f2bd8070940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:17.239 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2be02f4640 1 --2- 172.21.15.28:0/931177116 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2bd8144dd0 0x7f2bd8070940 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2bd80bd830 tx=0x7f2bd401c440 comp rx=0 tx=0).stop 2023-11-16T02:29:17.239 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2be02f4640 1 -- 172.21.15.28:0/931177116 shutdown_connections 2023-11-16T02:29:17.239 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2be02f4640 1 --2- 172.21.15.28:0/931177116 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2bd814dfe0 0x7f2bd806acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:17.239 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2be02f4640 1 --2- 172.21.15.28:0/931177116 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2bd8144dd0 0x7f2bd8070940 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:17.239 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2be02f4640 1 --2- 172.21.15.28:0/931177116 >> v2:172.21.15.70:3300/0 conn(0x7f2bd81449f0 0x7f2bd806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:17.239 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2be02f4640 1 -- 172.21.15.28:0/931177116 >> 172.21.15.28:0/931177116 conn(0x7f2bd80b9230 msgr2=0x7f2bd80b9640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:17.239 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2be02f4640 1 -- 172.21.15.28:0/931177116 shutdown_connections 2023-11-16T02:29:17.239 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2be02f4640 1 -- 172.21.15.28:0/931177116 wait complete. 2023-11-16T02:29:17.241 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2be02f4640 1 Processor -- start 2023-11-16T02:29:17.241 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2be02f4640 1 -- start start 2023-11-16T02:29:17.241 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2be02f4640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2bd81449f0 0x7f2bd81401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:17.241 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2be02f4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2bd8144dd0 0x7f2bd81e70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:17.242 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2be02f4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bd814dfe0 0x7f2bd813bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:17.242 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2be02f4640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd81e6cd0 con 0x7f2bd8144dd0 2023-11-16T02:29:17.242 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2be02f4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd814b6a0 con 0x7f2bd814dfe0 2023-11-16T02:29:17.242 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2be02f4640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd81e6980 con 0x7f2bd81449f0 2023-11-16T02:29:17.242 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2bdd88f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2bd8144dd0 0x7f2bd81e70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:17.242 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2bdd88f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2bd8144dd0 0x7f2bd81e70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33152/0 (socket says 172.21.15.28:33152) 2023-11-16T02:29:17.242 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2bdd88f640 1 -- 172.21.15.28:0/2528334126 learned_addr learned my addr 172.21.15.28:0/2528334126 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:17.242 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2bde090640 1 --2- 172.21.15.28:0/2528334126 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2bd81449f0 0x7f2bd81401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:17.242 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2bde891640 1 --2- 172.21.15.28:0/2528334126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bd814dfe0 0x7f2bd813bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:17.242 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2bdd88f640 1 -- 172.21.15.28:0/2528334126 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2bd81449f0 msgr2=0x7f2bd81401a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:17.243 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2bdd88f640 1 --2- 172.21.15.28:0/2528334126 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2bd81449f0 0x7f2bd81401a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:17.243 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2bdd88f640 1 -- 172.21.15.28:0/2528334126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bd814dfe0 msgr2=0x7f2bd813bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:17.243 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2bdd88f640 1 --2- 172.21.15.28:0/2528334126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bd814dfe0 0x7f2bd813bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:17.243 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2bdd88f640 1 -- 172.21.15.28:0/2528334126 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd40094d0 con 0x7f2bd8144dd0 2023-11-16T02:29:17.243 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2bdd88f640 1 --2- 172.21.15.28:0/2528334126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2bd8144dd0 0x7f2bd81e70f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2bd401aaf0 tx=0x7f2bd401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:17.243 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2bceffd640 1 -- 172.21.15.28:0/2528334126 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40b4800 con 0x7f2bd8144dd0 2023-11-16T02:29:17.243 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2bceffd640 1 -- 172.21.15.28:0/2528334126 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd40b4960 con 0x7f2bd8144dd0 2023-11-16T02:29:17.243 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2be02f4640 1 -- 172.21.15.28:0/2528334126 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd81e3480 con 0x7f2bd8144dd0 2023-11-16T02:29:17.243 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2bceffd640 1 -- 172.21.15.28:0/2528334126 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40b4d10 con 0x7f2bd8144dd0 2023-11-16T02:29:17.243 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2be02f4640 1 -- 172.21.15.28:0/2528334126 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd814b0e0 con 0x7f2bd8144dd0 2023-11-16T02:29:17.243 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2bceffd640 1 -- 172.21.15.28:0/2528334126 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2bd40c7740 con 0x7f2bd8144dd0 2023-11-16T02:29:17.243 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2bceffd640 1 -- 172.21.15.28:0/2528334126 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f2bd40bec50 con 0x7f2bd8144dd0 2023-11-16T02:29:17.244 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.239+0000 7f2be02f4640 1 -- 172.21.15.28:0/2528334126 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd80741a0 con 0x7f2bd8144dd0 2023-11-16T02:29:17.244 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.243+0000 7f2bceffd640 1 -- 172.21.15.28:0/2528334126 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f2bd40be580 con 0x7f2bd8144dd0 2023-11-16T02:29:17.265 INFO:tasks.ceph.mgr.x.smithi070.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-16T02:29:17.265 INFO:tasks.ceph.mgr.x.smithi070.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-16T02:29:17.265 INFO:tasks.ceph.mgr.x.smithi070.stderr: from numpy import show_config as show_numpy_config 2023-11-16T02:29:17.300 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.299+0000 7f2be02f4640 1 -- 172.21.15.28:0/2528334126 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2bd80b5ab0 con 0x7f2bd8144dd0 2023-11-16T02:29:17.301 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.299+0000 7f2bceffd640 1 -- 172.21.15.28:0/2528334126 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f2bd40be720 con 0x7f2bd8144dd0 2023-11-16T02:29:17.301 INFO:teuthology.misc.health.smithi028.stdout: 2023-11-16T02:29:17.301 INFO:teuthology.misc.health.smithi028.stdout:{"epoch":10,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","created":"2023-11-16T02:29:13.710567+0000","modified":"2023-11-16T02:29:16.024490+0000","last_up_change":"0.000000","last_in_change":"2023-11-16T02:29:16.024490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dfa8b58d-3481-4e68-86e8-21873d31d0c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e18f39cd-6a35-4d36-9eed-3877794bf2d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"303d0728-409d-47d7-b7a6-6eb273f602fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"df0bf0ac-6efe-4964-ad27-7c1771a70c56","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"84921219-65cb-4c4e-b9ed-a773db639034","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e2cdd418-12ce-4eea-9b22-efdad83eb76d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-16T02:29:17.302 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.299+0000 7f2be02f4640 1 -- 172.21.15.28:0/2528334126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2bd8144dd0 msgr2=0x7f2bd81e70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:17.302 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.299+0000 7f2be02f4640 1 --2- 172.21.15.28:0/2528334126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2bd8144dd0 0x7f2bd81e70f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2bd401aaf0 tx=0x7f2bd401ac80 comp rx=0 tx=0).stop 2023-11-16T02:29:17.302 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.299+0000 7f2be02f4640 1 -- 172.21.15.28:0/2528334126 shutdown_connections 2023-11-16T02:29:17.302 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.299+0000 7f2be02f4640 1 --2- 172.21.15.28:0/2528334126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bd814dfe0 0x7f2bd813bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:17.302 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.299+0000 7f2be02f4640 1 --2- 172.21.15.28:0/2528334126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2bd8144dd0 0x7f2bd81e70f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:17.302 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.299+0000 7f2be02f4640 1 --2- 172.21.15.28:0/2528334126 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2bd81449f0 0x7f2bd81401a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:17.302 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.299+0000 7f2be02f4640 1 -- 172.21.15.28:0/2528334126 >> 172.21.15.28:0/2528334126 conn(0x7f2bd80b9230 msgr2=0x7f2bd806fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:17.302 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.299+0000 7f2be02f4640 1 -- 172.21.15.28:0/2528334126 shutdown_connections 2023-11-16T02:29:17.303 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:17.299+0000 7f2be02f4640 1 -- 172.21.15.28:0/2528334126 wait complete. 2023-11-16T02:29:17.316 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-16T02:29:17.317 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-11-16T02:29:17.313+0000 7f1e919f3180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-16T02:29:17.478 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-11-16T02:29:17.477+0000 7f1e919f3180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-16T02:29:17.626 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-11-16T02:29:17.625+0000 7f1e919f3180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-16T02:29:17.675 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-16T02:29:17.675+0000 7f056ebda180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-16T02:29:17.689 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-11-16T02:29:17.689+0000 7f1e919f3180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-16T02:29:17.754 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-16T02:29:17.755+0000 7f056ebda180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-16T02:29:17.819 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-11-16T02:29:17.817+0000 7f1e919f3180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-16T02:29:17.932 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-16T02:29:17.931+0000 7f056ebda180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-16T02:29:18.009 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-16T02:29:18.007+0000 7f056ebda180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-16T02:29:18.312 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-16T02:29:18.311+0000 7f056ebda180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-16T02:29:18.375 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-16T02:29:18.375+0000 7f056ebda180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-16T02:29:18.441 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-11-16T02:29:18.437+0000 7f1e919f3180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-16T02:29:18.521 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-11-16T02:29:18.517+0000 7f1e919f3180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-16T02:29:18.694 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-11-16T02:29:18.689+0000 7f1e919f3180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-16T02:29:18.764 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-11-16T02:29:18.761+0000 7f1e919f3180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-16T02:29:19.052 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-11-16T02:29:19.049+0000 7f1e919f3180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-16T02:29:19.110 INFO:tasks.ceph.mgr.x.smithi070.stderr:2023-11-16T02:29:19.109+0000 7f1e919f3180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-16T02:29:19.415 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-16T02:29:19.415+0000 7f0516399640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-16T02:29:19.421 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-16T02:29:19.419+0000 7f0516399640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-16T02:29:20.320 INFO:tasks.ceph.osd.2.smithi028.stderr:2023-11-16T02:29:20.318+0000 7f11124bc640 -1 osd.2 0 log_to_monitors true 2023-11-16T02:29:20.501 INFO:tasks.ceph.osd.0.smithi028.stderr:2023-11-16T02:29:20.498+0000 7f16f93c0640 -1 osd.0 0 log_to_monitors true 2023-11-16T02:29:20.580 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T02:29:20.577+0000 7f04aecc0640 -1 osd.5 0 log_to_monitors true 2023-11-16T02:29:20.624 INFO:tasks.ceph.osd.3.smithi028.stderr:2023-11-16T02:29:20.622+0000 7f7d0ff31640 -1 osd.3 0 log_to_monitors true 2023-11-16T02:29:20.625 INFO:tasks.ceph.osd.1.smithi028.stderr:2023-11-16T02:29:20.622+0000 7fb73a82f640 -1 osd.1 0 log_to_monitors true 2023-11-16T02:29:20.640 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T02:29:20.637+0000 7fb4e22b9640 -1 osd.4 0 log_to_monitors true 2023-11-16T02:29:20.679 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T02:29:20.677+0000 7f8aa2b58640 -1 osd.7 0 log_to_monitors true 2023-11-16T02:29:20.679 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T02:29:20.677+0000 7fec4beac640 -1 osd.6 0 log_to_monitors true 2023-11-16T02:29:22.373 INFO:tasks.ceph.osd.2.smithi028.stderr:2023-11-16T02:29:22.370+0000 7f110dc3e640 -1 osd.2 0 waiting for initial osdmap 2023-11-16T02:29:22.402 INFO:tasks.ceph.osd.2.smithi028.stderr:2023-11-16T02:29:22.402+0000 7f1106283640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-16T02:29:23.793 INFO:tasks.ceph.osd.0.smithi028.stderr:2023-11-16T02:29:23.790+0000 7f16f4b42640 -1 osd.0 0 waiting for initial osdmap 2023-11-16T02:29:23.803 INFO:tasks.ceph.osd.3.smithi028.stderr:2023-11-16T02:29:23.798+0000 7f7d0b6b3640 -1 osd.3 0 waiting for initial osdmap 2023-11-16T02:29:23.828 INFO:tasks.ceph.osd.0.smithi028.stderr:2023-11-16T02:29:23.826+0000 7f16ed187640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-16T02:29:23.834 INFO:tasks.ceph.osd.3.smithi028.stderr:2023-11-16T02:29:23.834+0000 7f7d03cf8640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-16T02:29:23.836 INFO:tasks.ceph.osd.1.smithi028.stderr:2023-11-16T02:29:23.834+0000 7fb7377ec640 -1 osd.1 0 waiting for initial osdmap 2023-11-16T02:29:23.862 INFO:tasks.ceph.osd.1.smithi028.stderr:2023-11-16T02:29:23.862+0000 7fb72e5f6640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-16T02:29:23.943 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T02:29:23.941+0000 7fb4dda3b640 -1 osd.4 0 waiting for initial osdmap 2023-11-16T02:29:23.990 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T02:29:23.989+0000 7fb4d6080640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-16T02:29:24.039 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T02:29:24.037+0000 7f04abc7d640 -1 osd.5 0 waiting for initial osdmap 2023-11-16T02:29:24.070 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T02:29:24.069+0000 7f04a2a87640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-16T02:29:24.123 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-16T02:29:24.126 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T02:29:24.125+0000 7fec4762e640 -1 osd.6 0 waiting for initial osdmap 2023-11-16T02:29:24.146 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T02:29:24.145+0000 7fec3fc73640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-16T02:29:24.175 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T02:29:24.173+0000 7f8a9e2da640 -1 osd.7 0 waiting for initial osdmap 2023-11-16T02:29:24.198 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T02:29:24.197+0000 7f8a9691f640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-16T02:29:24.244 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.242+0000 7fe77a616640 1 Processor -- start 2023-11-16T02:29:24.244 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.242+0000 7fe77a616640 1 -- start start 2023-11-16T02:29:24.246 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.242+0000 7fe77a616640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe774142da0 0x7fe774070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:24.246 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.242+0000 7fe77a616640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe77406f3f0 0x7fe774071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:24.246 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.242+0000 7fe77a616640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7740b8000 con 0x7fe7740b7120 2023-11-16T02:29:24.246 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.242+0000 7fe77a616640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe774070190 con 0x7fe774142da0 2023-11-16T02:29:24.246 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.242+0000 7fe77a616640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7740b7640 con 0x7fe77406f3f0 2023-11-16T02:29:24.246 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.242+0000 7fe773fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe774142da0 0x7fe774070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:24.246 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.242+0000 7fe7737fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe7740b7120 0x7fe77406ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:51206/0 (socket says 172.21.15.28:51206) 2023-11-16T02:29:24.247 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.242+0000 7fe7737fe640 1 -- 172.21.15.28:0/253436111 learned_addr learned my addr 172.21.15.28:0/253436111 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:24.247 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.242+0000 7fe778bb3640 1 --2- 172.21.15.28:0/253436111 >> v2:172.21.15.70:3300/0 conn(0x7fe77406f3f0 0x7fe774071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:24.247 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.242+0000 7fe773fff640 1 -- 172.21.15.28:0/253436111 >> v2:172.21.15.70:3300/0 conn(0x7fe77406f3f0 msgr2=0x7fe774071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:24.247 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.242+0000 7fe773fff640 1 --2- 172.21.15.28:0/253436111 >> v2:172.21.15.70:3300/0 conn(0x7fe77406f3f0 0x7fe774071530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:24.247 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.242+0000 7fe773fff640 1 -- 172.21.15.28:0/253436111 >> v1:172.21.15.28:6789/0 conn(0x7fe7740b7120 legacy=0x7fe77406ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:24.247 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.242+0000 7fe773fff640 1 -- 172.21.15.28:0/253436111 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7740a0d80 con 0x7fe774142da0 2023-11-16T02:29:24.247 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.242+0000 7fe772ffd640 1 -- 172.21.15.28:0/253436111 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1487712700 0 0) 0x7fe7740b8000 con 0x7fe7740b7120 2023-11-16T02:29:24.247 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.242+0000 7fe778bb3640 1 --2- 172.21.15.28:0/253436111 >> v2:172.21.15.70:3300/0 conn(0x7fe77406f3f0 0x7fe774071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:29:24.248 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.246+0000 7fe773fff640 1 --2- 172.21.15.28:0/253436111 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe774142da0 0x7fe774070ff0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe77406d4a0 tx=0x7fe76401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93a70bff299a2b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:24.248 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.246+0000 7fe772ffd640 1 -- 172.21.15.28:0/253436111 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7640a59f0 con 0x7fe774142da0 2023-11-16T02:29:24.248 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.246+0000 7fe772ffd640 1 -- 172.21.15.28:0/253436111 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7640a5b50 con 0x7fe774142da0 2023-11-16T02:29:24.248 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.246+0000 7fe772ffd640 1 -- 172.21.15.28:0/253436111 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7640ad440 con 0x7fe774142da0 2023-11-16T02:29:24.249 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.246+0000 7fe77a616640 1 -- 172.21.15.28:0/253436111 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe774142da0 msgr2=0x7fe774070ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:24.249 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.246+0000 7fe77a616640 1 --2- 172.21.15.28:0/253436111 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe774142da0 0x7fe774070ff0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe77406d4a0 tx=0x7fe76401c910 comp rx=0 tx=0).stop 2023-11-16T02:29:24.249 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.246+0000 7fe77a616640 1 -- 172.21.15.28:0/253436111 shutdown_connections 2023-11-16T02:29:24.249 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.246+0000 7fe77a616640 1 --2- 172.21.15.28:0/253436111 >> v2:172.21.15.70:3300/0 conn(0x7fe77406f3f0 0x7fe774071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:24.249 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.246+0000 7fe77a616640 1 --2- 172.21.15.28:0/253436111 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe774142da0 0x7fe774070ff0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:24.249 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.246+0000 7fe77a616640 1 -- 172.21.15.28:0/253436111 >> 172.21.15.28:0/253436111 conn(0x7fe7740b8920 msgr2=0x7fe7740b8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:24.250 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.246+0000 7fe77a616640 1 -- 172.21.15.28:0/253436111 shutdown_connections 2023-11-16T02:29:24.250 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.246+0000 7fe77a616640 1 -- 172.21.15.28:0/253436111 wait complete. 2023-11-16T02:29:24.252 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.246+0000 7fe77a616640 1 Processor -- start 2023-11-16T02:29:24.252 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.246+0000 7fe77a616640 1 -- start start 2023-11-16T02:29:24.252 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe77a616640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe77406f3f0 0x7fe7741e3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:24.252 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe77a616640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe7740b7120 0x7fe77413c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:24.252 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe77a616640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe774142da0 0x7fe7741e2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:24.252 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe77a616640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7740bb3f0 con 0x7fe7740b7120 2023-11-16T02:29:24.252 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe77a616640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7741e4460 con 0x7fe77406f3f0 2023-11-16T02:29:24.252 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe77a616640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7741396b0 con 0x7fe774142da0 2023-11-16T02:29:24.252 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe7737fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe7740b7120 0x7fe77413c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:24.252 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe7737fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe7740b7120 0x7fe77413c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:44536/0 (socket says 172.21.15.28:44536) 2023-11-16T02:29:24.252 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe7737fe640 1 -- 172.21.15.28:0/1662966828 learned_addr learned my addr 172.21.15.28:0/1662966828 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:24.253 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe773fff640 1 --2- 172.21.15.28:0/1662966828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe77406f3f0 0x7fe7741e3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:24.253 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe778bb3640 1 --2- 172.21.15.28:0/1662966828 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe774142da0 0x7fe7741e2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:24.253 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe7737fe640 1 -- 172.21.15.28:0/1662966828 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe774142da0 msgr2=0x7fe7741e2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:24.253 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe7737fe640 1 --2- 172.21.15.28:0/1662966828 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe774142da0 0x7fe7741e2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:24.253 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe7737fe640 1 -- 172.21.15.28:0/1662966828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe77406f3f0 msgr2=0x7fe7741e3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:24.253 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe7737fe640 1 --2- 172.21.15.28:0/1662966828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe77406f3f0 0x7fe7741e3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:24.253 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe7737fe640 1 -- 172.21.15.28:0/1662966828 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe764009a70 con 0x7fe7740b7120 2023-11-16T02:29:24.253 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe778bb3640 1 --2- 172.21.15.28:0/1662966828 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe774142da0 0x7fe7741e2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:24.253 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe7737fe640 1 --2- 172.21.15.28:0/1662966828 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe7740b7120 0x7fe77413c670 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe76800c480 tx=0x7fe76800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:24.253 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe770ff9640 1 -- 172.21.15.28:0/1662966828 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7680074e0 con 0x7fe7740b7120 2023-11-16T02:29:24.253 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe770ff9640 1 -- 172.21.15.28:0/1662966828 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe768007640 con 0x7fe7740b7120 2023-11-16T02:29:24.253 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe77a616640 1 -- 172.21.15.28:0/1662966828 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7740baee0 con 0x7fe7740b7120 2023-11-16T02:29:24.254 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe770ff9640 1 -- 172.21.15.28:0/1662966828 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe768004a10 con 0x7fe7740b7120 2023-11-16T02:29:24.254 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe77a616640 1 -- 172.21.15.28:0/1662966828 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7741496d0 con 0x7fe7740b7120 2023-11-16T02:29:24.254 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe77a616640 1 -- 172.21.15.28:0/1662966828 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7741e1d30 con 0x7fe7740b7120 2023-11-16T02:29:24.255 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe770ff9640 1 -- 172.21.15.28:0/1662966828 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 4) v1 ==== 85172+0+0 (secure 0 0 0) 0x7fe768004b70 con 0x7fe7740b7120 2023-11-16T02:29:24.255 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe770ff9640 1 --2- 172.21.15.28:0/1662966828 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe7600659d0 0x7fe760067e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:24.255 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe770ff9640 1 -- 172.21.15.28:0/1662966828 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2511+0+0 (secure 0 0 0) 0x7fe768081530 con 0x7fe7740b7120 2023-11-16T02:29:24.255 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe773fff640 1 --2- 172.21.15.28:0/1662966828 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe7600659d0 0x7fe760067e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:24.255 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.250+0000 7fe773fff640 1 --2- 172.21.15.28:0/1662966828 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe7600659d0 0x7fe760067e90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe7640af000 tx=0x7fe7640a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:24.258 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.258+0000 7fe770ff9640 1 -- 172.21.15.28:0/1662966828 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fe7741e1d30 con 0x7fe7740b7120 2023-11-16T02:29:24.408 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.406+0000 7fe77a616640 1 -- 172.21.15.28:0/1662966828 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7741e1d30 con 0x7fe7740b7120 2023-11-16T02:29:24.408 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.406+0000 7fe770ff9640 1 -- 172.21.15.28:0/1662966828 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7494 (secure 0 0 0) 0x7fe7741e1d30 con 0x7fe7740b7120 2023-11-16T02:29:24.409 INFO:teuthology.misc.health.smithi028.stdout: 2023-11-16T02:29:24.409 INFO:teuthology.misc.health.smithi028.stdout:{"epoch":14,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","created":"2023-11-16T02:29:13.710567+0000","modified":"2023-11-16T02:29:23.427485+0000","last_up_change":"2023-11-16T02:29:23.427485+0000","last_in_change":"2023-11-16T02:29:16.024490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dfa8b58d-3481-4e68-86e8-21873d31d0c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e18f39cd-6a35-4d36-9eed-3877794bf2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":38723},{"type":"v1","addr":"172.21.15.28:6801","nonce":38723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":38723},{"type":"v1","addr":"172.21.15.28:6803","nonce":38723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":38723},{"type":"v1","addr":"172.21.15.28:6807","nonce":38723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":38723},{"type":"v1","addr":"172.21.15.28:6805","nonce":38723}]},"public_addr":"172.21.15.28:6801/38723","cluster_addr":"172.21.15.28:6803/38723","heartbeat_back_addr":"172.21.15.28:6807/38723","heartbeat_front_addr":"172.21.15.28:6805/38723","state":["exists","up"]},{"osd":3,"uuid":"303d0728-409d-47d7-b7a6-6eb273f602fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"df0bf0ac-6efe-4964-ad27-7c1771a70c56","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"84921219-65cb-4c4e-b9ed-a773db639034","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e2cdd418-12ce-4eea-9b22-efdad83eb76d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-16T02:29:24.411 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.410+0000 7fe77a616640 1 -- 172.21.15.28:0/1662966828 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe7600659d0 msgr2=0x7fe760067e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:24.411 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.410+0000 7fe77a616640 1 --2- 172.21.15.28:0/1662966828 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe7600659d0 0x7fe760067e90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe7640af000 tx=0x7fe7640a7070 comp rx=0 tx=0).stop 2023-11-16T02:29:24.412 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.410+0000 7fe77a616640 1 -- 172.21.15.28:0/1662966828 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe7740b7120 msgr2=0x7fe77413c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:24.412 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.410+0000 7fe77a616640 1 --2- 172.21.15.28:0/1662966828 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe7740b7120 0x7fe77413c670 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe76800c480 tx=0x7fe76800c940 comp rx=0 tx=0).stop 2023-11-16T02:29:24.412 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.410+0000 7fe77a616640 1 -- 172.21.15.28:0/1662966828 shutdown_connections 2023-11-16T02:29:24.412 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.410+0000 7fe77a616640 1 --2- 172.21.15.28:0/1662966828 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe7600659d0 0x7fe760067e90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:24.412 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.410+0000 7fe77a616640 1 --2- 172.21.15.28:0/1662966828 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe774142da0 0x7fe7741e2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:24.412 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.410+0000 7fe77a616640 1 --2- 172.21.15.28:0/1662966828 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe7740b7120 0x7fe77413c670 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:24.412 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.410+0000 7fe77a616640 1 --2- 172.21.15.28:0/1662966828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe77406f3f0 0x7fe7741e3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:24.412 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.410+0000 7fe77a616640 1 -- 172.21.15.28:0/1662966828 >> 172.21.15.28:0/1662966828 conn(0x7fe7740b8920 msgr2=0x7fe774141d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:24.412 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.410+0000 7fe77a616640 1 -- 172.21.15.28:0/1662966828 shutdown_connections 2023-11-16T02:29:24.412 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:24.410+0000 7fe77a616640 1 -- 172.21.15.28:0/1662966828 wait complete. 2023-11-16T02:29:24.425 DEBUG:teuthology.misc:1 of 8 OSDs are up 2023-11-16T02:29:31.234 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-16T02:29:31.361 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.358+0000 7f5555058640 1 Processor -- start 2023-11-16T02:29:31.362 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.358+0000 7f5555058640 1 -- start start 2023-11-16T02:29:31.363 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.362+0000 7f5555058640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5550145080 0x7f55500bad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:31.363 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.362+0000 7f5555058640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f555014ec90 0x7f55500b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:31.363 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.362+0000 7f5555058640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555014e800 con 0x7f55500b8e70 2023-11-16T02:29:31.363 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.362+0000 7f5555058640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55500b8800 con 0x7f555014ec90 2023-11-16T02:29:31.364 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.362+0000 7f5555058640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555014e1b0 con 0x7f5550145080 2023-11-16T02:29:31.364 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.362+0000 7f554f59e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f555014ec90 0x7f55500b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:31.364 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.362+0000 7f554f59e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f555014ec90 0x7f55500b7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38204/0 (socket says 172.21.15.28:38204) 2023-11-16T02:29:31.364 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.362+0000 7f554f59e640 1 -- 172.21.15.28:0/3996558418 learned_addr learned my addr 172.21.15.28:0/3996558418 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:31.364 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.362+0000 7f554659c640 1 --2- 172.21.15.28:0/3996558418 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5550145080 0x7f55500bad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:31.364 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.362+0000 7f554f59e640 1 -- 172.21.15.28:0/3996558418 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5550145080 msgr2=0x7f55500bad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:31.364 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.362+0000 7f554f59e640 1 --2- 172.21.15.28:0/3996558418 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5550145080 0x7f55500bad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:31.364 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.362+0000 7f554f59e640 1 -- 172.21.15.28:0/3996558418 >> v1:172.21.15.70:6789/0 conn(0x7f55500b8e70 legacy=0x7f5550144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:31.364 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.362+0000 7f554f59e640 1 -- 172.21.15.28:0/3996558418 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f555014e490 con 0x7f555014ec90 2023-11-16T02:29:31.367 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.362+0000 7f554f59e640 1 --2- 172.21.15.28:0/3996558418 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f555014ec90 0x7f55500b7ab0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5548009e50 tx=0x7f554801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4126d66db86dde server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:31.367 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.362+0000 7f554e59c640 1 -- 172.21.15.28:0/3996558418 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55480a5900 con 0x7f555014ec90 2023-11-16T02:29:31.367 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.362+0000 7f554e59c640 1 -- 172.21.15.28:0/3996558418 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55480a5a60 con 0x7f555014ec90 2023-11-16T02:29:31.367 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.362+0000 7f554e59c640 1 -- 172.21.15.28:0/3996558418 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55480a5df0 con 0x7f555014ec90 2023-11-16T02:29:31.368 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.362+0000 7f5555058640 1 -- 172.21.15.28:0/3996558418 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f555014ec90 msgr2=0x7f55500b7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:31.368 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.362+0000 7f5555058640 1 --2- 172.21.15.28:0/3996558418 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f555014ec90 0x7f55500b7ab0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5548009e50 tx=0x7f554801ca10 comp rx=0 tx=0).stop 2023-11-16T02:29:31.368 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.362+0000 7f5555058640 1 -- 172.21.15.28:0/3996558418 shutdown_connections 2023-11-16T02:29:31.368 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.362+0000 7f5555058640 1 --2- 172.21.15.28:0/3996558418 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f555014ec90 0x7f55500b7ab0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:31.368 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.362+0000 7f5555058640 1 --2- 172.21.15.28:0/3996558418 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5550145080 0x7f55500bad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:31.368 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.362+0000 7f5555058640 1 -- 172.21.15.28:0/3996558418 >> 172.21.15.28:0/3996558418 conn(0x7f55500c03f0 msgr2=0x7f55500c0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:31.368 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.362+0000 7f5555058640 1 -- 172.21.15.28:0/3996558418 shutdown_connections 2023-11-16T02:29:31.368 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.362+0000 7f5555058640 1 -- 172.21.15.28:0/3996558418 wait complete. 2023-11-16T02:29:31.368 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.366+0000 7f5555058640 1 Processor -- start 2023-11-16T02:29:31.368 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.366+0000 7f5555058640 1 -- start start 2023-11-16T02:29:31.370 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.366+0000 7f5555058640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55500b8e70 0x7f5550148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:31.370 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.366+0000 7f5555058640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5550145080 0x7f55501e7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:31.370 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.366+0000 7f5555058640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f555014ec90 0x7f5550147e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:31.371 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.366+0000 7f5555058640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55501e6820 con 0x7f5550145080 2023-11-16T02:29:31.371 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.366+0000 7f5555058640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55501e6b00 con 0x7f55500b8e70 2023-11-16T02:29:31.371 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.366+0000 7f5555058640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55501e6de0 con 0x7f555014ec90 2023-11-16T02:29:31.371 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.366+0000 7f554659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5550145080 0x7f55501e7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:31.371 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.366+0000 7f554659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5550145080 0x7f55501e7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38206/0 (socket says 172.21.15.28:38206) 2023-11-16T02:29:31.371 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.366+0000 7f554659c640 1 -- 172.21.15.28:0/1653739469 learned_addr learned my addr 172.21.15.28:0/1653739469 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:31.371 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.366+0000 7f554ed9d640 1 --2- 172.21.15.28:0/1653739469 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55500b8e70 0x7f5550148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:31.371 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.366+0000 7f554f59e640 1 --2- 172.21.15.28:0/1653739469 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f555014ec90 0x7f5550147e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:31.371 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.366+0000 7f554659c640 1 -- 172.21.15.28:0/1653739469 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f555014ec90 msgr2=0x7f5550147e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:31.371 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.366+0000 7f554659c640 1 --2- 172.21.15.28:0/1653739469 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f555014ec90 0x7f5550147e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:31.371 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.366+0000 7f554659c640 1 -- 172.21.15.28:0/1653739469 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55500b8e70 msgr2=0x7f5550148ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:31.371 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.366+0000 7f554659c640 1 --2- 172.21.15.28:0/1653739469 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55500b8e70 0x7f5550148ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:31.372 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.366+0000 7f554659c640 1 -- 172.21.15.28:0/1653739469 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5548009b30 con 0x7f5550145080 2023-11-16T02:29:31.372 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.366+0000 7f554659c640 1 --2- 172.21.15.28:0/1653739469 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5550145080 0x7f55501e7300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f553800d800 tx=0x7f553800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:31.372 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.366+0000 7f5547fff640 1 -- 172.21.15.28:0/1653739469 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553800b6c0 con 0x7f5550145080 2023-11-16T02:29:31.372 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.366+0000 7f5547fff640 1 -- 172.21.15.28:0/1653739469 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553800b840 con 0x7f5550145080 2023-11-16T02:29:31.372 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.366+0000 7f5555058640 1 -- 172.21.15.28:0/1653739469 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5550145580 con 0x7f5550145080 2023-11-16T02:29:31.372 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.366+0000 7f5547fff640 1 -- 172.21.15.28:0/1653739469 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553800bbf0 con 0x7f5550145080 2023-11-16T02:29:31.372 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.366+0000 7f5555058640 1 -- 172.21.15.28:0/1653739469 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f555014b000 con 0x7f5550145080 2023-11-16T02:29:31.372 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.366+0000 7f5555058640 1 -- 172.21.15.28:0/1653739469 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55500741a0 con 0x7f5550145080 2023-11-16T02:29:31.372 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.370+0000 7f5547fff640 1 -- 172.21.15.28:0/1653739469 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f553800bd50 con 0x7f5550145080 2023-11-16T02:29:31.373 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.370+0000 7f5547fff640 1 --2- 172.21.15.28:0/1653739469 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5530065a60 0x7f5530067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:31.373 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.370+0000 7f5547fff640 1 -- 172.21.15.28:0/1653739469 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5538083380 con 0x7f5550145080 2023-11-16T02:29:31.373 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.370+0000 7f554ed9d640 1 --2- 172.21.15.28:0/1653739469 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5530065a60 0x7f5530067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:31.373 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.370+0000 7f554ed9d640 1 --2- 172.21.15.28:0/1653739469 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5530065a60 0x7f5530067f20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5540000f70 tx=0x7f5540009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:31.377 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.374+0000 7f5547fff640 1 -- 172.21.15.28:0/1653739469 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f5538051100 con 0x7f5550145080 2023-11-16T02:29:31.534 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.530+0000 7f5555058640 1 -- 172.21.15.28:0/1653739469 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5550144400 con 0x7f5550145080 2023-11-16T02:29:31.535 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.534+0000 7f5547fff640 1 -- 172.21.15.28:0/1653739469 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12334 (secure 0 0 0) 0x7f5538054720 con 0x7f5550145080 2023-11-16T02:29:31.536 INFO:teuthology.misc.health.smithi028.stdout: 2023-11-16T02:29:31.536 INFO:teuthology.misc.health.smithi028.stdout:{"epoch":18,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","created":"2023-11-16T02:29:13.710567+0000","modified":"2023-11-16T02:29:28.504308+0000","last_up_change":"2023-11-16T02:29:24.841087+0000","last_in_change":"2023-11-16T02:29:16.024490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-16T02:29:26.490910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dfa8b58d-3481-4e68-86e8-21873d31d0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":38722},{"type":"v1","addr":"172.21.15.28:6809","nonce":38722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":38722},{"type":"v1","addr":"172.21.15.28:6811","nonce":38722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":38722},{"type":"v1","addr":"172.21.15.28:6815","nonce":38722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":38722},{"type":"v1","addr":"172.21.15.28:6813","nonce":38722}]},"public_addr":"172.21.15.28:6809/38722","cluster_addr":"172.21.15.28:6811/38722","heartbeat_back_addr":"172.21.15.28:6815/38722","heartbeat_front_addr":"172.21.15.28:6813/38722","state":["exists","up"]},{"osd":1,"uuid":"1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":38724},{"type":"v1","addr":"172.21.15.28:6824","nonce":38724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":38724},{"type":"v1","addr":"172.21.15.28:6827","nonce":38724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":38724},{"type":"v1","addr":"172.21.15.28:6831","nonce":38724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":38724},{"type":"v1","addr":"172.21.15.28:6829","nonce":38724}]},"public_addr":"172.21.15.28:6824/38724","cluster_addr":"172.21.15.28:6827/38724","heartbeat_back_addr":"172.21.15.28:6831/38724","heartbeat_front_addr":"172.21.15.28:6829/38724","state":["exists","up"]},{"osd":2,"uuid":"e18f39cd-6a35-4d36-9eed-3877794bf2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":38723},{"type":"v1","addr":"172.21.15.28:6801","nonce":38723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":38723},{"type":"v1","addr":"172.21.15.28:6803","nonce":38723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":38723},{"type":"v1","addr":"172.21.15.28:6807","nonce":38723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":38723},{"type":"v1","addr":"172.21.15.28:6805","nonce":38723}]},"public_addr":"172.21.15.28:6801/38723","cluster_addr":"172.21.15.28:6803/38723","heartbeat_back_addr":"172.21.15.28:6807/38723","heartbeat_front_addr":"172.21.15.28:6805/38723","state":["exists","up"]},{"osd":3,"uuid":"303d0728-409d-47d7-b7a6-6eb273f602fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":38725},{"type":"v1","addr":"172.21.15.28:6817","nonce":38725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":38725},{"type":"v1","addr":"172.21.15.28:6819","nonce":38725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":38725},{"type":"v1","addr":"172.21.15.28:6825","nonce":38725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":38725},{"type":"v1","addr":"172.21.15.28:6821","nonce":38725}]},"public_addr":"172.21.15.28:6817/38725","cluster_addr":"172.21.15.28:6819/38725","heartbeat_back_addr":"172.21.15.28:6825/38725","heartbeat_front_addr":"172.21.15.28:6821/38725","state":["exists","up"]},{"osd":4,"uuid":"df0bf0ac-6efe-4964-ad27-7c1771a70c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":38828},{"type":"v1","addr":"172.21.15.70:6801","nonce":38828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":38828},{"type":"v1","addr":"172.21.15.70:6803","nonce":38828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":38828},{"type":"v1","addr":"172.21.15.70:6807","nonce":38828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":38828},{"type":"v1","addr":"172.21.15.70:6805","nonce":38828}]},"public_addr":"172.21.15.70:6801/38828","cluster_addr":"172.21.15.70:6803/38828","heartbeat_back_addr":"172.21.15.70:6807/38828","heartbeat_front_addr":"172.21.15.70:6805/38828","state":["exists","up"]},{"osd":5,"uuid":"84921219-65cb-4c4e-b9ed-a773db639034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":38830},{"type":"v1","addr":"172.21.15.70:6810","nonce":38830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6813","nonce":38830},{"type":"v1","addr":"172.21.15.70:6814","nonce":38830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":38830},{"type":"v1","addr":"172.21.15.70:6824","nonce":38830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":38830},{"type":"v1","addr":"172.21.15.70:6819","nonce":38830}]},"public_addr":"172.21.15.70:6810/38830","cluster_addr":"172.21.15.70:6814/38830","heartbeat_back_addr":"172.21.15.70:6824/38830","heartbeat_front_addr":"172.21.15.70:6819/38830","state":["exists","up"]},{"osd":6,"uuid":"c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":38829},{"type":"v1","addr":"172.21.15.70:6812","nonce":38829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":38829},{"type":"v1","addr":"172.21.15.70:6820","nonce":38829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":38829},{"type":"v1","addr":"172.21.15.70:6828","nonce":38829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":38829},{"type":"v1","addr":"172.21.15.70:6825","nonce":38829}]},"public_addr":"172.21.15.70:6812/38829","cluster_addr":"172.21.15.70:6820/38829","heartbeat_back_addr":"172.21.15.70:6828/38829","heartbeat_front_addr":"172.21.15.70:6825/38829","state":["exists","up"]},{"osd":7,"uuid":"e2cdd418-12ce-4eea-9b22-efdad83eb76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":38839},{"type":"v1","addr":"172.21.15.70:6815","nonce":38839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":38839},{"type":"v1","addr":"172.21.15.70:6823","nonce":38839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":38839},{"type":"v1","addr":"172.21.15.70:6831","nonce":38839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6827","nonce":38839},{"type":"v1","addr":"172.21.15.70:6829","nonce":38839}]},"public_addr":"172.21.15.70:6815/38839","cluster_addr":"172.21.15.70:6823/38839","heartbeat_back_addr":"172.21.15.70:6831/38839","heartbeat_front_addr":"172.21.15.70:6829/38839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.544240+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.637637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.352115+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.652916+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.624477+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.570247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.706468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.696574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-16T02:29:31.538 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.534+0000 7f5555058640 1 -- 172.21.15.28:0/1653739469 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5530065a60 msgr2=0x7f5530067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:31.538 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.534+0000 7f5555058640 1 --2- 172.21.15.28:0/1653739469 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5530065a60 0x7f5530067f20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5540000f70 tx=0x7f5540009040 comp rx=0 tx=0).stop 2023-11-16T02:29:31.538 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.534+0000 7f5555058640 1 -- 172.21.15.28:0/1653739469 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5550145080 msgr2=0x7f55501e7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:31.539 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.534+0000 7f5555058640 1 --2- 172.21.15.28:0/1653739469 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5550145080 0x7f55501e7300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f553800d800 tx=0x7f553800dcc0 comp rx=0 tx=0).stop 2023-11-16T02:29:31.539 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.534+0000 7f5555058640 1 -- 172.21.15.28:0/1653739469 shutdown_connections 2023-11-16T02:29:31.539 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.534+0000 7f5555058640 1 --2- 172.21.15.28:0/1653739469 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5530065a60 0x7f5530067f20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:31.539 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.534+0000 7f5555058640 1 --2- 172.21.15.28:0/1653739469 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f555014ec90 0x7f5550147e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:31.539 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.534+0000 7f5555058640 1 --2- 172.21.15.28:0/1653739469 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5550145080 0x7f55501e7300 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:31.539 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.534+0000 7f5555058640 1 --2- 172.21.15.28:0/1653739469 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55500b8e70 0x7f5550148ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:31.539 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.534+0000 7f5555058640 1 -- 172.21.15.28:0/1653739469 >> 172.21.15.28:0/1653739469 conn(0x7f55500c03f0 msgr2=0x7f55500b77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:31.539 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.534+0000 7f5555058640 1 -- 172.21.15.28:0/1653739469 shutdown_connections 2023-11-16T02:29:31.539 INFO:teuthology.misc.health.smithi028.stderr:2023-11-16T02:29:31.534+0000 7f5555058640 1 -- 172.21.15.28:0/1653739469 wait complete. 2023-11-16T02:29:31.554 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-16T02:29:31.554 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-16T02:29:31.555 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-16T02:29:31.555 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-16T02:29:31.557 INFO:tasks.ceph.mds.a:Started 2023-11-16T02:29:31.557 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-16T02:29:31.557 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-16T02:29:31.559 INFO:tasks.ceph.mds.c:Started 2023-11-16T02:29:31.560 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-16T02:29:31.560 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-16T02:29:31.562 INFO:tasks.ceph.mds.b:Started 2023-11-16T02:29:31.562 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-16T02:29:31.563 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-16T02:29:31.634 INFO:tasks.ceph.mds.c.smithi028.stdout:starting mds.c at 2023-11-16T02:29:31.636 INFO:tasks.ceph.mds.a.smithi028.stdout:starting mds.a at 2023-11-16T02:29:31.650 INFO:tasks.ceph.mds.b.smithi070.stdout:starting mds.b at 2023-11-16T02:29:31.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.678+0000 7f22f5ff8640 1 Processor -- start 2023-11-16T02:29:31.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.678+0000 7f22f5ff8640 1 -- start start 2023-11-16T02:29:31.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.678+0000 7f22f5ff8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f22f00baec0 0x7f22f00b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:31.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.678+0000 7f22f5ff8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f22f014b7b0 0x7f22f00b7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:31.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.678+0000 7f22f5ff8640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f0145460 con 0x7f22f006ae80 2023-11-16T02:29:31.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.678+0000 7f22f5ff8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f014ad10 con 0x7f22f00baec0 2023-11-16T02:29:31.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.678+0000 7f22f5ff8640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f014bbc0 con 0x7f22f014b7b0 2023-11-16T02:29:31.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.678+0000 7f22ef7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f22f00baec0 0x7f22f00b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:31.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.678+0000 7f22ef7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f22f00baec0 0x7f22f00b8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38250/0 (socket says 172.21.15.28:38250) 2023-11-16T02:29:31.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.678+0000 7f22ef7fe640 1 -- 172.21.15.28:0/1066640232 learned_addr learned my addr 172.21.15.28:0/1066640232 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:31.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.678+0000 7f22effff640 1 --2- 172.21.15.28:0/1066640232 >> v2:172.21.15.70:3300/0 conn(0x7f22f014b7b0 0x7f22f00b7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:31.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.678+0000 7f22ef7fe640 1 -- 172.21.15.28:0/1066640232 >> v2:172.21.15.70:3300/0 conn(0x7f22f014b7b0 msgr2=0x7f22f00b7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:31.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.678+0000 7f22ef7fe640 1 --2- 172.21.15.28:0/1066640232 >> v2:172.21.15.70:3300/0 conn(0x7f22f014b7b0 0x7f22f00b7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:31.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.678+0000 7f22ef7fe640 1 -- 172.21.15.28:0/1066640232 >> v1:172.21.15.70:6789/0 conn(0x7f22f006ae80 legacy=0x7f22f006b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:31.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.678+0000 7f22ef7fe640 1 -- 172.21.15.28:0/1066640232 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f006bac0 con 0x7f22f00baec0 2023-11-16T02:29:31.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.682+0000 7f22ef7fe640 1 --2- 172.21.15.28:0/1066640232 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22f00baec0 0x7f22f00b8bf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f22f00baa00 tx=0x7f22e001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6229ba4dba934b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:31.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.682+0000 7f22ee7fc640 1 -- 172.21.15.28:0/1066640232 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e00a89f0 con 0x7f22f00baec0 2023-11-16T02:29:31.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.682+0000 7f22ee7fc640 1 -- 172.21.15.28:0/1066640232 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e00a8b50 con 0x7f22f00baec0 2023-11-16T02:29:31.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.682+0000 7f22ee7fc640 1 -- 172.21.15.28:0/1066640232 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e00b0440 con 0x7f22f00baec0 2023-11-16T02:29:31.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.682+0000 7f22f5ff8640 1 -- 172.21.15.28:0/1066640232 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22f00baec0 msgr2=0x7f22f00b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:31.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.682+0000 7f22f5ff8640 1 --2- 172.21.15.28:0/1066640232 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22f00baec0 0x7f22f00b8bf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f22f00baa00 tx=0x7f22e001ecf0 comp rx=0 tx=0).stop 2023-11-16T02:29:31.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.682+0000 7f22f5ff8640 1 -- 172.21.15.28:0/1066640232 shutdown_connections 2023-11-16T02:29:31.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.682+0000 7f22f5ff8640 1 --2- 172.21.15.28:0/1066640232 >> v2:172.21.15.70:3300/0 conn(0x7f22f014b7b0 0x7f22f00b7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:31.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.682+0000 7f22f5ff8640 1 --2- 172.21.15.28:0/1066640232 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22f00baec0 0x7f22f00b8bf0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:31.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.682+0000 7f22f5ff8640 1 -- 172.21.15.28:0/1066640232 >> 172.21.15.28:0/1066640232 conn(0x7f22f0070f70 msgr2=0x7f22f0071350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:31.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.682+0000 7f22f5ff8640 1 -- 172.21.15.28:0/1066640232 shutdown_connections 2023-11-16T02:29:31.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.682+0000 7f22f5ff8640 1 -- 172.21.15.28:0/1066640232 wait complete. 2023-11-16T02:29:31.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.682+0000 7f22f5ff8640 1 Processor -- start 2023-11-16T02:29:31.687 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.682+0000 7f22f5ff8640 1 -- start start 2023-11-16T02:29:31.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.682+0000 7f22f5ff8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22f006ae80 0x7f22f01d3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:31.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.682+0000 7f22f5ff8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22f00baec0 0x7f22f01d4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:31.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.682+0000 7f22f5ff8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f22f014b7b0 0x7f22f01e3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:31.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.682+0000 7f22f5ff8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f01d41b0 con 0x7f22f00baec0 2023-11-16T02:29:31.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.682+0000 7f22f5ff8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f01d7b00 con 0x7f22f006ae80 2023-11-16T02:29:31.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.682+0000 7f22f5ff8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f01477e0 con 0x7f22f014b7b0 2023-11-16T02:29:31.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.682+0000 7f22eeffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22f00baec0 0x7f22f01d4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:31.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.682+0000 7f22ef7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22f006ae80 0x7f22f01d3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:31.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.682+0000 7f22eeffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22f00baec0 0x7f22f01d4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38256/0 (socket says 172.21.15.28:38256) 2023-11-16T02:29:31.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.682+0000 7f22eeffd640 1 -- 172.21.15.28:0/3506654103 learned_addr learned my addr 172.21.15.28:0/3506654103 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:31.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.682+0000 7f22effff640 1 --2- 172.21.15.28:0/3506654103 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f22f014b7b0 0x7f22f01e3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:31.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.686+0000 7f22eeffd640 1 -- 172.21.15.28:0/3506654103 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f22f014b7b0 msgr2=0x7f22f01e3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:31.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.686+0000 7f22eeffd640 1 --2- 172.21.15.28:0/3506654103 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f22f014b7b0 0x7f22f01e3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:31.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.686+0000 7f22eeffd640 1 -- 172.21.15.28:0/3506654103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22f006ae80 msgr2=0x7f22f01d3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:31.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.686+0000 7f22eeffd640 1 --2- 172.21.15.28:0/3506654103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22f006ae80 0x7f22f01d3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:31.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.686+0000 7f22eeffd640 1 -- 172.21.15.28:0/3506654103 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e0009480 con 0x7f22f00baec0 2023-11-16T02:29:31.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.686+0000 7f22eeffd640 1 --2- 172.21.15.28:0/3506654103 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22f00baec0 0x7f22f01d4800 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f22e400c500 tx=0x7f22e400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:31.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.686+0000 7f22d7fff640 1 -- 172.21.15.28:0/3506654103 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e4005220 con 0x7f22f00baec0 2023-11-16T02:29:31.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.686+0000 7f22d7fff640 1 -- 172.21.15.28:0/3506654103 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e4005380 con 0x7f22f00baec0 2023-11-16T02:29:31.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.686+0000 7f22f5ff8640 1 -- 172.21.15.28:0/3506654103 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f01d2ff0 con 0x7f22f00baec0 2023-11-16T02:29:31.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.686+0000 7f22d7fff640 1 -- 172.21.15.28:0/3506654103 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e4007270 con 0x7f22f00baec0 2023-11-16T02:29:31.689 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.686+0000 7f22f5ff8640 1 -- 172.21.15.28:0/3506654103 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f0147d10 con 0x7f22f00baec0 2023-11-16T02:29:31.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.686+0000 7f22f5ff8640 1 -- 172.21.15.28:0/3506654103 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f004e8a0 con 0x7f22f00baec0 2023-11-16T02:29:31.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.686+0000 7f22d7fff640 1 -- 172.21.15.28:0/3506654103 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f22e40073d0 con 0x7f22f00baec0 2023-11-16T02:29:31.690 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.686+0000 7f22d7fff640 1 --2- 172.21.15.28:0/3506654103 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f22dc065a90 0x7f22dc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:31.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.686+0000 7f22d7fff640 1 -- 172.21.15.28:0/3506654103 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f22e40825b0 con 0x7f22f00baec0 2023-11-16T02:29:31.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.686+0000 7f22ef7fe640 1 --2- 172.21.15.28:0/3506654103 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f22dc065a90 0x7f22dc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:31.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.686+0000 7f22ef7fe640 1 --2- 172.21.15.28:0/3506654103 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f22dc065a90 0x7f22dc067f50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f22e00b2000 tx=0x7f22e00aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:31.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.690+0000 7f22d7fff640 1 -- 172.21.15.28:0/3506654103 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f22e4050380 con 0x7f22f00baec0 2023-11-16T02:29:31.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.846+0000 7f22f5ff8640 1 -- 172.21.15.28:0/3506654103 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22f0148f90 con 0x7f22f00baec0 2023-11-16T02:29:31.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.850+0000 7f22d7fff640 1 -- 172.21.15.28:0/3506654103 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12334 (secure 0 0 0) 0x7f22e40539a0 con 0x7f22f00baec0 2023-11-16T02:29:31.851 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:31.851 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":18,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","created":"2023-11-16T02:29:13.710567+0000","modified":"2023-11-16T02:29:28.504308+0000","last_up_change":"2023-11-16T02:29:24.841087+0000","last_in_change":"2023-11-16T02:29:16.024490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-16T02:29:26.490910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dfa8b58d-3481-4e68-86e8-21873d31d0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":38722},{"type":"v1","addr":"172.21.15.28:6809","nonce":38722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":38722},{"type":"v1","addr":"172.21.15.28:6811","nonce":38722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":38722},{"type":"v1","addr":"172.21.15.28:6815","nonce":38722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":38722},{"type":"v1","addr":"172.21.15.28:6813","nonce":38722}]},"public_addr":"172.21.15.28:6809/38722","cluster_addr":"172.21.15.28:6811/38722","heartbeat_back_addr":"172.21.15.28:6815/38722","heartbeat_front_addr":"172.21.15.28:6813/38722","state":["exists","up"]},{"osd":1,"uuid":"1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":38724},{"type":"v1","addr":"172.21.15.28:6824","nonce":38724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":38724},{"type":"v1","addr":"172.21.15.28:6827","nonce":38724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":38724},{"type":"v1","addr":"172.21.15.28:6831","nonce":38724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":38724},{"type":"v1","addr":"172.21.15.28:6829","nonce":38724}]},"public_addr":"172.21.15.28:6824/38724","cluster_addr":"172.21.15.28:6827/38724","heartbeat_back_addr":"172.21.15.28:6831/38724","heartbeat_front_addr":"172.21.15.28:6829/38724","state":["exists","up"]},{"osd":2,"uuid":"e18f39cd-6a35-4d36-9eed-3877794bf2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":38723},{"type":"v1","addr":"172.21.15.28:6801","nonce":38723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":38723},{"type":"v1","addr":"172.21.15.28:6803","nonce":38723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":38723},{"type":"v1","addr":"172.21.15.28:6807","nonce":38723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":38723},{"type":"v1","addr":"172.21.15.28:6805","nonce":38723}]},"public_addr":"172.21.15.28:6801/38723","cluster_addr":"172.21.15.28:6803/38723","heartbeat_back_addr":"172.21.15.28:6807/38723","heartbeat_front_addr":"172.21.15.28:6805/38723","state":["exists","up"]},{"osd":3,"uuid":"303d0728-409d-47d7-b7a6-6eb273f602fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":38725},{"type":"v1","addr":"172.21.15.28:6817","nonce":38725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":38725},{"type":"v1","addr":"172.21.15.28:6819","nonce":38725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":38725},{"type":"v1","addr":"172.21.15.28:6825","nonce":38725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":38725},{"type":"v1","addr":"172.21.15.28:6821","nonce":38725}]},"public_addr":"172.21.15.28:6817/38725","cluster_addr":"172.21.15.28:6819/38725","heartbeat_back_addr":"172.21.15.28:6825/38725","heartbeat_front_addr":"172.21.15.28:6821/38725","state":["exists","up"]},{"osd":4,"uuid":"df0bf0ac-6efe-4964-ad27-7c1771a70c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":38828},{"type":"v1","addr":"172.21.15.70:6801","nonce":38828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":38828},{"type":"v1","addr":"172.21.15.70:6803","nonce":38828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":38828},{"type":"v1","addr":"172.21.15.70:6807","nonce":38828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":38828},{"type":"v1","addr":"172.21.15.70:6805","nonce":38828}]},"public_addr":"172.21.15.70:6801/38828","cluster_addr":"172.21.15.70:6803/38828","heartbeat_back_addr":"172.21.15.70:6807/38828","heartbeat_front_addr":"172.21.15.70:6805/38828","state":["exists","up"]},{"osd":5,"uuid":"84921219-65cb-4c4e-b9ed-a773db639034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":38830},{"type":"v1","addr":"172.21.15.70:6810","nonce":38830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6813","nonce":38830},{"type":"v1","addr":"172.21.15.70:6814","nonce":38830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":38830},{"type":"v1","addr":"172.21.15.70:6824","nonce":38830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":38830},{"type":"v1","addr":"172.21.15.70:6819","nonce":38830}]},"public_addr":"172.21.15.70:6810/38830","cluster_addr":"172.21.15.70:6814/38830","heartbeat_back_addr":"172.21.15.70:6824/38830","heartbeat_front_addr":"172.21.15.70:6819/38830","state":["exists","up"]},{"osd":6,"uuid":"c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":38829},{"type":"v1","addr":"172.21.15.70:6812","nonce":38829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":38829},{"type":"v1","addr":"172.21.15.70:6820","nonce":38829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":38829},{"type":"v1","addr":"172.21.15.70:6828","nonce":38829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":38829},{"type":"v1","addr":"172.21.15.70:6825","nonce":38829}]},"public_addr":"172.21.15.70:6812/38829","cluster_addr":"172.21.15.70:6820/38829","heartbeat_back_addr":"172.21.15.70:6828/38829","heartbeat_front_addr":"172.21.15.70:6825/38829","state":["exists","up"]},{"osd":7,"uuid":"e2cdd418-12ce-4eea-9b22-efdad83eb76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":38839},{"type":"v1","addr":"172.21.15.70:6815","nonce":38839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":38839},{"type":"v1","addr":"172.21.15.70:6823","nonce":38839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":38839},{"type":"v1","addr":"172.21.15.70:6831","nonce":38839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6827","nonce":38839},{"type":"v1","addr":"172.21.15.70:6829","nonce":38839}]},"public_addr":"172.21.15.70:6815/38839","cluster_addr":"172.21.15.70:6823/38839","heartbeat_back_addr":"172.21.15.70:6831/38839","heartbeat_front_addr":"172.21.15.70:6829/38839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.544240+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.637637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.352115+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.652916+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.624477+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.570247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.706468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.696574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-16T02:29:31.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.850+0000 7f22f5ff8640 1 -- 172.21.15.28:0/3506654103 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f22dc065a90 msgr2=0x7f22dc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:31.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.850+0000 7f22f5ff8640 1 --2- 172.21.15.28:0/3506654103 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f22dc065a90 0x7f22dc067f50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f22e00b2000 tx=0x7f22e00aa070 comp rx=0 tx=0).stop 2023-11-16T02:29:31.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.850+0000 7f22f5ff8640 1 -- 172.21.15.28:0/3506654103 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22f00baec0 msgr2=0x7f22f01d4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:31.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.850+0000 7f22f5ff8640 1 --2- 172.21.15.28:0/3506654103 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22f00baec0 0x7f22f01d4800 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f22e400c500 tx=0x7f22e400c9c0 comp rx=0 tx=0).stop 2023-11-16T02:29:31.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.850+0000 7f22f5ff8640 1 -- 172.21.15.28:0/3506654103 shutdown_connections 2023-11-16T02:29:31.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.850+0000 7f22f5ff8640 1 --2- 172.21.15.28:0/3506654103 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f22dc065a90 0x7f22dc067f50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:31.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.850+0000 7f22f5ff8640 1 --2- 172.21.15.28:0/3506654103 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f22f014b7b0 0x7f22f01e3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:31.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.850+0000 7f22f5ff8640 1 --2- 172.21.15.28:0/3506654103 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f22f00baec0 0x7f22f01d4800 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:31.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.850+0000 7f22f5ff8640 1 --2- 172.21.15.28:0/3506654103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22f006ae80 0x7f22f01d3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:31.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.850+0000 7f22f5ff8640 1 -- 172.21.15.28:0/3506654103 >> 172.21.15.28:0/3506654103 conn(0x7f22f0070f70 msgr2=0x7f22f00bc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:31.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.850+0000 7f22f5ff8640 1 -- 172.21.15.28:0/3506654103 shutdown_connections 2023-11-16T02:29:31.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.850+0000 7f22f5ff8640 1 -- 172.21.15.28:0/3506654103 wait complete. 2023-11-16T02:29:31.870 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-16T02:29:26.490910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-16T02:29:31.871 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-16T02:29:31.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.990+0000 7ffaad115640 1 Processor -- start 2023-11-16T02:29:31.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.990+0000 7ffaad115640 1 -- start start 2023-11-16T02:29:31.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaad115640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ffaa806a3d0 0x7ffaa8071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:31.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaad115640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa814b1f0 con 0x7ffaa81417e0 2023-11-16T02:29:31.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaad115640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa814aec0 con 0x7ffaa80702d0 2023-11-16T02:29:31.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaad115640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa814bd90 con 0x7ffaa806a3d0 2023-11-16T02:29:31.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa759e640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ffaa81417e0 0x7ffaa81521b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:32772/0 (socket says 172.21.15.28:32772) 2023-11-16T02:29:31.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa759e640 1 -- 172.21.15.28:0/179170721 learned_addr learned my addr 172.21.15.28:0/179170721 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:31.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa6d9d640 1 --2- 172.21.15.28:0/179170721 >> v2:172.21.15.70:3300/0 conn(0x7ffaa806a3d0 0x7ffaa8071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:31.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa5d9b640 1 -- 172.21.15.28:0/179170721 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2482728255 0 0) 0x7ffaa814b1f0 con 0x7ffaa81417e0 2023-11-16T02:29:31.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa5d9b640 1 -- 172.21.15.28:0/179170721 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa94005740 con 0x7ffaa81417e0 2023-11-16T02:29:31.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa5d9b640 1 -- 172.21.15.28:0/179170721 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782661048 0 0) 0x7ffaa814aec0 con 0x7ffaa80702d0 2023-11-16T02:29:31.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa5d9b640 1 -- 172.21.15.28:0/179170721 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffaa814b1f0 con 0x7ffaa80702d0 2023-11-16T02:29:31.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa5d9b640 1 -- 172.21.15.28:0/179170721 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3029294677 0 0) 0x7ffa94005740 con 0x7ffaa81417e0 2023-11-16T02:29:31.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa5d9b640 1 -- 172.21.15.28:0/179170721 >> v2:172.21.15.70:3300/0 conn(0x7ffaa806a3d0 msgr2=0x7ffaa8071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:31.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa5d9b640 1 --2- 172.21.15.28:0/179170721 >> v2:172.21.15.70:3300/0 conn(0x7ffaa806a3d0 0x7ffaa8071090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:31.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa5d9b640 1 -- 172.21.15.28:0/179170721 >> v1:172.21.15.70:6789/0 conn(0x7ffaa80702d0 legacy=0x7ffaa814b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:31.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa5d9b640 1 -- 172.21.15.28:0/179170721 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa80716b0 con 0x7ffaa81417e0 2023-11-16T02:29:31.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa5d9b640 1 -- 172.21.15.28:0/179170721 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7ffaa0001a00 con 0x7ffaa81417e0 2023-11-16T02:29:31.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa5d9b640 1 -- 172.21.15.28:0/179170721 >> v1:172.21.15.28:6789/0 conn(0x7ffaa81417e0 legacy=0x7ffaa81521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:31.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa5d9b640 1 --2- 172.21.15.28:0/179170721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa94005d70 0x7ffa94006170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:31.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa5d9b640 1 --2- 172.21.15.28:0/179170721 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa940069e0 0x7ffa94006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:31.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa5d9b640 1 --2- 172.21.15.28:0/179170721 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa940073a0 0x7ffa9400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:31.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa5d9b640 1 -- 172.21.15.28:0/179170721 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa814bd90 con 0x7ffa940073a0 2023-11-16T02:29:31.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa5d9b640 1 -- 172.21.15.28:0/179170721 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9400e270 con 0x7ffa94005d70 2023-11-16T02:29:31.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa5d9b640 1 -- 172.21.15.28:0/179170721 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9400e430 con 0x7ffa940069e0 2023-11-16T02:29:31.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa759e640 1 --2- 172.21.15.28:0/179170721 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa940073a0 0x7ffa9400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:31.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa6d9d640 1 --2- 172.21.15.28:0/179170721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa94005d70 0x7ffa94006170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:31.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa659c640 1 --2- 172.21.15.28:0/179170721 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa940069e0 0x7ffa94006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:31.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa759e640 1 -- 172.21.15.28:0/179170721 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa940069e0 msgr2=0x7ffa94006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:32.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa759e640 1 --2- 172.21.15.28:0/179170721 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa940069e0 0x7ffa94006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:32.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa759e640 1 -- 172.21.15.28:0/179170721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa94005d70 msgr2=0x7ffa94006170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:32.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa759e640 1 --2- 172.21.15.28:0/179170721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa94005d70 0x7ffa94006170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:32.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa759e640 1 -- 172.21.15.28:0/179170721 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa94005740 con 0x7ffa940073a0 2023-11-16T02:29:32.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.994+0000 7ffaa6d9d640 1 --2- 172.21.15.28:0/179170721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa94005d70 0x7ffa94006170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:29:32.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.998+0000 7ffaa759e640 1 -- 172.21.15.28:0/179170721 reap_dead start 2023-11-16T02:29:32.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.998+0000 7ffaa759e640 1 --2- 172.21.15.28:0/179170721 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa940073a0 0x7ffa9400dba0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000a710 tx=0x7ffaa001f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df98efd7e4f45248 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:32.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.998+0000 7ffaa5d9b640 1 -- 172.21.15.28:0/179170721 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa00b0070 con 0x7ffa940073a0 2023-11-16T02:29:32.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.998+0000 7ffaa5d9b640 1 -- 172.21.15.28:0/179170721 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa00ac3f0 con 0x7ffa940073a0 2023-11-16T02:29:32.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.998+0000 7ffaa5d9b640 1 -- 172.21.15.28:0/179170721 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa00ac7c0 con 0x7ffa940073a0 2023-11-16T02:29:32.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.998+0000 7ffaad115640 1 -- 172.21.15.28:0/179170721 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa940073a0 msgr2=0x7ffa9400dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:32.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.998+0000 7ffaad115640 1 --2- 172.21.15.28:0/179170721 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa940073a0 0x7ffa9400dba0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000a710 tx=0x7ffaa001f940 comp rx=0 tx=0).stop 2023-11-16T02:29:32.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.998+0000 7ffaad115640 1 -- 172.21.15.28:0/179170721 shutdown_connections 2023-11-16T02:29:32.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.998+0000 7ffaad115640 1 --2- 172.21.15.28:0/179170721 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa940073a0 0x7ffa9400dba0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:32.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.998+0000 7ffaad115640 1 -- 172.21.15.28:0/179170721 >> 172.21.15.28:0/179170721 conn(0x7ffaa80bc5a0 msgr2=0x7ffaa80bc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:32.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.998+0000 7ffaad115640 1 -- 172.21.15.28:0/179170721 shutdown_connections 2023-11-16T02:29:32.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.998+0000 7ffaad115640 1 -- 172.21.15.28:0/179170721 wait complete. 2023-11-16T02:29:32.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.998+0000 7ffaad115640 1 Processor -- start 2023-11-16T02:29:32.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.998+0000 7ffaad115640 1 -- start start 2023-11-16T02:29:32.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.998+0000 7ffaad115640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa940073a0 0x7ffaa80bb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:32.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.998+0000 7ffaad115640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffaa8143930 0x7ffaa813a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:32.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.998+0000 7ffaad115640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffaa8143db0 0x7ffaa80b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:32.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.998+0000 7ffaad115640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa80bb6a0 con 0x7ffaa8143db0 2023-11-16T02:29:32.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.998+0000 7ffaad115640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa8144790 con 0x7ffa940073a0 2023-11-16T02:29:32.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.998+0000 7ffaad115640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa81492c0 con 0x7ffaa8143930 2023-11-16T02:29:32.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.998+0000 7ffaa759e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffaa8143db0 0x7ffaa80b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:32.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.998+0000 7ffaa759e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffaa8143db0 0x7ffaa80b53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38276/0 (socket says 172.21.15.28:38276) 2023-11-16T02:29:32.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:31.998+0000 7ffaa759e640 1 -- 172.21.15.28:0/3941683638 learned_addr learned my addr 172.21.15.28:0/3941683638 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:32.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.002+0000 7ffaa6d9d640 1 --2- 172.21.15.28:0/3941683638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa940073a0 0x7ffaa80bb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:32.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.002+0000 7ffaa659c640 1 --2- 172.21.15.28:0/3941683638 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffaa8143930 0x7ffaa813a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:32.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.002+0000 7ffaa759e640 1 -- 172.21.15.28:0/3941683638 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffaa8143930 msgr2=0x7ffaa813a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:32.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.002+0000 7ffaa759e640 1 --2- 172.21.15.28:0/3941683638 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffaa8143930 0x7ffaa813a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:32.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.002+0000 7ffaa759e640 1 -- 172.21.15.28:0/3941683638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa940073a0 msgr2=0x7ffaa80bb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:32.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.002+0000 7ffaa759e640 1 --2- 172.21.15.28:0/3941683638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa940073a0 0x7ffaa80bb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:32.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.002+0000 7ffaa759e640 1 -- 172.21.15.28:0/3941683638 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa81495a0 con 0x7ffaa8143db0 2023-11-16T02:29:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.002+0000 7ffaa759e640 1 --2- 172.21.15.28:0/3941683638 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffaa8143db0 0x7ffaa80b53d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00201e0 tx=0x7ffa94007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.002+0000 7ffa9f7fe640 1 -- 172.21.15.28:0/3941683638 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa00b0040 con 0x7ffaa8143db0 2023-11-16T02:29:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.002+0000 7ffa9f7fe640 1 -- 172.21.15.28:0/3941683638 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa0004b70 con 0x7ffaa8143db0 2023-11-16T02:29:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.002+0000 7ffaad115640 1 -- 172.21.15.28:0/3941683638 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa8141cf0 con 0x7ffaa8143db0 2023-11-16T02:29:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.002+0000 7ffa9f7fe640 1 -- 172.21.15.28:0/3941683638 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0001a00 con 0x7ffaa8143db0 2023-11-16T02:29:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.002+0000 7ffaad115640 1 -- 172.21.15.28:0/3941683638 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa8148a10 con 0x7ffaa8143db0 2023-11-16T02:29:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.002+0000 7ffaad115640 1 -- 172.21.15.28:0/3941683638 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa804e8a0 con 0x7ffaa8143db0 2023-11-16T02:29:32.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.002+0000 7ffa9f7fe640 1 -- 172.21.15.28:0/3941683638 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffaa00acb00 con 0x7ffaa8143db0 2023-11-16T02:29:32.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.002+0000 7ffa9f7fe640 1 --2- 172.21.15.28:0/3941683638 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ffa88065a90 0x7ffa88067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:32.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.002+0000 7ffaa6d9d640 1 --2- 172.21.15.28:0/3941683638 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ffa88065a90 0x7ffa88067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:32.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.002+0000 7ffa9f7fe640 1 -- 172.21.15.28:0/3941683638 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ffaa0120160 con 0x7ffaa8143db0 2023-11-16T02:29:32.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.002+0000 7ffaa6d9d640 1 --2- 172.21.15.28:0/3941683638 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ffa88065a90 0x7ffa88067f50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffaa813d650 tx=0x7ffa98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:32.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.006+0000 7ffa9f7fe640 1 -- 172.21.15.28:0/3941683638 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7ffaa00ede70 con 0x7ffaa8143db0 2023-11-16T02:29:32.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.158+0000 7ffaad115640 1 -- 172.21.15.28:0/3941683638 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffaa814ab80 con 0x7ffaa8143db0 2023-11-16T02:29:32.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.158+0000 7ffa9f7fe640 1 -- 172.21.15.28:0/3941683638 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffaa00f1490 con 0x7ffaa8143db0 2023-11-16T02:29:32.160 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-11-16T02:29:32.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.162+0000 7ffaad115640 1 -- 172.21.15.28:0/3941683638 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ffa88065a90 msgr2=0x7ffa88067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:32.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.162+0000 7ffaad115640 1 --2- 172.21.15.28:0/3941683638 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ffa88065a90 0x7ffa88067f50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffaa813d650 tx=0x7ffa98008040 comp rx=0 tx=0).stop 2023-11-16T02:29:32.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.162+0000 7ffaad115640 1 -- 172.21.15.28:0/3941683638 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffaa8143db0 msgr2=0x7ffaa80b53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:32.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.162+0000 7ffaad115640 1 --2- 172.21.15.28:0/3941683638 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffaa8143db0 0x7ffaa80b53d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00201e0 tx=0x7ffa94007a10 comp rx=0 tx=0).stop 2023-11-16T02:29:32.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.162+0000 7ffaad115640 1 -- 172.21.15.28:0/3941683638 shutdown_connections 2023-11-16T02:29:32.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.162+0000 7ffaad115640 1 --2- 172.21.15.28:0/3941683638 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ffa88065a90 0x7ffa88067f50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:32.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.162+0000 7ffaad115640 1 --2- 172.21.15.28:0/3941683638 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffaa8143db0 0x7ffaa80b53d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:32.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.162+0000 7ffaad115640 1 --2- 172.21.15.28:0/3941683638 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffaa8143930 0x7ffaa813a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:32.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.162+0000 7ffaad115640 1 --2- 172.21.15.28:0/3941683638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa940073a0 0x7ffaa80bb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:32.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.162+0000 7ffaad115640 1 -- 172.21.15.28:0/3941683638 >> 172.21.15.28:0/3941683638 conn(0x7ffaa80bc5a0 msgr2=0x7ffaa806f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:32.167 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.162+0000 7ffaad115640 1 -- 172.21.15.28:0/3941683638 shutdown_connections 2023-11-16T02:29:32.167 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.162+0000 7ffaad115640 1 -- 172.21.15.28:0/3941683638 wait complete. 2023-11-16T02:29:32.179 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-16T02:29:32.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.282+0000 7f0e663bf640 1 Processor -- start 2023-11-16T02:29:32.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e663bf640 1 -- start start 2023-11-16T02:29:32.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e663bf640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e6014bb00 0x7f0e6006edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:32.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e663bf640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e6006f310 con 0x7f0e60141840 2023-11-16T02:29:32.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e663bf640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e60071bf0 con 0x7f0e600b7cc0 2023-11-16T02:29:32.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e663bf640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6014b6e0 con 0x7f0e6014bb00 2023-11-16T02:29:32.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e6495c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f0e60141840 0x7f0e60152230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:32786/0 (socket says 172.21.15.28:32786) 2023-11-16T02:29:32.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e6495c640 1 -- 172.21.15.28:0/4165418812 learned_addr learned my addr 172.21.15.28:0/4165418812 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:32.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e57fff640 1 --2- 172.21.15.28:0/4165418812 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e6014bb00 0x7f0e6006edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:32.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e5f7fe640 1 -- 172.21.15.28:0/4165418812 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2227553862 0 0) 0x7f0e6006f310 con 0x7f0e60141840 2023-11-16T02:29:32.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e5f7fe640 1 -- 172.21.15.28:0/4165418812 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e4c003530 con 0x7f0e60141840 2023-11-16T02:29:32.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e5f7fe640 1 -- 172.21.15.28:0/4165418812 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1779082196 0 0) 0x7f0e4c003530 con 0x7f0e60141840 2023-11-16T02:29:32.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e5f7fe640 1 -- 172.21.15.28:0/4165418812 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e6014bb00 msgr2=0x7f0e6006edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:32.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e5f7fe640 1 --2- 172.21.15.28:0/4165418812 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e6014bb00 0x7f0e6006edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:32.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e5f7fe640 1 -- 172.21.15.28:0/4165418812 >> v1:172.21.15.70:6789/0 conn(0x7f0e600b7cc0 legacy=0x7f0e60071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:32.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e5f7fe640 1 -- 172.21.15.28:0/4165418812 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6014b020 con 0x7f0e60141840 2023-11-16T02:29:32.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e5f7fe640 1 -- 172.21.15.28:0/4165418812 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7f0e58001a00 con 0x7f0e60141840 2023-11-16T02:29:32.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e5f7fe640 1 -- 172.21.15.28:0/4165418812 >> v1:172.21.15.28:6789/0 conn(0x7f0e60141840 legacy=0x7f0e60152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:32.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e5f7fe640 1 --2- 172.21.15.28:0/4165418812 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e6014bb00 0x7f0e4c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:32.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e5f7fe640 1 --2- 172.21.15.28:0/4165418812 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e4c003f30 0x7f0e4c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:32.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e5f7fe640 1 --2- 172.21.15.28:0/4165418812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e4c004d10 0x7f0e4c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:32.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e5f7fe640 1 -- 172.21.15.28:0/4165418812 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6014b6e0 con 0x7f0e4c003f30 2023-11-16T02:29:32.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e5f7fe640 1 -- 172.21.15.28:0/4165418812 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c00dd30 con 0x7f0e4c004d10 2023-11-16T02:29:32.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e5f7fe640 1 -- 172.21.15.28:0/4165418812 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c00bb20 con 0x7f0e6014bb00 2023-11-16T02:29:32.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e57fff640 1 --2- 172.21.15.28:0/4165418812 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e4c003f30 0x7f0e4c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:32.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e5ffff640 1 --2- 172.21.15.28:0/4165418812 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e6014bb00 0x7f0e4c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:32.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e6495c640 1 --2- 172.21.15.28:0/4165418812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e4c004d10 0x7f0e4c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:32.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e57fff640 1 -- 172.21.15.28:0/4165418812 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e6014bb00 msgr2=0x7f0e4c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:32.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e57fff640 1 --2- 172.21.15.28:0/4165418812 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e6014bb00 0x7f0e4c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:32.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e57fff640 1 -- 172.21.15.28:0/4165418812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e4c004d10 msgr2=0x7f0e4c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:32.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e57fff640 1 --2- 172.21.15.28:0/4165418812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e4c004d10 0x7f0e4c005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:32.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e57fff640 1 -- 172.21.15.28:0/4165418812 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c003530 con 0x7f0e4c003f30 2023-11-16T02:29:32.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e5ffff640 1 --2- 172.21.15.28:0/4165418812 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e6014bb00 0x7f0e4c0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:32.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.286+0000 7f0e57fff640 1 --2- 172.21.15.28:0/4165418812 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e4c003f30 0x7f0e4c0047d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009ae0 tx=0x7f0e5001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3efa51edcc493cb2 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:32.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e5f7fe640 1 -- 172.21.15.28:0/4165418812 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500a9430 con 0x7f0e4c003f30 2023-11-16T02:29:32.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e5f7fe640 1 -- 172.21.15.28:0/4165418812 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e500a9590 con 0x7f0e4c003f30 2023-11-16T02:29:32.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e5f7fe640 1 -- 172.21.15.28:0/4165418812 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500a9940 con 0x7f0e4c003f30 2023-11-16T02:29:32.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e663bf640 1 -- 172.21.15.28:0/4165418812 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e4c003f30 msgr2=0x7f0e4c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:32.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e663bf640 1 --2- 172.21.15.28:0/4165418812 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e4c003f30 0x7f0e4c0047d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009ae0 tx=0x7f0e5001ca50 comp rx=0 tx=0).stop 2023-11-16T02:29:32.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e6495c640 1 -- 172.21.15.28:0/4165418812 reap_dead start 2023-11-16T02:29:32.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e663bf640 1 -- 172.21.15.28:0/4165418812 shutdown_connections 2023-11-16T02:29:32.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e663bf640 1 -- 172.21.15.28:0/4165418812 >> 172.21.15.28:0/4165418812 conn(0x7f0e600b9050 msgr2=0x7f0e600bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:32.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e663bf640 1 -- 172.21.15.28:0/4165418812 shutdown_connections 2023-11-16T02:29:32.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e663bf640 1 -- 172.21.15.28:0/4165418812 wait complete. 2023-11-16T02:29:32.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e663bf640 1 Processor -- start 2023-11-16T02:29:32.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e663bf640 1 -- start start 2023-11-16T02:29:32.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e663bf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e4c003f30 0x7f0e600b9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:32.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e663bf640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e601474a0 0x7f0e60147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:32.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e663bf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e6013e1a0 0x7f0e6013e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:32.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e663bf640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e60142690 con 0x7f0e4c003f30 2023-11-16T02:29:32.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e663bf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e60145b60 con 0x7f0e6013e1a0 2023-11-16T02:29:32.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e663bf640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e60145e40 con 0x7f0e601474a0 2023-11-16T02:29:32.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e5ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e4c003f30 0x7f0e600b9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:32.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e5ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e4c003f30 0x7f0e600b9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38288/0 (socket says 172.21.15.28:38288) 2023-11-16T02:29:32.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e5ffff640 1 -- 172.21.15.28:0/444215573 learned_addr learned my addr 172.21.15.28:0/444215573 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:32.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e5ffff640 1 -- 172.21.15.28:0/444215573 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e601474a0 msgr2=0x7f0e60147920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:32.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e5ffff640 1 --2- 172.21.15.28:0/444215573 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e601474a0 0x7f0e60147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:32.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e5ffff640 1 -- 172.21.15.28:0/444215573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e6013e1a0 msgr2=0x7f0e6013e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:32.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e5ffff640 1 --2- 172.21.15.28:0/444215573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e6013e1a0 0x7f0e6013e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:32.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e5ffff640 1 -- 172.21.15.28:0/444215573 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e60146120 con 0x7f0e4c003f30 2023-11-16T02:29:32.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e5ffff640 1 --2- 172.21.15.28:0/444215573 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e4c003f30 0x7f0e600b9d90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800d770 tx=0x7f0e4800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:32.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e5d7fa640 1 -- 172.21.15.28:0/444215573 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e48005270 con 0x7f0e4c003f30 2023-11-16T02:29:32.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e5d7fa640 1 -- 172.21.15.28:0/444215573 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e480053d0 con 0x7f0e4c003f30 2023-11-16T02:29:32.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e5d7fa640 1 -- 172.21.15.28:0/444215573 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4800b8d0 con 0x7f0e4c003f30 2023-11-16T02:29:32.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e663bf640 1 -- 172.21.15.28:0/444215573 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e60146400 con 0x7f0e4c003f30 2023-11-16T02:29:32.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.290+0000 7f0e663bf640 1 -- 172.21.15.28:0/444215573 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6013eb60 con 0x7f0e4c003f30 2023-11-16T02:29:32.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.294+0000 7f0e663bf640 1 -- 172.21.15.28:0/444215573 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e600b3c60 con 0x7f0e4c003f30 2023-11-16T02:29:32.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.294+0000 7f0e5d7fa640 1 -- 172.21.15.28:0/444215573 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0e4800ba30 con 0x7f0e4c003f30 2023-11-16T02:29:32.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.294+0000 7f0e5d7fa640 1 --2- 172.21.15.28:0/444215573 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0e40065a60 0x7f0e40067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:32.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.294+0000 7f0e5d7fa640 1 -- 172.21.15.28:0/444215573 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0e48082f00 con 0x7f0e4c003f30 2023-11-16T02:29:32.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.294+0000 7f0e57fff640 1 --2- 172.21.15.28:0/444215573 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0e40065a60 0x7f0e40067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:32.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.294+0000 7f0e57fff640 1 --2- 172.21.15.28:0/444215573 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0e40065a60 0x7f0e40067f20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009ae0 tx=0x7f0e500b3040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:32.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.298+0000 7f0e5d7fa640 1 -- 172.21.15.28:0/444215573 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f0e48050ae0 con 0x7f0e4c003f30 2023-11-16T02:29:32.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.486+0000 7f0e663bf640 1 -- 172.21.15.28:0/444215573 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e6004e8a0 con 0x7f0e4c003f30 2023-11-16T02:29:32.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.490+0000 7f0e5d7fa640 1 -- 172.21.15.28:0/444215573 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7f0e48019310 con 0x7f0e4c003f30 2023-11-16T02:29:32.491 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:32.491 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/4054669002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":4054669002},{"type":"v1","addr":"172.21.15.28:6836","nonce":4054669002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-11-16T02:29:32.491 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 2 2023-11-16T02:29:32.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.490+0000 7f0e663bf640 1 -- 172.21.15.28:0/444215573 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0e40065a60 msgr2=0x7f0e40067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:32.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.490+0000 7f0e663bf640 1 --2- 172.21.15.28:0/444215573 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0e40065a60 0x7f0e40067f20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009ae0 tx=0x7f0e500b3040 comp rx=0 tx=0).stop 2023-11-16T02:29:32.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.490+0000 7f0e663bf640 1 -- 172.21.15.28:0/444215573 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e4c003f30 msgr2=0x7f0e600b9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:32.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.490+0000 7f0e663bf640 1 --2- 172.21.15.28:0/444215573 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e4c003f30 0x7f0e600b9d90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800d770 tx=0x7f0e4800dc30 comp rx=0 tx=0).stop 2023-11-16T02:29:32.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.490+0000 7f0e663bf640 1 -- 172.21.15.28:0/444215573 shutdown_connections 2023-11-16T02:29:32.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.490+0000 7f0e663bf640 1 --2- 172.21.15.28:0/444215573 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0e40065a60 0x7f0e40067f20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:32.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.490+0000 7f0e663bf640 1 --2- 172.21.15.28:0/444215573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e6013e1a0 0x7f0e6013e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:32.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.490+0000 7f0e663bf640 1 --2- 172.21.15.28:0/444215573 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0e601474a0 0x7f0e60147920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:32.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.490+0000 7f0e663bf640 1 --2- 172.21.15.28:0/444215573 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e4c003f30 0x7f0e600b9d90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:32.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.490+0000 7f0e663bf640 1 -- 172.21.15.28:0/444215573 >> 172.21.15.28:0/444215573 conn(0x7f0e600b9050 msgr2=0x7f0e6014c240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:32.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.490+0000 7f0e663bf640 1 -- 172.21.15.28:0/444215573 shutdown_connections 2023-11-16T02:29:32.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:32.490+0000 7f0e663bf640 1 -- 172.21.15.28:0/444215573 wait complete. 2023-11-16T02:29:34.509 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-16T02:29:34.609 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:29:34.617 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:29:34.623 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:29:34.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.638+0000 7f5c4ff13640 1 Processor -- start 2023-11-16T02:29:34.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.638+0000 7f5c4ff13640 1 -- start start 2023-11-16T02:29:34.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.638+0000 7f5c4ff13640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f5c480b32c0 0x7f5c480b8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:34.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.638+0000 7f5c4ff13640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c480708f0 con 0x7f5c480b8f70 2023-11-16T02:29:34.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.638+0000 7f5c4ff13640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c48070bb0 con 0x7f5c48070140 2023-11-16T02:29:34.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.638+0000 7f5c4ff13640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c480b2af0 con 0x7f5c480b32c0 2023-11-16T02:29:34.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.638+0000 7f5c4e4b0640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f5c480b8f70 0x7f5c481428e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:32800/0 (socket says 172.21.15.28:32800) 2023-11-16T02:29:34.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.638+0000 7f5c4e4b0640 1 -- 172.21.15.28:0/1554148776 learned_addr learned my addr 172.21.15.28:0/1554148776 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:34.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.638+0000 7f5c4d4ae640 1 --2- 172.21.15.28:0/1554148776 >> v2:172.21.15.70:3300/0 conn(0x7f5c480b32c0 0x7f5c480b8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:34.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.638+0000 7f5c4ccad640 1 -- 172.21.15.28:0/1554148776 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2423727848 0 0) 0x7f5c480708f0 con 0x7f5c480b8f70 2023-11-16T02:29:34.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.638+0000 7f5c4ccad640 1 -- 172.21.15.28:0/1554148776 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c34003530 con 0x7f5c480b8f70 2023-11-16T02:29:34.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.638+0000 7f5c4ccad640 1 -- 172.21.15.28:0/1554148776 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 285308994 0 0) 0x7f5c34003530 con 0x7f5c480b8f70 2023-11-16T02:29:34.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.638+0000 7f5c4d4ae640 1 -- 172.21.15.28:0/1554148776 >> v1:172.21.15.70:6789/0 conn(0x7f5c48070140 legacy=0x7f5c48071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:34.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.638+0000 7f5c4d4ae640 1 -- 172.21.15.28:0/1554148776 >> v1:172.21.15.28:6789/0 conn(0x7f5c480b8f70 legacy=0x7f5c481428e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:34.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.638+0000 7f5c4d4ae640 1 -- 172.21.15.28:0/1554148776 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c48070e90 con 0x7f5c480b32c0 2023-11-16T02:29:34.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.642+0000 7f5c4d4ae640 1 --2- 172.21.15.28:0/1554148776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c480b32c0 0x7f5c480b8a30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5c380097c0 tx=0x7f5c3801c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b539d2e2f9a3e5b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:34.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.642+0000 7f5c4ccad640 1 -- 172.21.15.28:0/1554148776 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c40001a50 con 0x7f5c480b32c0 2023-11-16T02:29:34.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.642+0000 7f5c4ccad640 1 -- 172.21.15.28:0/1554148776 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c380a7050 con 0x7f5c480b32c0 2023-11-16T02:29:34.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.642+0000 7f5c4ccad640 1 -- 172.21.15.28:0/1554148776 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c380ab600 con 0x7f5c480b32c0 2023-11-16T02:29:34.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.642+0000 7f5c4ff13640 1 -- 172.21.15.28:0/1554148776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c480b32c0 msgr2=0x7f5c480b8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:34.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.642+0000 7f5c4ff13640 1 --2- 172.21.15.28:0/1554148776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c480b32c0 0x7f5c480b8a30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5c380097c0 tx=0x7f5c3801c310 comp rx=0 tx=0).stop 2023-11-16T02:29:34.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.642+0000 7f5c4ff13640 1 -- 172.21.15.28:0/1554148776 shutdown_connections 2023-11-16T02:29:34.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.642+0000 7f5c4ff13640 1 --2- 172.21.15.28:0/1554148776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c480b32c0 0x7f5c480b8a30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:34.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.642+0000 7f5c4ff13640 1 -- 172.21.15.28:0/1554148776 >> 172.21.15.28:0/1554148776 conn(0x7f5c480b9b20 msgr2=0x7f5c480b9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:34.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.642+0000 7f5c4ff13640 1 -- 172.21.15.28:0/1554148776 shutdown_connections 2023-11-16T02:29:34.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.642+0000 7f5c4ff13640 1 -- 172.21.15.28:0/1554148776 wait complete. 2023-11-16T02:29:34.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.642+0000 7f5c4ff13640 1 Processor -- start 2023-11-16T02:29:34.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.642+0000 7f5c4ff13640 1 -- start start 2023-11-16T02:29:34.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.642+0000 7f5c4ff13640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5c48070140 0x7f5c48140420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:34.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.642+0000 7f5c4ff13640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c480b32c0 0x7f5c481e1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:34.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.642+0000 7f5c4ff13640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c480b8f70 0x7f5c48130da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:34.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.642+0000 7f5c4ff13640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c480a0880 con 0x7f5c480b8f70 2023-11-16T02:29:34.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.642+0000 7f5c4ff13640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c481422c0 con 0x7f5c480b32c0 2023-11-16T02:29:34.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.642+0000 7f5c4ff13640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c481e0d10 con 0x7f5c48070140 2023-11-16T02:29:34.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.642+0000 7f5c4e4b0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c480b8f70 0x7f5c48130da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:34.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.642+0000 7f5c4e4b0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c480b8f70 0x7f5c48130da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38292/0 (socket says 172.21.15.28:38292) 2023-11-16T02:29:34.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.642+0000 7f5c4e4b0640 1 -- 172.21.15.28:0/4035564186 learned_addr learned my addr 172.21.15.28:0/4035564186 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:34.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.642+0000 7f5c4d4ae640 1 --2- 172.21.15.28:0/4035564186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c480b32c0 0x7f5c481e1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:34.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.642+0000 7f5c4dcaf640 1 --2- 172.21.15.28:0/4035564186 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5c48070140 0x7f5c48140420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:34.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.646+0000 7f5c4e4b0640 1 -- 172.21.15.28:0/4035564186 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5c48070140 msgr2=0x7f5c48140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:34.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.646+0000 7f5c4e4b0640 1 --2- 172.21.15.28:0/4035564186 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5c48070140 0x7f5c48140420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:34.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.646+0000 7f5c4e4b0640 1 -- 172.21.15.28:0/4035564186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c480b32c0 msgr2=0x7f5c481e1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:34.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.646+0000 7f5c4e4b0640 1 --2- 172.21.15.28:0/4035564186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c480b32c0 0x7f5c481e1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:34.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.646+0000 7f5c4e4b0640 1 -- 172.21.15.28:0/4035564186 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c38009420 con 0x7f5c480b8f70 2023-11-16T02:29:34.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.646+0000 7f5c4dcaf640 1 --2- 172.21.15.28:0/4035564186 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5c48070140 0x7f5c48140420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:34.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.646+0000 7f5c4d4ae640 1 --2- 172.21.15.28:0/4035564186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c480b32c0 0x7f5c481e1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:34.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.646+0000 7f5c4e4b0640 1 --2- 172.21.15.28:0/4035564186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c480b8f70 0x7f5c48130da0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5c4000cb10 tx=0x7f5c4000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:34.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.646+0000 7f5c3e7fc640 1 -- 172.21.15.28:0/4035564186 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4000ac70 con 0x7f5c480b8f70 2023-11-16T02:29:34.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.646+0000 7f5c3e7fc640 1 -- 172.21.15.28:0/4035564186 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4000add0 con 0x7f5c480b8f70 2023-11-16T02:29:34.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.646+0000 7f5c4ff13640 1 -- 172.21.15.28:0/4035564186 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c481e0ff0 con 0x7f5c480b8f70 2023-11-16T02:29:34.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.646+0000 7f5c3e7fc640 1 -- 172.21.15.28:0/4035564186 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c40012640 con 0x7f5c480b8f70 2023-11-16T02:29:34.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.646+0000 7f5c4ff13640 1 -- 172.21.15.28:0/4035564186 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c481e09e0 con 0x7f5c480b8f70 2023-11-16T02:29:34.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.646+0000 7f5c4ff13640 1 -- 172.21.15.28:0/4035564186 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c48066f00 con 0x7f5c480b8f70 2023-11-16T02:29:34.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.646+0000 7f5c3e7fc640 1 -- 172.21.15.28:0/4035564186 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5c4001b3b0 con 0x7f5c480b8f70 2023-11-16T02:29:34.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.646+0000 7f5c3e7fc640 1 --2- 172.21.15.28:0/4035564186 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5c2c065a60 0x7f5c2c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:34.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.646+0000 7f5c3e7fc640 1 -- 172.21.15.28:0/4035564186 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5c40082dc0 con 0x7f5c480b8f70 2023-11-16T02:29:34.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.646+0000 7f5c4dcaf640 1 --2- 172.21.15.28:0/4035564186 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5c2c065a60 0x7f5c2c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:34.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.646+0000 7f5c4dcaf640 1 --2- 172.21.15.28:0/4035564186 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5c2c065a60 0x7f5c2c067f20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5c44000f70 tx=0x7f5c44009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:34.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.650+0000 7f5c3e7fc640 1 -- 172.21.15.28:0/4035564186 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f5c40050b60 con 0x7f5c480b8f70 2023-11-16T02:29:34.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.838+0000 7f5c4ff13640 1 -- 172.21.15.28:0/4035564186 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c480b9990 con 0x7f5c480b8f70 2023-11-16T02:29:34.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.838+0000 7f5c3e7fc640 1 -- 172.21.15.28:0/4035564186 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2765 (secure 0 0 0) 0x7f5c40017090 con 0x7f5c480b8f70 2023-11-16T02:29:34.840 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:34.840 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/4054669002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":4054669002},{"type":"v1","addr":"172.21.15.28:6836","nonce":4054669002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/903740631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":903740631},{"type":"v1","addr":"172.21.15.70:6833","nonce":903740631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6837/1025130674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1025130674},{"type":"v1","addr":"172.21.15.28:6837","nonce":1025130674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-11-16T02:29:34.840 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 3 2023-11-16T02:29:34.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.838+0000 7f5c4ff13640 1 -- 172.21.15.28:0/4035564186 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5c2c065a60 msgr2=0x7f5c2c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:34.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.838+0000 7f5c4ff13640 1 --2- 172.21.15.28:0/4035564186 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5c2c065a60 0x7f5c2c067f20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5c44000f70 tx=0x7f5c44009040 comp rx=0 tx=0).stop 2023-11-16T02:29:34.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.838+0000 7f5c4ff13640 1 -- 172.21.15.28:0/4035564186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c480b8f70 msgr2=0x7f5c48130da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:34.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.838+0000 7f5c4ff13640 1 --2- 172.21.15.28:0/4035564186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c480b8f70 0x7f5c48130da0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5c4000cb10 tx=0x7f5c4000a060 comp rx=0 tx=0).stop 2023-11-16T02:29:34.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.838+0000 7f5c4ff13640 1 -- 172.21.15.28:0/4035564186 shutdown_connections 2023-11-16T02:29:34.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.838+0000 7f5c4ff13640 1 --2- 172.21.15.28:0/4035564186 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5c2c065a60 0x7f5c2c067f20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:34.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.838+0000 7f5c4ff13640 1 --2- 172.21.15.28:0/4035564186 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5c480b8f70 0x7f5c48130da0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:34.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.838+0000 7f5c4ff13640 1 --2- 172.21.15.28:0/4035564186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c480b32c0 0x7f5c481e1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:34.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.838+0000 7f5c4ff13640 1 --2- 172.21.15.28:0/4035564186 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5c48070140 0x7f5c48140420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:34.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.838+0000 7f5c4ff13640 1 -- 172.21.15.28:0/4035564186 >> 172.21.15.28:0/4035564186 conn(0x7f5c480b9b20 msgr2=0x7f5c4813d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:34.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.838+0000 7f5c4ff13640 1 -- 172.21.15.28:0/4035564186 shutdown_connections 2023-11-16T02:29:34.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.838+0000 7f5c4ff13640 1 -- 172.21.15.28:0/4035564186 wait complete. 2023-11-16T02:29:34.857 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-16T02:29:34.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.978+0000 7fcfa3b12640 1 Processor -- start 2023-11-16T02:29:34.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.978+0000 7fcfa3b12640 1 -- start start 2023-11-16T02:29:34.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.978+0000 7fcfa3b12640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf9c0b82c0 0x7fcf9c147c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:34.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.978+0000 7fcfa3b12640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fcf9c1481a0 0x7fcf9c152190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:34.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.978+0000 7fcfa3b12640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf9c0b8700 con 0x7fcf9c0bc900 2023-11-16T02:29:34.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.978+0000 7fcfa3b12640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf9c071b50 con 0x7fcf9c1481a0 2023-11-16T02:29:34.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.978+0000 7fcfa3b12640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c148610 con 0x7fcf9c0b82c0 2023-11-16T02:29:34.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.978+0000 7fcfa18ae640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fcf9c0bc900 0x7fcf9c1416d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:32802/0 (socket says 172.21.15.28:32802) 2023-11-16T02:29:34.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.978+0000 7fcfa18ae640 1 -- 172.21.15.28:0/2578340494 learned_addr learned my addr 172.21.15.28:0/2578340494 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:34.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa08ac640 1 -- 172.21.15.28:0/2578340494 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2044053818 0 0) 0x7fcf9c0b8700 con 0x7fcf9c0bc900 2023-11-16T02:29:34.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa20af640 1 --2- 172.21.15.28:0/2578340494 >> v2:172.21.15.70:3300/0 conn(0x7fcf9c1481a0 0x7fcf9c152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:34.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa10ad640 1 --2- 172.21.15.28:0/2578340494 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf9c0b82c0 0x7fcf9c147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:34.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa08ac640 1 -- 172.21.15.28:0/2578340494 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf88003530 con 0x7fcf9c0bc900 2023-11-16T02:29:34.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa08ac640 1 -- 172.21.15.28:0/2578340494 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3911246990 0 0) 0x7fcf88003530 con 0x7fcf9c0bc900 2023-11-16T02:29:34.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa08ac640 1 -- 172.21.15.28:0/2578340494 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf9c0b82c0 msgr2=0x7fcf9c147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:34.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa08ac640 1 --2- 172.21.15.28:0/2578340494 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf9c0b82c0 0x7fcf9c147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:34.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa08ac640 1 -- 172.21.15.28:0/2578340494 >> v2:172.21.15.70:3300/0 conn(0x7fcf9c1481a0 msgr2=0x7fcf9c152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:34.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa08ac640 1 --2- 172.21.15.28:0/2578340494 >> v2:172.21.15.70:3300/0 conn(0x7fcf9c1481a0 0x7fcf9c152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:34.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa08ac640 1 -- 172.21.15.28:0/2578340494 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c0712b0 con 0x7fcf9c0bc900 2023-11-16T02:29:34.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa08ac640 1 -- 172.21.15.28:0/2578340494 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7fcf98001680 con 0x7fcf9c0bc900 2023-11-16T02:29:34.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa08ac640 1 -- 172.21.15.28:0/2578340494 >> v1:172.21.15.28:6789/0 conn(0x7fcf9c0bc900 legacy=0x7fcf9c1416d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:34.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa08ac640 1 --2- 172.21.15.28:0/2578340494 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf88003980 0x7fcf88003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:34.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa08ac640 1 --2- 172.21.15.28:0/2578340494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf880047d0 0x7fcf88004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:34.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa08ac640 1 --2- 172.21.15.28:0/2578340494 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf9c0b82c0 0x7fcf88005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:34.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa08ac640 1 -- 172.21.15.28:0/2578340494 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c071b50 con 0x7fcf88003980 2023-11-16T02:29:34.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa08ac640 1 -- 172.21.15.28:0/2578340494 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c148610 con 0x7fcf880047d0 2023-11-16T02:29:34.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa08ac640 1 -- 172.21.15.28:0/2578340494 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8800b990 con 0x7fcf9c0b82c0 2023-11-16T02:29:34.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa18ae640 1 --2- 172.21.15.28:0/2578340494 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf88003980 0x7fcf88003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:34.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa10ad640 1 --2- 172.21.15.28:0/2578340494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf880047d0 0x7fcf88004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:34.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa20af640 1 --2- 172.21.15.28:0/2578340494 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf9c0b82c0 0x7fcf88005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:34.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa18ae640 1 -- 172.21.15.28:0/2578340494 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf9c0b82c0 msgr2=0x7fcf88005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:34.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa18ae640 1 --2- 172.21.15.28:0/2578340494 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf9c0b82c0 0x7fcf88005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:34.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa18ae640 1 -- 172.21.15.28:0/2578340494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf880047d0 msgr2=0x7fcf88004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:34.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa18ae640 1 --2- 172.21.15.28:0/2578340494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf880047d0 0x7fcf88004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:34.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa18ae640 1 -- 172.21.15.28:0/2578340494 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf88003530 con 0x7fcf88003980 2023-11-16T02:29:34.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa20af640 1 --2- 172.21.15.28:0/2578340494 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf9c0b82c0 0x7fcf88005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:34.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa10ad640 1 --2- 172.21.15.28:0/2578340494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf880047d0 0x7fcf88004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:34.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa18ae640 1 --2- 172.21.15.28:0/2578340494 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf88003980 0x7fcf88003da0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800c290 tx=0x7fcf9801cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df5dc1858b37f26 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:34.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa08ac640 1 -- 172.21.15.28:0/2578340494 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf980058e0 con 0x7fcf88003980 2023-11-16T02:29:34.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa08ac640 1 -- 172.21.15.28:0/2578340494 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf98005a40 con 0x7fcf88003980 2023-11-16T02:29:34.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa08ac640 1 -- 172.21.15.28:0/2578340494 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf98005df0 con 0x7fcf88003980 2023-11-16T02:29:34.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa3b12640 1 -- 172.21.15.28:0/2578340494 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf88003980 msgr2=0x7fcf88003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:34.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa3b12640 1 --2- 172.21.15.28:0/2578340494 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf88003980 0x7fcf88003da0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800c290 tx=0x7fcf9801cce0 comp rx=0 tx=0).stop 2023-11-16T02:29:34.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa20af640 1 -- 172.21.15.28:0/2578340494 reap_dead start 2023-11-16T02:29:34.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa3b12640 1 -- 172.21.15.28:0/2578340494 shutdown_connections 2023-11-16T02:29:34.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.982+0000 7fcfa3b12640 1 -- 172.21.15.28:0/2578340494 >> 172.21.15.28:0/2578340494 conn(0x7fcf9c0b9050 msgr2=0x7fcf9c0bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:34.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcfa3b12640 1 -- 172.21.15.28:0/2578340494 shutdown_connections 2023-11-16T02:29:34.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcfa3b12640 1 -- 172.21.15.28:0/2578340494 wait complete. 2023-11-16T02:29:34.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcfa3b12640 1 Processor -- start 2023-11-16T02:29:34.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcfa3b12640 1 -- start start 2023-11-16T02:29:34.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcfa3b12640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf88003980 0x7fcf9c140e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:34.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcfa3b12640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf9c145680 0x7fcf9c13ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:34.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcfa3b12640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf9c13fbb0 0x7fcf9c140010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:34.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcfa3b12640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c13bfb0 con 0x7fcf9c13fbb0 2023-11-16T02:29:34.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcfa3b12640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c13ac60 con 0x7fcf88003980 2023-11-16T02:29:34.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcfa3b12640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9c13a980 con 0x7fcf9c145680 2023-11-16T02:29:34.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcfa20af640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf9c13fbb0 0x7fcf9c140010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:34.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcfa20af640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf9c13fbb0 0x7fcf9c140010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38302/0 (socket says 172.21.15.28:38302) 2023-11-16T02:29:34.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcfa20af640 1 -- 172.21.15.28:0/2654006459 learned_addr learned my addr 172.21.15.28:0/2654006459 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:34.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcfa18ae640 1 --2- 172.21.15.28:0/2654006459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf88003980 0x7fcf9c140e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:34.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcfa10ad640 1 --2- 172.21.15.28:0/2654006459 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf9c145680 0x7fcf9c13ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:34.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcfa20af640 1 -- 172.21.15.28:0/2654006459 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf9c145680 msgr2=0x7fcf9c13ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:34.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcfa20af640 1 --2- 172.21.15.28:0/2654006459 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf9c145680 0x7fcf9c13ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:34.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcfa20af640 1 -- 172.21.15.28:0/2654006459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf88003980 msgr2=0x7fcf9c140e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:34.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcfa20af640 1 --2- 172.21.15.28:0/2654006459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf88003980 0x7fcf9c140e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:34.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcfa20af640 1 -- 172.21.15.28:0/2654006459 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c145ae0 con 0x7fcf9c13fbb0 2023-11-16T02:29:34.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcfa20af640 1 --2- 172.21.15.28:0/2654006459 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf9c13fbb0 0x7fcf9c140010 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c0bd040 tx=0x7fcf9400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:34.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcf927fc640 1 -- 172.21.15.28:0/2654006459 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf94016620 con 0x7fcf9c13fbb0 2023-11-16T02:29:34.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcf927fc640 1 -- 172.21.15.28:0/2654006459 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf94016780 con 0x7fcf9c13fbb0 2023-11-16T02:29:34.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcfa3b12640 1 -- 172.21.15.28:0/2654006459 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf9c140630 con 0x7fcf9c13fbb0 2023-11-16T02:29:34.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcf927fc640 1 -- 172.21.15.28:0/2654006459 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf94016b10 con 0x7fcf9c13fbb0 2023-11-16T02:29:34.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcfa3b12640 1 -- 172.21.15.28:0/2654006459 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf9c13a610 con 0x7fcf9c13fbb0 2023-11-16T02:29:34.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.986+0000 7fcfa3b12640 1 -- 172.21.15.28:0/2654006459 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf9c13a7d0 con 0x7fcf9c13fbb0 2023-11-16T02:29:34.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.990+0000 7fcf927fc640 1 -- 172.21.15.28:0/2654006459 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcf94016c70 con 0x7fcf9c13fbb0 2023-11-16T02:29:34.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.990+0000 7fcf927fc640 1 --2- 172.21.15.28:0/2654006459 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fcf80065a90 0x7fcf80067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:34.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.990+0000 7fcf927fc640 1 -- 172.21.15.28:0/2654006459 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcf94083b80 con 0x7fcf9c13fbb0 2023-11-16T02:29:34.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.990+0000 7fcfa18ae640 1 --2- 172.21.15.28:0/2654006459 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fcf80065a90 0x7fcf80067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:34.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.990+0000 7fcfa18ae640 1 --2- 172.21.15.28:0/2654006459 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fcf80065a90 0x7fcf80067f50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcf980aa000 tx=0x7fcf98001a10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:34.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:34.994+0000 7fcf927fc640 1 -- 172.21.15.28:0/2654006459 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fcf94051920 con 0x7fcf9c13fbb0 2023-11-16T02:29:35.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.146+0000 7fcfa3b12640 1 -- 172.21.15.28:0/2654006459 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf9c04e8a0 con 0x7fcf9c13fbb0 2023-11-16T02:29:35.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.146+0000 7fcf927fc640 1 -- 172.21.15.28:0/2654006459 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12334 (secure 0 0 0) 0x7fcf94054f40 con 0x7fcf9c13fbb0 2023-11-16T02:29:35.150 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:35.150 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":18,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","created":"2023-11-16T02:29:13.710567+0000","modified":"2023-11-16T02:29:28.504308+0000","last_up_change":"2023-11-16T02:29:24.841087+0000","last_in_change":"2023-11-16T02:29:16.024490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-16T02:29:26.490910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dfa8b58d-3481-4e68-86e8-21873d31d0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":38722},{"type":"v1","addr":"172.21.15.28:6809","nonce":38722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":38722},{"type":"v1","addr":"172.21.15.28:6811","nonce":38722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":38722},{"type":"v1","addr":"172.21.15.28:6815","nonce":38722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":38722},{"type":"v1","addr":"172.21.15.28:6813","nonce":38722}]},"public_addr":"172.21.15.28:6809/38722","cluster_addr":"172.21.15.28:6811/38722","heartbeat_back_addr":"172.21.15.28:6815/38722","heartbeat_front_addr":"172.21.15.28:6813/38722","state":["exists","up"]},{"osd":1,"uuid":"1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":38724},{"type":"v1","addr":"172.21.15.28:6824","nonce":38724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":38724},{"type":"v1","addr":"172.21.15.28:6827","nonce":38724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":38724},{"type":"v1","addr":"172.21.15.28:6831","nonce":38724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":38724},{"type":"v1","addr":"172.21.15.28:6829","nonce":38724}]},"public_addr":"172.21.15.28:6824/38724","cluster_addr":"172.21.15.28:6827/38724","heartbeat_back_addr":"172.21.15.28:6831/38724","heartbeat_front_addr":"172.21.15.28:6829/38724","state":["exists","up"]},{"osd":2,"uuid":"e18f39cd-6a35-4d36-9eed-3877794bf2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":38723},{"type":"v1","addr":"172.21.15.28:6801","nonce":38723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":38723},{"type":"v1","addr":"172.21.15.28:6803","nonce":38723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":38723},{"type":"v1","addr":"172.21.15.28:6807","nonce":38723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":38723},{"type":"v1","addr":"172.21.15.28:6805","nonce":38723}]},"public_addr":"172.21.15.28:6801/38723","cluster_addr":"172.21.15.28:6803/38723","heartbeat_back_addr":"172.21.15.28:6807/38723","heartbeat_front_addr":"172.21.15.28:6805/38723","state":["exists","up"]},{"osd":3,"uuid":"303d0728-409d-47d7-b7a6-6eb273f602fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":38725},{"type":"v1","addr":"172.21.15.28:6817","nonce":38725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":38725},{"type":"v1","addr":"172.21.15.28:6819","nonce":38725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":38725},{"type":"v1","addr":"172.21.15.28:6825","nonce":38725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":38725},{"type":"v1","addr":"172.21.15.28:6821","nonce":38725}]},"public_addr":"172.21.15.28:6817/38725","cluster_addr":"172.21.15.28:6819/38725","heartbeat_back_addr":"172.21.15.28:6825/38725","heartbeat_front_addr":"172.21.15.28:6821/38725","state":["exists","up"]},{"osd":4,"uuid":"df0bf0ac-6efe-4964-ad27-7c1771a70c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":38828},{"type":"v1","addr":"172.21.15.70:6801","nonce":38828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":38828},{"type":"v1","addr":"172.21.15.70:6803","nonce":38828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":38828},{"type":"v1","addr":"172.21.15.70:6807","nonce":38828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":38828},{"type":"v1","addr":"172.21.15.70:6805","nonce":38828}]},"public_addr":"172.21.15.70:6801/38828","cluster_addr":"172.21.15.70:6803/38828","heartbeat_back_addr":"172.21.15.70:6807/38828","heartbeat_front_addr":"172.21.15.70:6805/38828","state":["exists","up"]},{"osd":5,"uuid":"84921219-65cb-4c4e-b9ed-a773db639034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":38830},{"type":"v1","addr":"172.21.15.70:6810","nonce":38830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6813","nonce":38830},{"type":"v1","addr":"172.21.15.70:6814","nonce":38830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":38830},{"type":"v1","addr":"172.21.15.70:6824","nonce":38830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":38830},{"type":"v1","addr":"172.21.15.70:6819","nonce":38830}]},"public_addr":"172.21.15.70:6810/38830","cluster_addr":"172.21.15.70:6814/38830","heartbeat_back_addr":"172.21.15.70:6824/38830","heartbeat_front_addr":"172.21.15.70:6819/38830","state":["exists","up"]},{"osd":6,"uuid":"c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":38829},{"type":"v1","addr":"172.21.15.70:6812","nonce":38829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":38829},{"type":"v1","addr":"172.21.15.70:6820","nonce":38829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":38829},{"type":"v1","addr":"172.21.15.70:6828","nonce":38829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":38829},{"type":"v1","addr":"172.21.15.70:6825","nonce":38829}]},"public_addr":"172.21.15.70:6812/38829","cluster_addr":"172.21.15.70:6820/38829","heartbeat_back_addr":"172.21.15.70:6828/38829","heartbeat_front_addr":"172.21.15.70:6825/38829","state":["exists","up"]},{"osd":7,"uuid":"e2cdd418-12ce-4eea-9b22-efdad83eb76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":38839},{"type":"v1","addr":"172.21.15.70:6815","nonce":38839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":38839},{"type":"v1","addr":"172.21.15.70:6823","nonce":38839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":38839},{"type":"v1","addr":"172.21.15.70:6831","nonce":38839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6827","nonce":38839},{"type":"v1","addr":"172.21.15.70:6829","nonce":38839}]},"public_addr":"172.21.15.70:6815/38839","cluster_addr":"172.21.15.70:6823/38839","heartbeat_back_addr":"172.21.15.70:6831/38839","heartbeat_front_addr":"172.21.15.70:6829/38839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.544240+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.637637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.352115+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.652916+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.624477+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.570247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.706468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.696574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-16T02:29:35.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.150+0000 7fcfa3b12640 1 -- 172.21.15.28:0/2654006459 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fcf80065a90 msgr2=0x7fcf80067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:35.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.150+0000 7fcfa3b12640 1 --2- 172.21.15.28:0/2654006459 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fcf80065a90 0x7fcf80067f50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcf980aa000 tx=0x7fcf98001a10 comp rx=0 tx=0).stop 2023-11-16T02:29:35.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.150+0000 7fcfa3b12640 1 -- 172.21.15.28:0/2654006459 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf9c13fbb0 msgr2=0x7fcf9c140010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:35.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.150+0000 7fcfa3b12640 1 --2- 172.21.15.28:0/2654006459 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf9c13fbb0 0x7fcf9c140010 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c0bd040 tx=0x7fcf9400f520 comp rx=0 tx=0).stop 2023-11-16T02:29:35.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.150+0000 7fcfa3b12640 1 -- 172.21.15.28:0/2654006459 shutdown_connections 2023-11-16T02:29:35.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.150+0000 7fcfa3b12640 1 --2- 172.21.15.28:0/2654006459 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fcf80065a90 0x7fcf80067f50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.150+0000 7fcfa3b12640 1 --2- 172.21.15.28:0/2654006459 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf9c13fbb0 0x7fcf9c140010 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.150+0000 7fcfa3b12640 1 --2- 172.21.15.28:0/2654006459 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fcf9c145680 0x7fcf9c13ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.150+0000 7fcfa3b12640 1 --2- 172.21.15.28:0/2654006459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf88003980 0x7fcf9c140e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.150+0000 7fcfa3b12640 1 -- 172.21.15.28:0/2654006459 >> 172.21.15.28:0/2654006459 conn(0x7fcf9c0b9050 msgr2=0x7fcf9c06edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:35.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.150+0000 7fcfa3b12640 1 -- 172.21.15.28:0/2654006459 shutdown_connections 2023-11-16T02:29:35.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.150+0000 7fcfa3b12640 1 -- 172.21.15.28:0/2654006459 wait complete. 2023-11-16T02:29:35.167 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-16T02:29:26.490910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-16T02:29:35.168 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-16T02:29:35.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.294+0000 7fbec9853640 1 Processor -- start 2023-11-16T02:29:35.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.294+0000 7fbec9853640 1 -- start start 2023-11-16T02:29:35.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.294+0000 7fbec9853640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbec40b6900 0x7fbec40b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:35.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.294+0000 7fbec9853640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbec40b6ce0 0x7fbec414ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:35.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.294+0000 7fbec9853640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbec414ac10 0x7fbec4069d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:35.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.294+0000 7fbec9853640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec414b0a0 con 0x7fbec40b6900 2023-11-16T02:29:35.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.294+0000 7fbec9853640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec40b4160 con 0x7fbec414ac10 2023-11-16T02:29:35.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.294+0000 7fbec9853640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec414e160 con 0x7fbec40b6ce0 2023-11-16T02:29:35.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.294+0000 7fbec2ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbec40b6900 0x7fbec40b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:35.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.294+0000 7fbec2ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbec40b6900 0x7fbec40b3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38306/0 (socket says 172.21.15.28:38306) 2023-11-16T02:29:35.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.294+0000 7fbec2ffd640 1 -- 172.21.15.28:0/1075058869 learned_addr learned my addr 172.21.15.28:0/1075058869 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:35.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.294+0000 7fbec27fc640 1 --2- 172.21.15.28:0/1075058869 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbec40b6ce0 0x7fbec414ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:35.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.294+0000 7fbec37fe640 1 --2- 172.21.15.28:0/1075058869 >> v2:172.21.15.70:3300/0 conn(0x7fbec414ac10 0x7fbec4069d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:35.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.294+0000 7fbec2ffd640 1 -- 172.21.15.28:0/1075058869 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbec40b6ce0 msgr2=0x7fbec414ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:35.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.294+0000 7fbec2ffd640 1 --2- 172.21.15.28:0/1075058869 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbec40b6ce0 0x7fbec414ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.294+0000 7fbec2ffd640 1 -- 172.21.15.28:0/1075058869 >> v2:172.21.15.70:3300/0 conn(0x7fbec414ac10 msgr2=0x7fbec4069d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:35.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.294+0000 7fbec2ffd640 1 --2- 172.21.15.28:0/1075058869 >> v2:172.21.15.70:3300/0 conn(0x7fbec414ac10 0x7fbec4069d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.294+0000 7fbec2ffd640 1 -- 172.21.15.28:0/1075058869 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec414e440 con 0x7fbec40b6900 2023-11-16T02:29:35.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.294+0000 7fbec37fe640 1 --2- 172.21.15.28:0/1075058869 >> v2:172.21.15.70:3300/0 conn(0x7fbec414ac10 0x7fbec4069d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:29:35.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.298+0000 7fbec2ffd640 1 --2- 172.21.15.28:0/1075058869 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbec40b6900 0x7fbec40b3b60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbec406c460 tx=0x7fbeb401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00901c61e862ab4 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:35.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.298+0000 7fbec1ffb640 1 -- 172.21.15.28:0/1075058869 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb40ab600 con 0x7fbec40b6900 2023-11-16T02:29:35.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.298+0000 7fbec1ffb640 1 -- 172.21.15.28:0/1075058869 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb40a7050 con 0x7fbec40b6900 2023-11-16T02:29:35.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.298+0000 7fbec1ffb640 1 -- 172.21.15.28:0/1075058869 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb40ab980 con 0x7fbec40b6900 2023-11-16T02:29:35.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.298+0000 7fbec9853640 1 -- 172.21.15.28:0/1075058869 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbec40b6900 msgr2=0x7fbec40b3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:35.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.298+0000 7fbec9853640 1 --2- 172.21.15.28:0/1075058869 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbec40b6900 0x7fbec40b3b60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbec406c460 tx=0x7fbeb401c3e0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.298+0000 7fbec9853640 1 -- 172.21.15.28:0/1075058869 shutdown_connections 2023-11-16T02:29:35.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.298+0000 7fbec9853640 1 --2- 172.21.15.28:0/1075058869 >> v2:172.21.15.70:3300/0 conn(0x7fbec414ac10 0x7fbec4069d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.298+0000 7fbec9853640 1 --2- 172.21.15.28:0/1075058869 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbec40b6ce0 0x7fbec414ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.298+0000 7fbec9853640 1 --2- 172.21.15.28:0/1075058869 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbec40b6900 0x7fbec40b3b60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.298+0000 7fbec9853640 1 -- 172.21.15.28:0/1075058869 >> 172.21.15.28:0/1075058869 conn(0x7fbec40bd310 msgr2=0x7fbec40bd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:35.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.298+0000 7fbec9853640 1 -- 172.21.15.28:0/1075058869 shutdown_connections 2023-11-16T02:29:35.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.298+0000 7fbec9853640 1 -- 172.21.15.28:0/1075058869 wait complete. 2023-11-16T02:29:35.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.298+0000 7fbec9853640 1 Processor -- start 2023-11-16T02:29:35.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.298+0000 7fbec9853640 1 -- start start 2023-11-16T02:29:35.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.298+0000 7fbec9853640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbec40b6900 0x7fbec41e2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:35.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.298+0000 7fbec9853640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbec40b6ce0 0x7fbec41e68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:35.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.298+0000 7fbec9853640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbec414ac10 0x7fbec40b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:35.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.298+0000 7fbec9853640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec414d450 con 0x7fbec414ac10 2023-11-16T02:29:35.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.298+0000 7fbec9853640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec41e3670 con 0x7fbec40b6900 2023-11-16T02:29:35.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.298+0000 7fbec9853640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec41e3950 con 0x7fbec40b6ce0 2023-11-16T02:29:35.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.298+0000 7fbec37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbec414ac10 0x7fbec40b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:35.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.298+0000 7fbec37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbec414ac10 0x7fbec40b57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38310/0 (socket says 172.21.15.28:38310) 2023-11-16T02:29:35.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.298+0000 7fbec37fe640 1 -- 172.21.15.28:0/502167171 learned_addr learned my addr 172.21.15.28:0/502167171 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:35.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.302+0000 7fbec2ffd640 1 --2- 172.21.15.28:0/502167171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbec40b6900 0x7fbec41e2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:35.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.302+0000 7fbec27fc640 1 --2- 172.21.15.28:0/502167171 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbec40b6ce0 0x7fbec41e68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:35.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.302+0000 7fbec37fe640 1 -- 172.21.15.28:0/502167171 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbec40b6ce0 msgr2=0x7fbec41e68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:35.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.302+0000 7fbec37fe640 1 --2- 172.21.15.28:0/502167171 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbec40b6ce0 0x7fbec41e68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.302+0000 7fbec37fe640 1 -- 172.21.15.28:0/502167171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbec40b6900 msgr2=0x7fbec41e2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:35.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.302+0000 7fbec37fe640 1 --2- 172.21.15.28:0/502167171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbec40b6900 0x7fbec41e2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.302+0000 7fbec37fe640 1 -- 172.21.15.28:0/502167171 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb40094d0 con 0x7fbec414ac10 2023-11-16T02:29:35.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.302+0000 7fbec2ffd640 1 --2- 172.21.15.28:0/502167171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbec40b6900 0x7fbec41e2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:35.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.302+0000 7fbec37fe640 1 --2- 172.21.15.28:0/502167171 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbec414ac10 0x7fbec40b57f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbebc007ef0 tx=0x7fbebc00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:35.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.302+0000 7fbeabfff640 1 -- 172.21.15.28:0/502167171 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc003ba0 con 0x7fbec414ac10 2023-11-16T02:29:35.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.302+0000 7fbeabfff640 1 -- 172.21.15.28:0/502167171 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc00f040 con 0x7fbec414ac10 2023-11-16T02:29:35.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.302+0000 7fbeabfff640 1 -- 172.21.15.28:0/502167171 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc00de80 con 0x7fbec414ac10 2023-11-16T02:29:35.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.302+0000 7fbec9853640 1 -- 172.21.15.28:0/502167171 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec41e60d0 con 0x7fbec414ac10 2023-11-16T02:29:35.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.302+0000 7fbec9853640 1 -- 172.21.15.28:0/502167171 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec413f8a0 con 0x7fbec414ac10 2023-11-16T02:29:35.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.302+0000 7fbec9853640 1 -- 172.21.15.28:0/502167171 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec41e65f0 con 0x7fbec414ac10 2023-11-16T02:29:35.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.302+0000 7fbeabfff640 1 -- 172.21.15.28:0/502167171 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbebc004030 con 0x7fbec414ac10 2023-11-16T02:29:35.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.302+0000 7fbeabfff640 1 --2- 172.21.15.28:0/502167171 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fbeb0065a60 0x7fbeb0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:35.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.302+0000 7fbeabfff640 1 -- 172.21.15.28:0/502167171 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbebc083010 con 0x7fbec414ac10 2023-11-16T02:29:35.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.302+0000 7fbec2ffd640 1 --2- 172.21.15.28:0/502167171 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fbeb0065a60 0x7fbeb0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:35.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.302+0000 7fbec2ffd640 1 --2- 172.21.15.28:0/502167171 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fbeb0065a60 0x7fbeb0067f20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbeb40ad000 tx=0x7fbeb4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:35.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.306+0000 7fbeabfff640 1 -- 172.21.15.28:0/502167171 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fbec41e65f0 con 0x7fbec414ac10 2023-11-16T02:29:35.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.458+0000 7fbec9853640 1 -- 172.21.15.28:0/502167171 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbec41e65f0 con 0x7fbec414ac10 2023-11-16T02:29:35.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.458+0000 7fbeabfff640 1 -- 172.21.15.28:0/502167171 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbebc01a020 con 0x7fbec414ac10 2023-11-16T02:29:35.462 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-11-16T02:29:35.464 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.462+0000 7fbec9853640 1 -- 172.21.15.28:0/502167171 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fbeb0065a60 msgr2=0x7fbeb0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:35.464 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.462+0000 7fbec9853640 1 --2- 172.21.15.28:0/502167171 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fbeb0065a60 0x7fbeb0067f20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbeb40ad000 tx=0x7fbeb4008040 comp rx=0 tx=0).stop 2023-11-16T02:29:35.464 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.462+0000 7fbec9853640 1 -- 172.21.15.28:0/502167171 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbec414ac10 msgr2=0x7fbec40b57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:35.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.462+0000 7fbec9853640 1 --2- 172.21.15.28:0/502167171 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbec414ac10 0x7fbec40b57f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbebc007ef0 tx=0x7fbebc00d4a0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.462+0000 7fbec9853640 1 -- 172.21.15.28:0/502167171 shutdown_connections 2023-11-16T02:29:35.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.462+0000 7fbec9853640 1 --2- 172.21.15.28:0/502167171 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fbeb0065a60 0x7fbeb0067f20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.462+0000 7fbec9853640 1 --2- 172.21.15.28:0/502167171 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbec414ac10 0x7fbec40b57f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.462+0000 7fbec9853640 1 --2- 172.21.15.28:0/502167171 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbec40b6ce0 0x7fbec41e68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.462+0000 7fbec9853640 1 --2- 172.21.15.28:0/502167171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbec40b6900 0x7fbec41e2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.462+0000 7fbec9853640 1 -- 172.21.15.28:0/502167171 >> 172.21.15.28:0/502167171 conn(0x7fbec40bd310 msgr2=0x7fbec40bd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:35.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.462+0000 7fbec9853640 1 -- 172.21.15.28:0/502167171 shutdown_connections 2023-11-16T02:29:35.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.462+0000 7fbec9853640 1 -- 172.21.15.28:0/502167171 wait complete. 2023-11-16T02:29:35.481 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-16T02:29:35.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.598+0000 7f07d6f3c640 1 Processor -- start 2023-11-16T02:29:35.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.598+0000 7f07d6f3c640 1 -- start start 2023-11-16T02:29:35.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.602+0000 7f07d6f3c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07d0148960 0x7f07d0148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:35.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.602+0000 7f07d6f3c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f07d00b3450 0x7f07d00b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:35.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.602+0000 7f07d6f3c640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07d00b52b0 con 0x7f07d00b8240 2023-11-16T02:29:35.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.602+0000 7f07d6f3c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07d00b3e20 con 0x7f07d00b3450 2023-11-16T02:29:35.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.602+0000 7f07d6f3c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d00bcdb0 con 0x7f07d0148960 2023-11-16T02:29:35.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.602+0000 7f07d54d9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f07d00b3450 0x7f07d00b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:35.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.602+0000 7f07d4cd8640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f07d00b8240 0x7f07d00bc6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:32818/0 (socket says 172.21.15.28:32818) 2023-11-16T02:29:35.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.602+0000 7f07d4cd8640 1 -- 172.21.15.28:0/3077362814 learned_addr learned my addr 172.21.15.28:0/3077362814 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:35.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.602+0000 7f07d54d9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f07d00b3450 0x7f07d00b38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38324/0 (socket says 172.21.15.28:38324) 2023-11-16T02:29:35.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.602+0000 7f07cffff640 1 --2- 172.21.15.28:0/3077362814 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07d0148960 0x7f07d0148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:35.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.602+0000 7f07d54d9640 1 -- 172.21.15.28:0/3077362814 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07d0148960 msgr2=0x7f07d0148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:35.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.602+0000 7f07d54d9640 1 --2- 172.21.15.28:0/3077362814 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07d0148960 0x7f07d0148dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.602+0000 7f07d54d9640 1 -- 172.21.15.28:0/3077362814 >> v1:172.21.15.28:6789/0 conn(0x7f07d00b8240 legacy=0x7f07d00bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:35.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.602+0000 7f07d54d9640 1 -- 172.21.15.28:0/3077362814 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d00b6220 con 0x7f07d00b3450 2023-11-16T02:29:35.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.602+0000 7f07cf7fe640 1 -- 172.21.15.28:0/3077362814 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633948751 0 0) 0x7f07d00b52b0 con 0x7f07d00b8240 2023-11-16T02:29:35.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.602+0000 7f07cffff640 1 --2- 172.21.15.28:0/3077362814 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07d0148960 0x7f07d0148dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:35.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.602+0000 7f07d54d9640 1 --2- 172.21.15.28:0/3077362814 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07d00b3450 0x7f07d00b38e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f07c80097c0 tx=0x7f07c801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486fa33f90cfffc1 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:35.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.602+0000 7f07cf7fe640 1 -- 172.21.15.28:0/3077362814 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c80ab650 con 0x7f07d00b3450 2023-11-16T02:29:35.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.602+0000 7f07cf7fe640 1 -- 172.21.15.28:0/3077362814 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c80ab7b0 con 0x7f07d00b3450 2023-11-16T02:29:35.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.602+0000 7f07cf7fe640 1 -- 172.21.15.28:0/3077362814 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c80abb40 con 0x7f07d00b3450 2023-11-16T02:29:35.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07d6f3c640 1 -- 172.21.15.28:0/3077362814 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07d00b3450 msgr2=0x7f07d00b38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:35.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07d6f3c640 1 --2- 172.21.15.28:0/3077362814 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07d00b3450 0x7f07d00b38e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f07c80097c0 tx=0x7f07c801c450 comp rx=0 tx=0).stop 2023-11-16T02:29:35.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07d6f3c640 1 -- 172.21.15.28:0/3077362814 shutdown_connections 2023-11-16T02:29:35.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07d6f3c640 1 --2- 172.21.15.28:0/3077362814 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07d00b3450 0x7f07d00b38e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07d6f3c640 1 --2- 172.21.15.28:0/3077362814 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07d0148960 0x7f07d0148dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07d6f3c640 1 -- 172.21.15.28:0/3077362814 >> 172.21.15.28:0/3077362814 conn(0x7f07d00b9050 msgr2=0x7f07d00bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:35.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07d6f3c640 1 -- 172.21.15.28:0/3077362814 shutdown_connections 2023-11-16T02:29:35.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07d6f3c640 1 -- 172.21.15.28:0/3077362814 wait complete. 2023-11-16T02:29:35.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07d6f3c640 1 Processor -- start 2023-11-16T02:29:35.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07d6f3c640 1 -- start start 2023-11-16T02:29:35.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07d6f3c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07d00b3450 0x7f07d0139d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:35.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07d6f3c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07d00b8240 0x7f07d0130280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:35.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07d6f3c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07d0148960 0x7f07d01307c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:35.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07d6f3c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d0135ef0 con 0x7f07d00b8240 2023-11-16T02:29:35.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07d6f3c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07d013a2b0 con 0x7f07d00b3450 2023-11-16T02:29:35.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07d6f3c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07d01e6620 con 0x7f07d0148960 2023-11-16T02:29:35.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07cffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07d00b8240 0x7f07d0130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:35.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07cffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07d00b8240 0x7f07d0130280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38340/0 (socket says 172.21.15.28:38340) 2023-11-16T02:29:35.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07cffff640 1 -- 172.21.15.28:0/1060425184 learned_addr learned my addr 172.21.15.28:0/1060425184 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:35.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07d54d9640 1 --2- 172.21.15.28:0/1060425184 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07d0148960 0x7f07d01307c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:35.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07cffff640 1 -- 172.21.15.28:0/1060425184 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07d0148960 msgr2=0x7f07d01307c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:35.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07d4cd8640 1 --2- 172.21.15.28:0/1060425184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07d00b3450 0x7f07d0139d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:35.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07cffff640 1 --2- 172.21.15.28:0/1060425184 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07d0148960 0x7f07d01307c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07cffff640 1 -- 172.21.15.28:0/1060425184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07d00b3450 msgr2=0x7f07d0139d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:35.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07cffff640 1 --2- 172.21.15.28:0/1060425184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07d00b3450 0x7f07d0139d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07cffff640 1 -- 172.21.15.28:0/1060425184 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c8009420 con 0x7f07d00b8240 2023-11-16T02:29:35.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07cffff640 1 --2- 172.21.15.28:0/1060425184 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07d00b8240 0x7f07d0130280 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f07b800c820 tx=0x7f07b800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:35.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07cd7fa640 1 -- 172.21.15.28:0/1060425184 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b8007a30 con 0x7f07d00b8240 2023-11-16T02:29:35.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07cd7fa640 1 -- 172.21.15.28:0/1060425184 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b8007b90 con 0x7f07d00b8240 2023-11-16T02:29:35.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07d6f3c640 1 -- 172.21.15.28:0/1060425184 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07d01e6900 con 0x7f07d00b8240 2023-11-16T02:29:35.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07cd7fa640 1 -- 172.21.15.28:0/1060425184 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b800ce10 con 0x7f07d00b8240 2023-11-16T02:29:35.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07d6f3c640 1 -- 172.21.15.28:0/1060425184 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07d013e6a0 con 0x7f07d00b8240 2023-11-16T02:29:35.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.606+0000 7f07d6f3c640 1 -- 172.21.15.28:0/1060425184 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07d004e8a0 con 0x7f07d00b8240 2023-11-16T02:29:35.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.610+0000 7f07cd7fa640 1 -- 172.21.15.28:0/1060425184 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f07b80113f0 con 0x7f07d00b8240 2023-11-16T02:29:35.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.610+0000 7f07cd7fa640 1 --2- 172.21.15.28:0/1060425184 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f07b0065a60 0x7f07b0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:35.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.610+0000 7f07cd7fa640 1 -- 172.21.15.28:0/1060425184 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f07b8082f00 con 0x7f07d00b8240 2023-11-16T02:29:35.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.610+0000 7f07d4cd8640 1 --2- 172.21.15.28:0/1060425184 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f07b0065a60 0x7f07b0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:35.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.610+0000 7f07d4cd8640 1 --2- 172.21.15.28:0/1060425184 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f07b0065a60 0x7f07b0067f20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f07c00012f0 tx=0x7f07c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:35.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.614+0000 7f07cd7fa640 1 -- 172.21.15.28:0/1060425184 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f07b8050ca0 con 0x7f07d00b8240 2023-11-16T02:29:35.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.770+0000 7f07d6f3c640 1 -- 172.21.15.28:0/1060425184 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f07d01e6a90 con 0x7f07d00b8240 2023-11-16T02:29:35.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.770+0000 7f07cd7fa640 1 -- 172.21.15.28:0/1060425184 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7f07b801f090 con 0x7f07d00b8240 2023-11-16T02:29:35.774 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:35.774 INFO:teuthology.orchestra.run.smithi028.stdout:[ 2023-11-16T02:29:35.774 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-16T02:29:35.774 INFO:teuthology.orchestra.run.smithi028.stdout: "poolnum": 1, 2023-11-16T02:29:35.774 INFO:teuthology.orchestra.run.smithi028.stdout: "poolname": ".mgr" 2023-11-16T02:29:35.774 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-16T02:29:35.774 INFO:teuthology.orchestra.run.smithi028.stdout:] 2023-11-16T02:29:35.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.774+0000 7f07d6f3c640 1 -- 172.21.15.28:0/1060425184 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f07b0065a60 msgr2=0x7f07b0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:35.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.774+0000 7f07d6f3c640 1 --2- 172.21.15.28:0/1060425184 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f07b0065a60 0x7f07b0067f20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f07c00012f0 tx=0x7f07c0009040 comp rx=0 tx=0).stop 2023-11-16T02:29:35.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.774+0000 7f07d6f3c640 1 -- 172.21.15.28:0/1060425184 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07d00b8240 msgr2=0x7f07d0130280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:35.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.774+0000 7f07d6f3c640 1 --2- 172.21.15.28:0/1060425184 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07d00b8240 0x7f07d0130280 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f07b800c820 tx=0x7f07b800cce0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.774+0000 7f07d6f3c640 1 -- 172.21.15.28:0/1060425184 shutdown_connections 2023-11-16T02:29:35.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.774+0000 7f07d6f3c640 1 --2- 172.21.15.28:0/1060425184 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f07b0065a60 0x7f07b0067f20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.774+0000 7f07d6f3c640 1 --2- 172.21.15.28:0/1060425184 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f07d0148960 0x7f07d01307c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.774+0000 7f07d6f3c640 1 --2- 172.21.15.28:0/1060425184 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f07d00b8240 0x7f07d0130280 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.774+0000 7f07d6f3c640 1 --2- 172.21.15.28:0/1060425184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07d00b3450 0x7f07d0139d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.774+0000 7f07d6f3c640 1 -- 172.21.15.28:0/1060425184 >> 172.21.15.28:0/1060425184 conn(0x7f07d00b9050 msgr2=0x7f07d00ba370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:35.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.774+0000 7f07d6f3c640 1 -- 172.21.15.28:0/1060425184 shutdown_connections 2023-11-16T02:29:35.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.774+0000 7f07d6f3c640 1 -- 172.21.15.28:0/1060425184 wait complete. 2023-11-16T02:29:35.792 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-16T02:29:35.793 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-16T02:29:35.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.918+0000 7f6036ba3640 1 Processor -- start 2023-11-16T02:29:35.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.918+0000 7f6036ba3640 1 -- start start 2023-11-16T02:29:35.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.918+0000 7f6036ba3640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60300b36d0 0x7f60300b8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:35.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.918+0000 7f6036ba3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f60300b7b00 0x7f6030142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:35.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.918+0000 7f6036ba3640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60300b69f0 con 0x7f6030143230 2023-11-16T02:29:35.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.918+0000 7f6036ba3640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6030071590 con 0x7f60300b7b00 2023-11-16T02:29:35.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.918+0000 7f6036ba3640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6030070fa0 con 0x7f60300b36d0 2023-11-16T02:29:35.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.918+0000 7f602ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f60300b7b00 0x7f6030142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:35.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.918+0000 7f602ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f60300b7b00 0x7f6030142cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38352/0 (socket says 172.21.15.28:38352) 2023-11-16T02:29:35.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.918+0000 7f602ffff640 1 -- 172.21.15.28:0/3102321905 learned_addr learned my addr 172.21.15.28:0/3102321905 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:35.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.918+0000 7f603493f640 1 --2- 172.21.15.28:0/3102321905 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60300b36d0 0x7f60300b8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:35.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.918+0000 7f602ffff640 1 -- 172.21.15.28:0/3102321905 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60300b36d0 msgr2=0x7f60300b8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:35.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.918+0000 7f602ffff640 1 --2- 172.21.15.28:0/3102321905 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60300b36d0 0x7f60300b8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.918+0000 7f602ffff640 1 -- 172.21.15.28:0/3102321905 >> v1:172.21.15.70:6789/0 conn(0x7f6030143230 legacy=0x7f60300b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:35.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.918+0000 7f602ffff640 1 -- 172.21.15.28:0/3102321905 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60300b7000 con 0x7f60300b7b00 2023-11-16T02:29:35.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.918+0000 7f603493f640 1 --2- 172.21.15.28:0/3102321905 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60300b36d0 0x7f60300b8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:35.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f602ffff640 1 --2- 172.21.15.28:0/3102321905 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60300b7b00 0x7f6030142cf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6024009870 tx=0x7f602401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62386dd4c48529eb server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:35.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f602f7fe640 1 -- 172.21.15.28:0/3102321905 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60240ac410 con 0x7f60300b7b00 2023-11-16T02:29:35.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f602f7fe640 1 -- 172.21.15.28:0/3102321905 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60240ac570 con 0x7f60300b7b00 2023-11-16T02:29:35.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f602f7fe640 1 -- 172.21.15.28:0/3102321905 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60240ac900 con 0x7f60300b7b00 2023-11-16T02:29:35.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f6036ba3640 1 -- 172.21.15.28:0/3102321905 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60300b7b00 msgr2=0x7f6030142cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:35.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f6036ba3640 1 --2- 172.21.15.28:0/3102321905 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60300b7b00 0x7f6030142cf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6024009870 tx=0x7f602401c500 comp rx=0 tx=0).stop 2023-11-16T02:29:35.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f6036ba3640 1 -- 172.21.15.28:0/3102321905 shutdown_connections 2023-11-16T02:29:35.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f6036ba3640 1 --2- 172.21.15.28:0/3102321905 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60300b7b00 0x7f6030142cf0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f6036ba3640 1 --2- 172.21.15.28:0/3102321905 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60300b36d0 0x7f60300b8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f6036ba3640 1 -- 172.21.15.28:0/3102321905 >> 172.21.15.28:0/3102321905 conn(0x7f60300bc070 msgr2=0x7f60300bc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:35.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f6036ba3640 1 -- 172.21.15.28:0/3102321905 shutdown_connections 2023-11-16T02:29:35.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f6036ba3640 1 -- 172.21.15.28:0/3102321905 wait complete. 2023-11-16T02:29:35.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f6036ba3640 1 Processor -- start 2023-11-16T02:29:35.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f6036ba3640 1 -- start start 2023-11-16T02:29:35.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f6036ba3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60300b36d0 0x7f603006ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:35.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f6036ba3640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60300b7b00 0x7f60301e37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:35.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f6036ba3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6030143230 0x7f603014c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:35.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f6036ba3640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60300b1cb0 con 0x7f60300b36d0 2023-11-16T02:29:35.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f6036ba3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60300b1f90 con 0x7f6030143230 2023-11-16T02:29:35.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f6036ba3640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60300b2270 con 0x7f60300b7b00 2023-11-16T02:29:35.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f603493f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60300b36d0 0x7f603006ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:35.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f603493f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60300b36d0 0x7f603006ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38364/0 (socket says 172.21.15.28:38364) 2023-11-16T02:29:35.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f603493f640 1 -- 172.21.15.28:0/2772394976 learned_addr learned my addr 172.21.15.28:0/2772394976 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:35.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f6035140640 1 --2- 172.21.15.28:0/2772394976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6030143230 0x7f603014c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:35.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f602ffff640 1 --2- 172.21.15.28:0/2772394976 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60300b7b00 0x7f60301e37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:35.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f603493f640 1 -- 172.21.15.28:0/2772394976 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60300b7b00 msgr2=0x7f60301e37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:35.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f603493f640 1 --2- 172.21.15.28:0/2772394976 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60300b7b00 0x7f60301e37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f603493f640 1 -- 172.21.15.28:0/2772394976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6030143230 msgr2=0x7f603014c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:35.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f603493f640 1 --2- 172.21.15.28:0/2772394976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6030143230 0x7f603014c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:35.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f603493f640 1 -- 172.21.15.28:0/2772394976 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60240094d0 con 0x7f60300b36d0 2023-11-16T02:29:35.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.922+0000 7f602ffff640 1 --2- 172.21.15.28:0/2772394976 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60300b7b00 0x7f60301e37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:35.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.926+0000 7f603493f640 1 --2- 172.21.15.28:0/2772394976 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60300b36d0 0x7f603006ed90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f602000c7f0 tx=0x7f602000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:35.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.926+0000 7f602d7fa640 1 -- 172.21.15.28:0/2772394976 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6020007820 con 0x7f60300b36d0 2023-11-16T02:29:35.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.926+0000 7f602d7fa640 1 -- 172.21.15.28:0/2772394976 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6020007980 con 0x7f60300b36d0 2023-11-16T02:29:35.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.926+0000 7f6036ba3640 1 -- 172.21.15.28:0/2772394976 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60300b2550 con 0x7f60300b36d0 2023-11-16T02:29:35.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.926+0000 7f602d7fa640 1 -- 172.21.15.28:0/2772394976 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6020007d30 con 0x7f60300b36d0 2023-11-16T02:29:35.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.926+0000 7f6036ba3640 1 -- 172.21.15.28:0/2772394976 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60300af750 con 0x7f60300b36d0 2023-11-16T02:29:35.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.926+0000 7f6036ba3640 1 -- 172.21.15.28:0/2772394976 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603004e8a0 con 0x7f60300b36d0 2023-11-16T02:29:35.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.926+0000 7f602d7fa640 1 -- 172.21.15.28:0/2772394976 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f60200113f0 con 0x7f60300b36d0 2023-11-16T02:29:35.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.926+0000 7f602d7fa640 1 --2- 172.21.15.28:0/2772394976 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f601c065a90 0x7f601c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:35.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.926+0000 7f602d7fa640 1 -- 172.21.15.28:0/2772394976 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f60200830d0 con 0x7f60300b36d0 2023-11-16T02:29:35.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.926+0000 7f602ffff640 1 --2- 172.21.15.28:0/2772394976 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f601c065a90 0x7f601c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:35.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.926+0000 7f602ffff640 1 --2- 172.21.15.28:0/2772394976 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f601c065a90 0x7f601c067f50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f60240ae000 tx=0x7f60240a6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:35.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:35.930+0000 7f602d7fa640 1 -- 172.21.15.28:0/2772394976 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f6020050e70 con 0x7f60300b36d0 2023-11-16T02:29:36.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.086+0000 7f6036ba3640 1 -- 172.21.15.28:0/2772394976 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f60300b1df0 con 0x7f60300b36d0 2023-11-16T02:29:36.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.482+0000 7f602d7fa640 1 -- 172.21.15.28:0/2772394976 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f60300b1df0 con 0x7f60300b36d0 2023-11-16T02:29:36.487 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_metadata' created 2023-11-16T02:29:36.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.490+0000 7f6036ba3640 1 -- 172.21.15.28:0/2772394976 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f601c065a90 msgr2=0x7f601c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:36.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.490+0000 7f6036ba3640 1 --2- 172.21.15.28:0/2772394976 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f601c065a90 0x7f601c067f50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f60240ae000 tx=0x7f60240a6040 comp rx=0 tx=0).stop 2023-11-16T02:29:36.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.490+0000 7f6036ba3640 1 -- 172.21.15.28:0/2772394976 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60300b36d0 msgr2=0x7f603006ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:36.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.490+0000 7f6036ba3640 1 --2- 172.21.15.28:0/2772394976 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60300b36d0 0x7f603006ed90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f602000c7f0 tx=0x7f602000ccb0 comp rx=0 tx=0).stop 2023-11-16T02:29:36.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.490+0000 7f6036ba3640 1 -- 172.21.15.28:0/2772394976 shutdown_connections 2023-11-16T02:29:36.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.490+0000 7f6036ba3640 1 --2- 172.21.15.28:0/2772394976 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f601c065a90 0x7f601c067f50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:36.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.490+0000 7f6036ba3640 1 --2- 172.21.15.28:0/2772394976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6030143230 0x7f603014c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:36.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.490+0000 7f6036ba3640 1 --2- 172.21.15.28:0/2772394976 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f60300b7b00 0x7f60301e37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:36.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.490+0000 7f6036ba3640 1 --2- 172.21.15.28:0/2772394976 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60300b36d0 0x7f603006ed90 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f602000c7f0 tx=0x7f602000ccb0 comp rx=0 tx=0).stop 2023-11-16T02:29:36.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.490+0000 7f6036ba3640 1 -- 172.21.15.28:0/2772394976 >> 172.21.15.28:0/2772394976 conn(0x7f60300bc070 msgr2=0x7f6030148b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:36.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.494+0000 7f6036ba3640 1 -- 172.21.15.28:0/2772394976 shutdown_connections 2023-11-16T02:29:36.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.494+0000 7f6036ba3640 1 -- 172.21.15.28:0/2772394976 wait complete. 2023-11-16T02:29:36.517 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-16T02:29:36.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.650+0000 7ffa1535e640 1 Processor -- start 2023-11-16T02:29:36.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.650+0000 7ffa1535e640 1 -- start start 2023-11-16T02:29:36.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.650+0000 7ffa1535e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa101415b0 0x7ffa100ba410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:36.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.650+0000 7ffa1535e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffa100b8340 0x7ffa100b87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:36.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.650+0000 7ffa1535e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa100b78a0 con 0x7ffa1014e0f0 2023-11-16T02:29:36.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.650+0000 7ffa1535e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa100ba060 con 0x7ffa100b8340 2023-11-16T02:29:36.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.650+0000 7ffa1535e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa100b9390 con 0x7ffa101415b0 2023-11-16T02:29:36.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.650+0000 7ffa0e7fc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffa100b8340 0x7ffa100b87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:36.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.650+0000 7ffa0e7fc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffa100b8340 0x7ffa100b87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38368/0 (socket says 172.21.15.28:38368) 2023-11-16T02:29:36.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.650+0000 7ffa0e7fc640 1 -- 172.21.15.28:0/353678151 learned_addr learned my addr 172.21.15.28:0/353678151 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:36.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.650+0000 7ffa0effd640 1 --2- 172.21.15.28:0/353678151 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa101415b0 0x7ffa100ba410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:36.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.650+0000 7ffa0e7fc640 1 -- 172.21.15.28:0/353678151 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa101415b0 msgr2=0x7ffa100ba410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:36.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.650+0000 7ffa0e7fc640 1 --2- 172.21.15.28:0/353678151 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa101415b0 0x7ffa100ba410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:36.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.650+0000 7ffa0e7fc640 1 -- 172.21.15.28:0/353678151 >> v1:172.21.15.70:6789/0 conn(0x7ffa1014e0f0 legacy=0x7ffa1014e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:36.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.650+0000 7ffa0e7fc640 1 -- 172.21.15.28:0/353678151 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa100b8ce0 con 0x7ffa100b8340 2023-11-16T02:29:36.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.654+0000 7ffa0e7fc640 1 --2- 172.21.15.28:0/353678151 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa100b8340 0x7ffa100b87a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffa04009870 tx=0x7ffa0401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a966a7fa8303e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:36.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.654+0000 7ffa0dffb640 1 -- 172.21.15.28:0/353678151 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa040a9400 con 0x7ffa100b8340 2023-11-16T02:29:36.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.654+0000 7ffa0dffb640 1 -- 172.21.15.28:0/353678151 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa040a9560 con 0x7ffa100b8340 2023-11-16T02:29:36.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.654+0000 7ffa0dffb640 1 -- 172.21.15.28:0/353678151 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa040a98f0 con 0x7ffa100b8340 2023-11-16T02:29:36.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.654+0000 7ffa1535e640 1 -- 172.21.15.28:0/353678151 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa100b8340 msgr2=0x7ffa100b87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:36.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.654+0000 7ffa1535e640 1 --2- 172.21.15.28:0/353678151 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa100b8340 0x7ffa100b87a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffa04009870 tx=0x7ffa0401c540 comp rx=0 tx=0).stop 2023-11-16T02:29:36.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.654+0000 7ffa1535e640 1 -- 172.21.15.28:0/353678151 shutdown_connections 2023-11-16T02:29:36.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.654+0000 7ffa1535e640 1 --2- 172.21.15.28:0/353678151 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa100b8340 0x7ffa100b87a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:36.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.654+0000 7ffa1535e640 1 --2- 172.21.15.28:0/353678151 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa101415b0 0x7ffa100ba410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:36.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.654+0000 7ffa1535e640 1 -- 172.21.15.28:0/353678151 >> 172.21.15.28:0/353678151 conn(0x7ffa1006b7e0 msgr2=0x7ffa1006bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:36.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.654+0000 7ffa1535e640 1 -- 172.21.15.28:0/353678151 shutdown_connections 2023-11-16T02:29:36.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.654+0000 7ffa1535e640 1 -- 172.21.15.28:0/353678151 wait complete. 2023-11-16T02:29:36.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.654+0000 7ffa1535e640 1 Processor -- start 2023-11-16T02:29:36.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.654+0000 7ffa1535e640 1 -- start start 2023-11-16T02:29:36.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ffa1535e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa100b8340 0x7ffa101432e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:36.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ffa1535e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa101415b0 0x7ffa1013cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:36.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ffa1535e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa1014e0f0 0x7ffa1014f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:36.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ffa1535e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1014f450 con 0x7ffa1014e0f0 2023-11-16T02:29:36.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ffa1535e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa10142890 con 0x7ffa100b8340 2023-11-16T02:29:36.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ffa1535e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1014fe40 con 0x7ffa101415b0 2023-11-16T02:29:36.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ffa0f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa1014e0f0 0x7ffa1014f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:36.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ffa0f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa1014e0f0 0x7ffa1014f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38374/0 (socket says 172.21.15.28:38374) 2023-11-16T02:29:36.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ffa0f7fe640 1 -- 172.21.15.28:0/4188583873 learned_addr learned my addr 172.21.15.28:0/4188583873 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:36.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ffa0e7fc640 1 --2- 172.21.15.28:0/4188583873 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa101415b0 0x7ffa1013cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:36.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ffa0effd640 1 --2- 172.21.15.28:0/4188583873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa100b8340 0x7ffa101432e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:36.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ffa0f7fe640 1 -- 172.21.15.28:0/4188583873 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa101415b0 msgr2=0x7ffa1013cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:36.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ffa0f7fe640 1 --2- 172.21.15.28:0/4188583873 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa101415b0 0x7ffa1013cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:36.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ffa0f7fe640 1 -- 172.21.15.28:0/4188583873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa100b8340 msgr2=0x7ffa101432e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:36.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ffa0f7fe640 1 --2- 172.21.15.28:0/4188583873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa100b8340 0x7ffa101432e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:36.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ffa0f7fe640 1 -- 172.21.15.28:0/4188583873 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa040094d0 con 0x7ffa1014e0f0 2023-11-16T02:29:36.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ffa0f7fe640 1 --2- 172.21.15.28:0/4188583873 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa1014e0f0 0x7ffa1014f730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffa0000c430 tx=0x7ffa0000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:36.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ff9f77fe640 1 -- 172.21.15.28:0/4188583873 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa00005220 con 0x7ffa1014e0f0 2023-11-16T02:29:36.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ff9f77fe640 1 -- 172.21.15.28:0/4188583873 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa00005380 con 0x7ffa1014e0f0 2023-11-16T02:29:36.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ffa1535e640 1 -- 172.21.15.28:0/4188583873 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa10150120 con 0x7ffa1014e0f0 2023-11-16T02:29:36.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ff9f77fe640 1 -- 172.21.15.28:0/4188583873 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa00007270 con 0x7ffa1014e0f0 2023-11-16T02:29:36.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ffa1535e640 1 -- 172.21.15.28:0/4188583873 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa10143f10 con 0x7ffa1014e0f0 2023-11-16T02:29:36.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ffa1535e640 1 -- 172.21.15.28:0/4188583873 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa10141990 con 0x7ffa1014e0f0 2023-11-16T02:29:36.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ff9f77fe640 1 -- 172.21.15.28:0/4188583873 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffa000073d0 con 0x7ffa1014e0f0 2023-11-16T02:29:36.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ff9f77fe640 1 --2- 172.21.15.28:0/4188583873 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff9fc065a60 0x7ff9fc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:36.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ff9f77fe640 1 -- 172.21.15.28:0/4188583873 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7ffa000825d0 con 0x7ffa1014e0f0 2023-11-16T02:29:36.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.658+0000 7ffa0effd640 1 --2- 172.21.15.28:0/4188583873 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff9fc065a60 0x7ff9fc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:36.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.662+0000 7ffa0effd640 1 --2- 172.21.15.28:0/4188583873 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff9fc065a60 0x7ff9fc067f20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffa08003fd0 tx=0x7ffa080039a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:36.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.662+0000 7ff9f77fe640 1 -- 172.21.15.28:0/4188583873 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7ffa00050160 con 0x7ffa1014e0f0 2023-11-16T02:29:36.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:36.822+0000 7ffa1535e640 1 -- 172.21.15.28:0/4188583873 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ffa1004e8a0 con 0x7ffa1014e0f0 2023-11-16T02:29:37.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.490+0000 7ff9f77fe640 1 -- 172.21.15.28:0/4188583873 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7ffa00053780 con 0x7ffa1014e0f0 2023-11-16T02:29:37.493 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data' created 2023-11-16T02:29:37.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.506+0000 7ffa1535e640 1 -- 172.21.15.28:0/4188583873 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff9fc065a60 msgr2=0x7ff9fc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:37.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.506+0000 7ffa1535e640 1 --2- 172.21.15.28:0/4188583873 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff9fc065a60 0x7ff9fc067f20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffa08003fd0 tx=0x7ffa080039a0 comp rx=0 tx=0).stop 2023-11-16T02:29:37.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.506+0000 7ffa1535e640 1 -- 172.21.15.28:0/4188583873 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa1014e0f0 msgr2=0x7ffa1014f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:37.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.506+0000 7ffa1535e640 1 --2- 172.21.15.28:0/4188583873 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa1014e0f0 0x7ffa1014f730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffa0000c430 tx=0x7ffa0000c8f0 comp rx=0 tx=0).stop 2023-11-16T02:29:37.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.506+0000 7ffa1535e640 1 -- 172.21.15.28:0/4188583873 shutdown_connections 2023-11-16T02:29:37.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.506+0000 7ffa1535e640 1 --2- 172.21.15.28:0/4188583873 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff9fc065a60 0x7ff9fc067f20 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ffa08003fd0 tx=0x7ffa080039a0 comp rx=0 tx=0).stop 2023-11-16T02:29:37.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.506+0000 7ffa1535e640 1 --2- 172.21.15.28:0/4188583873 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa1014e0f0 0x7ffa1014f730 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:37.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.506+0000 7ffa1535e640 1 --2- 172.21.15.28:0/4188583873 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa101415b0 0x7ffa1013cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:37.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.506+0000 7ffa1535e640 1 --2- 172.21.15.28:0/4188583873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa100b8340 0x7ffa101432e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:37.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.506+0000 7ffa1535e640 1 -- 172.21.15.28:0/4188583873 >> 172.21.15.28:0/4188583873 conn(0x7ffa1006b7e0 msgr2=0x7ffa100be2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:37.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.506+0000 7ffa1535e640 1 -- 172.21.15.28:0/4188583873 shutdown_connections 2023-11-16T02:29:37.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.510+0000 7ffa1535e640 1 -- 172.21.15.28:0/4188583873 wait complete. 2023-11-16T02:29:37.537 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-16T02:29:37.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.658+0000 7f9f0f3af640 1 Processor -- start 2023-11-16T02:29:37.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.658+0000 7f9f0f3af640 1 -- start start 2023-11-16T02:29:37.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.658+0000 7f9f0f3af640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9f0806a170 0x7f9f080b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:37.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.658+0000 7f9f0f3af640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9f0806a550 0x7f9f08148a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:37.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.658+0000 7f9f0f3af640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9f08148fa0 0x7f9f080b7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:37.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.658+0000 7f9f0f3af640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f08071800 con 0x7f9f08148fa0 2023-11-16T02:29:37.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.658+0000 7f9f0f3af640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f080b5ec0 con 0x7f9f0806a170 2023-11-16T02:29:37.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.658+0000 7f9f0f3af640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f080b6350 con 0x7f9f0806a550 2023-11-16T02:29:37.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.658+0000 7f9f0d94c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9f08148fa0 0x7f9f080b7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:37.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.658+0000 7f9f0d94c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9f08148fa0 0x7f9f080b7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38384/0 (socket says 172.21.15.28:38384) 2023-11-16T02:29:37.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.658+0000 7f9f0d94c640 1 -- 172.21.15.28:0/994973067 learned_addr learned my addr 172.21.15.28:0/994973067 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:37.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.658+0000 7f9f0c94a640 1 --2- 172.21.15.28:0/994973067 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9f0806a550 0x7f9f08148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:37.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.658+0000 7f9f0d14b640 1 --2- 172.21.15.28:0/994973067 >> v2:172.21.15.70:3300/0 conn(0x7f9f0806a170 0x7f9f080b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:37.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.658+0000 7f9f0d94c640 1 -- 172.21.15.28:0/994973067 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9f0806a550 msgr2=0x7f9f08148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:37.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.658+0000 7f9f0d94c640 1 --2- 172.21.15.28:0/994973067 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9f0806a550 0x7f9f08148a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:37.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.658+0000 7f9f0d94c640 1 -- 172.21.15.28:0/994973067 >> v2:172.21.15.70:3300/0 conn(0x7f9f0806a170 msgr2=0x7f9f080b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:37.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.658+0000 7f9f0d94c640 1 --2- 172.21.15.28:0/994973067 >> v2:172.21.15.70:3300/0 conn(0x7f9f0806a170 0x7f9f080b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:37.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.658+0000 7f9f0d94c640 1 -- 172.21.15.28:0/994973067 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f080b5870 con 0x7f9f08148fa0 2023-11-16T02:29:37.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.658+0000 7f9f0c94a640 1 --2- 172.21.15.28:0/994973067 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9f0806a550 0x7f9f08148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:29:37.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.658+0000 7f9f0d14b640 1 --2- 172.21.15.28:0/994973067 >> v2:172.21.15.70:3300/0 conn(0x7f9f0806a170 0x7f9f080b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:29:37.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.662+0000 7f9f0d94c640 1 --2- 172.21.15.28:0/994973067 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f08148fa0 0x7f9f080b7c60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9f0806aa80 tx=0x7f9f0001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9220c6b40329ed77 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:37.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.662+0000 7f9f07fff640 1 -- 172.21.15.28:0/994973067 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f000ab600 con 0x7f9f08148fa0 2023-11-16T02:29:37.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.662+0000 7f9f07fff640 1 -- 172.21.15.28:0/994973067 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f000a7050 con 0x7f9f08148fa0 2023-11-16T02:29:37.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.662+0000 7f9f07fff640 1 -- 172.21.15.28:0/994973067 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f000ab980 con 0x7f9f08148fa0 2023-11-16T02:29:37.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.662+0000 7f9f0f3af640 1 -- 172.21.15.28:0/994973067 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f08148fa0 msgr2=0x7f9f080b7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:37.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.662+0000 7f9f0f3af640 1 --2- 172.21.15.28:0/994973067 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f08148fa0 0x7f9f080b7c60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9f0806aa80 tx=0x7f9f0001c470 comp rx=0 tx=0).stop 2023-11-16T02:29:37.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.662+0000 7f9f0f3af640 1 -- 172.21.15.28:0/994973067 shutdown_connections 2023-11-16T02:29:37.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.662+0000 7f9f0f3af640 1 --2- 172.21.15.28:0/994973067 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f08148fa0 0x7f9f080b7c60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:37.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.662+0000 7f9f0f3af640 1 --2- 172.21.15.28:0/994973067 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9f0806a550 0x7f9f08148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:37.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.662+0000 7f9f0f3af640 1 --2- 172.21.15.28:0/994973067 >> v2:172.21.15.70:3300/0 conn(0x7f9f0806a170 0x7f9f080b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:37.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.662+0000 7f9f0f3af640 1 -- 172.21.15.28:0/994973067 >> 172.21.15.28:0/994973067 conn(0x7f9f080bc5a0 msgr2=0x7f9f080bc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:37.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.662+0000 7f9f0f3af640 1 -- 172.21.15.28:0/994973067 shutdown_connections 2023-11-16T02:29:37.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.662+0000 7f9f0f3af640 1 -- 172.21.15.28:0/994973067 wait complete. 2023-11-16T02:29:37.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.662+0000 7f9f0f3af640 1 Processor -- start 2023-11-16T02:29:37.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.662+0000 7f9f0f3af640 1 -- start start 2023-11-16T02:29:37.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.662+0000 7f9f0f3af640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9f0806a170 0x7f9f080b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:37.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.662+0000 7f9f0f3af640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f0806a550 0x7f9f0814b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:37.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.662+0000 7f9f0f3af640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f08148fa0 0x7f9f0813c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:37.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.662+0000 7f9f0f3af640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f080b71c0 con 0x7f9f0806a550 2023-11-16T02:29:37.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.662+0000 7f9f0f3af640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0813f460 con 0x7f9f08148fa0 2023-11-16T02:29:37.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.662+0000 7f9f0f3af640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0813f8f0 con 0x7f9f0806a170 2023-11-16T02:29:37.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.666+0000 7f9f0c94a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f0806a550 0x7f9f0814b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:37.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.666+0000 7f9f0c94a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f0806a550 0x7f9f0814b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38386/0 (socket says 172.21.15.28:38386) 2023-11-16T02:29:37.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.666+0000 7f9f0c94a640 1 -- 172.21.15.28:0/2812907571 learned_addr learned my addr 172.21.15.28:0/2812907571 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:37.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.666+0000 7f9f0d94c640 1 --2- 172.21.15.28:0/2812907571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f08148fa0 0x7f9f0813c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:37.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.666+0000 7f9f0d14b640 1 --2- 172.21.15.28:0/2812907571 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9f0806a170 0x7f9f080b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:37.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.666+0000 7f9f0c94a640 1 -- 172.21.15.28:0/2812907571 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9f0806a170 msgr2=0x7f9f080b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:37.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.666+0000 7f9f0c94a640 1 --2- 172.21.15.28:0/2812907571 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9f0806a170 0x7f9f080b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:37.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.666+0000 7f9f0c94a640 1 -- 172.21.15.28:0/2812907571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f08148fa0 msgr2=0x7f9f0813c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:37.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.666+0000 7f9f0c94a640 1 --2- 172.21.15.28:0/2812907571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f08148fa0 0x7f9f0813c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:37.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.666+0000 7f9f0c94a640 1 -- 172.21.15.28:0/2812907571 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f000094d0 con 0x7f9f0806a550 2023-11-16T02:29:37.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.666+0000 7f9f0d94c640 1 --2- 172.21.15.28:0/2812907571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f08148fa0 0x7f9f0813c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:29:37.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.666+0000 7f9f0c94a640 1 --2- 172.21.15.28:0/2812907571 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f0806a550 0x7f9f0814b4a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9efc007fa0 tx=0x7f9efc00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:37.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.666+0000 7f9f05ffb640 1 -- 172.21.15.28:0/2812907571 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc003ba0 con 0x7f9f0806a550 2023-11-16T02:29:37.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.666+0000 7f9f05ffb640 1 -- 172.21.15.28:0/2812907571 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc00f040 con 0x7f9f0806a550 2023-11-16T02:29:37.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.666+0000 7f9f0f3af640 1 -- 172.21.15.28:0/2812907571 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0813e7b0 con 0x7f9f0806a550 2023-11-16T02:29:37.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.666+0000 7f9f05ffb640 1 -- 172.21.15.28:0/2812907571 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc004030 con 0x7f9f0806a550 2023-11-16T02:29:37.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.666+0000 7f9f0f3af640 1 -- 172.21.15.28:0/2812907571 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0813f0f0 con 0x7f9f0806a550 2023-11-16T02:29:37.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.666+0000 7f9f0f3af640 1 -- 172.21.15.28:0/2812907571 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0804e8a0 con 0x7f9f0806a550 2023-11-16T02:29:37.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.666+0000 7f9f05ffb640 1 -- 172.21.15.28:0/2812907571 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9efc004190 con 0x7f9f0806a550 2023-11-16T02:29:37.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.666+0000 7f9f05ffb640 1 --2- 172.21.15.28:0/2812907571 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f9eec065a60 0x7f9eec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:37.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.666+0000 7f9f05ffb640 1 -- 172.21.15.28:0/2812907571 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f9efc083390 con 0x7f9f0806a550 2023-11-16T02:29:37.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.666+0000 7f9f0d14b640 1 --2- 172.21.15.28:0/2812907571 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f9eec065a60 0x7f9eec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:37.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.666+0000 7f9f0d14b640 1 --2- 172.21.15.28:0/2812907571 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f9eec065a60 0x7f9eec067f20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400b990 tx=0x7f9ef4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:37.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.670+0000 7f9f05ffb640 1 -- 172.21.15.28:0/2812907571 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f9efc050ef0 con 0x7f9f0806a550 2023-11-16T02:29:37.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.862+0000 7f9f0f3af640 1 -- 172.21.15.28:0/2812907571 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9f0813f5a0 con 0x7f9f0806a550 2023-11-16T02:29:37.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.874+0000 7f9f05ffb640 1 -- 172.21.15.28:0/2812907571 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9efc054510 con 0x7f9f0806a550 2023-11-16T02:29:37.876 INFO:teuthology.orchestra.run.smithi028.stderr:new fs with metadata pool 2 and data pool 3 2023-11-16T02:29:37.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.894+0000 7f9f0f3af640 1 -- 172.21.15.28:0/2812907571 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f9eec065a60 msgr2=0x7f9eec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:37.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.894+0000 7f9f0f3af640 1 --2- 172.21.15.28:0/2812907571 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f9eec065a60 0x7f9eec067f20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400b990 tx=0x7f9ef4008040 comp rx=0 tx=0).stop 2023-11-16T02:29:37.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.894+0000 7f9f0f3af640 1 -- 172.21.15.28:0/2812907571 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f0806a550 msgr2=0x7f9f0814b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:37.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.894+0000 7f9f0f3af640 1 --2- 172.21.15.28:0/2812907571 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f0806a550 0x7f9f0814b4a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9efc007fa0 tx=0x7f9efc00d560 comp rx=0 tx=0).stop 2023-11-16T02:29:37.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.894+0000 7f9f0f3af640 1 -- 172.21.15.28:0/2812907571 shutdown_connections 2023-11-16T02:29:37.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.894+0000 7f9f0f3af640 1 --2- 172.21.15.28:0/2812907571 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f9eec065a60 0x7f9eec067f20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:37.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.894+0000 7f9f0f3af640 1 --2- 172.21.15.28:0/2812907571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9f08148fa0 0x7f9f0813c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:37.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.894+0000 7f9f0f3af640 1 --2- 172.21.15.28:0/2812907571 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9f0806a550 0x7f9f0814b4a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:37.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.894+0000 7f9f0f3af640 1 --2- 172.21.15.28:0/2812907571 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9f0806a170 0x7f9f080b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:37.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.894+0000 7f9f0f3af640 1 -- 172.21.15.28:0/2812907571 >> 172.21.15.28:0/2812907571 conn(0x7f9f080bc5a0 msgr2=0x7f9f0814c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:37.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.894+0000 7f9f0f3af640 1 -- 172.21.15.28:0/2812907571 shutdown_connections 2023-11-16T02:29:37.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:37.894+0000 7f9f0f3af640 1 -- 172.21.15.28:0/2812907571 wait complete. 2023-11-16T02:29:37.917 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-16T02:29:38.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.030+0000 7f6a3a1f1640 1 Processor -- start 2023-11-16T02:29:38.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.030+0000 7f6a3a1f1640 1 -- start start 2023-11-16T02:29:38.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.030+0000 7f6a3a1f1640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6a340b8240 0x7f6a340bc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:38.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.030+0000 7f6a3a1f1640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a340b52b0 con 0x7f6a340b3b60 2023-11-16T02:29:38.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.030+0000 7f6a3a1f1640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a340b6220 con 0x7f6a34148960 2023-11-16T02:29:38.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.030+0000 7f6a3a1f1640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a340b4040 con 0x7f6a340b8240 2023-11-16T02:29:38.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.034+0000 7f6a337fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6a340b8240 0x7f6a340bc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:38.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.034+0000 7f6a33fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f6a340b3b60 0x7f6a341532a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:32824/0 (socket says 172.21.15.28:32824) 2023-11-16T02:29:38.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.034+0000 7f6a337fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6a340b8240 0x7f6a340bc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38392/0 (socket says 172.21.15.28:38392) 2023-11-16T02:29:38.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.034+0000 7f6a33fff640 1 -- 172.21.15.28:0/1451361103 learned_addr learned my addr 172.21.15.28:0/1451361103 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:38.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.034+0000 7f6a337fe640 1 -- 172.21.15.28:0/1451361103 >> v1:172.21.15.70:6789/0 conn(0x7f6a34148960 legacy=0x7f6a340b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:38.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.034+0000 7f6a337fe640 1 -- 172.21.15.28:0/1451361103 >> v1:172.21.15.28:6789/0 conn(0x7f6a340b3b60 legacy=0x7f6a341532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:38.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.034+0000 7f6a337fe640 1 -- 172.21.15.28:0/1451361103 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a340b5a20 con 0x7f6a340b8240 2023-11-16T02:29:38.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.034+0000 7f6a337fe640 1 --2- 172.21.15.28:0/1451361103 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a340b8240 0x7f6a340bc6a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0097c0 tx=0x7f6a2c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c469f80f8094fcf1 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:38.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.034+0000 7f6a327fc640 1 -- 172.21.15.28:0/1451361103 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0ab600 con 0x7f6a340b8240 2023-11-16T02:29:38.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.034+0000 7f6a327fc640 1 -- 172.21.15.28:0/1451361103 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c0a7050 con 0x7f6a340b8240 2023-11-16T02:29:38.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.034+0000 7f6a327fc640 1 -- 172.21.15.28:0/1451361103 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0ab980 con 0x7f6a340b8240 2023-11-16T02:29:38.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.034+0000 7f6a3a1f1640 1 -- 172.21.15.28:0/1451361103 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a340b8240 msgr2=0x7f6a340bc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:38.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.034+0000 7f6a3a1f1640 1 --2- 172.21.15.28:0/1451361103 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a340b8240 0x7f6a340bc6a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0097c0 tx=0x7f6a2c01c410 comp rx=0 tx=0).stop 2023-11-16T02:29:38.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.034+0000 7f6a3a1f1640 1 -- 172.21.15.28:0/1451361103 shutdown_connections 2023-11-16T02:29:38.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.034+0000 7f6a3a1f1640 1 --2- 172.21.15.28:0/1451361103 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a340b8240 0x7f6a340bc6a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:38.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.034+0000 7f6a3a1f1640 1 -- 172.21.15.28:0/1451361103 >> 172.21.15.28:0/1451361103 conn(0x7f6a340b9050 msgr2=0x7f6a340bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:38.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.034+0000 7f6a3a1f1640 1 -- 172.21.15.28:0/1451361103 shutdown_connections 2023-11-16T02:29:38.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.034+0000 7f6a3a1f1640 1 -- 172.21.15.28:0/1451361103 wait complete. 2023-11-16T02:29:38.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a3a1f1640 1 Processor -- start 2023-11-16T02:29:38.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a3a1f1640 1 -- start start 2023-11-16T02:29:38.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a3a1f1640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6a340b3b60 0x7f6a341456d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:38.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a3a1f1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a340b8240 0x7f6a34144230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:38.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a3a1f1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a34148960 0x7f6a34136500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:38.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a3a1f1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a34145c10 con 0x7f6a34148960 2023-11-16T02:29:38.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a3a1f1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a34144770 con 0x7f6a340b8240 2023-11-16T02:29:38.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a3a1f1640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a34142910 con 0x7f6a340b3b60 2023-11-16T02:29:38.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a33fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a34148960 0x7f6a34136500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:38.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a33fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a34148960 0x7f6a34136500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38404/0 (socket says 172.21.15.28:38404) 2023-11-16T02:29:38.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a33fff640 1 -- 172.21.15.28:0/3311409623 learned_addr learned my addr 172.21.15.28:0/3311409623 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:38.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a32ffd640 1 --2- 172.21.15.28:0/3311409623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a340b8240 0x7f6a34144230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:38.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a33fff640 1 -- 172.21.15.28:0/3311409623 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6a340b3b60 msgr2=0x7f6a341456d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:38.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a33fff640 1 --2- 172.21.15.28:0/3311409623 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6a340b3b60 0x7f6a341456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:38.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a33fff640 1 -- 172.21.15.28:0/3311409623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a340b8240 msgr2=0x7f6a34144230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:38.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a33fff640 1 --2- 172.21.15.28:0/3311409623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a340b8240 0x7f6a34144230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:38.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a33fff640 1 -- 172.21.15.28:0/3311409623 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c009420 con 0x7f6a34148960 2023-11-16T02:29:38.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a33fff640 1 --2- 172.21.15.28:0/3311409623 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a34148960 0x7f6a34136500 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400c3c0 tx=0x7f6a2400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:38.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a2bfff640 1 -- 172.21.15.28:0/3311409623 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a24005cf0 con 0x7f6a34148960 2023-11-16T02:29:38.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a2bfff640 1 -- 172.21.15.28:0/3311409623 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a24005e50 con 0x7f6a34148960 2023-11-16T02:29:38.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a2bfff640 1 -- 172.21.15.28:0/3311409623 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a240072d0 con 0x7f6a34148960 2023-11-16T02:29:38.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a3a1f1640 1 -- 172.21.15.28:0/3311409623 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a34142bf0 con 0x7f6a34148960 2023-11-16T02:29:38.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a3a1f1640 1 -- 172.21.15.28:0/3311409623 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a34143d10 con 0x7f6a34148960 2023-11-16T02:29:38.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a3a1f1640 1 -- 172.21.15.28:0/3311409623 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3413f350 con 0x7f6a34148960 2023-11-16T02:29:38.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a2bfff640 1 -- 172.21.15.28:0/3311409623 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6a24007430 con 0x7f6a34148960 2023-11-16T02:29:38.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a2bfff640 1 --2- 172.21.15.28:0/3311409623 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f6a14065a60 0x7f6a14067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:38.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.038+0000 7f6a2bfff640 1 -- 172.21.15.28:0/3311409623 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a24082620 con 0x7f6a34148960 2023-11-16T02:29:38.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.042+0000 7f6a337fe640 1 --2- 172.21.15.28:0/3311409623 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f6a14065a60 0x7f6a14067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:38.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.042+0000 7f6a337fe640 1 --2- 172.21.15.28:0/3311409623 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f6a14065a60 0x7f6a14067f20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0ad000 tx=0x7f6a2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:38.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.046+0000 7f6a2bfff640 1 -- 172.21.15.28:0/3311409623 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f6a24050000 con 0x7f6a34148960 2023-11-16T02:29:38.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.202+0000 7f6a3a1f1640 1 -- 172.21.15.28:0/3311409623 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a34143f00 con 0x7f6a34148960 2023-11-16T02:29:38.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.206+0000 7f6a2bfff640 1 -- 172.21.15.28:0/3311409623 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16002 (secure 0 0 0) 0x7f6a24017090 con 0x7f6a34148960 2023-11-16T02:29:38.209 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:38.209 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":21,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","created":"2023-11-16T02:29:13.710567+0000","modified":"2023-11-16T02:29:37.867312+0000","last_up_change":"2023-11-16T02:29:24.841087+0000","last_in_change":"2023-11-16T02:29:16.024490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-16T02:29:26.490910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-16T02:29:36.133224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-16T02:29:36.866156+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dfa8b58d-3481-4e68-86e8-21873d31d0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":38722},{"type":"v1","addr":"172.21.15.28:6809","nonce":38722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":38722},{"type":"v1","addr":"172.21.15.28:6811","nonce":38722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":38722},{"type":"v1","addr":"172.21.15.28:6815","nonce":38722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":38722},{"type":"v1","addr":"172.21.15.28:6813","nonce":38722}]},"public_addr":"172.21.15.28:6809/38722","cluster_addr":"172.21.15.28:6811/38722","heartbeat_back_addr":"172.21.15.28:6815/38722","heartbeat_front_addr":"172.21.15.28:6813/38722","state":["exists","up"]},{"osd":1,"uuid":"1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":38724},{"type":"v1","addr":"172.21.15.28:6824","nonce":38724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":38724},{"type":"v1","addr":"172.21.15.28:6827","nonce":38724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":38724},{"type":"v1","addr":"172.21.15.28:6831","nonce":38724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":38724},{"type":"v1","addr":"172.21.15.28:6829","nonce":38724}]},"public_addr":"172.21.15.28:6824/38724","cluster_addr":"172.21.15.28:6827/38724","heartbeat_back_addr":"172.21.15.28:6831/38724","heartbeat_front_addr":"172.21.15.28:6829/38724","state":["exists","up"]},{"osd":2,"uuid":"e18f39cd-6a35-4d36-9eed-3877794bf2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":38723},{"type":"v1","addr":"172.21.15.28:6801","nonce":38723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":38723},{"type":"v1","addr":"172.21.15.28:6803","nonce":38723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":38723},{"type":"v1","addr":"172.21.15.28:6807","nonce":38723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":38723},{"type":"v1","addr":"172.21.15.28:6805","nonce":38723}]},"public_addr":"172.21.15.28:6801/38723","cluster_addr":"172.21.15.28:6803/38723","heartbeat_back_addr":"172.21.15.28:6807/38723","heartbeat_front_addr":"172.21.15.28:6805/38723","state":["exists","up"]},{"osd":3,"uuid":"303d0728-409d-47d7-b7a6-6eb273f602fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":38725},{"type":"v1","addr":"172.21.15.28:6817","nonce":38725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":38725},{"type":"v1","addr":"172.21.15.28:6819","nonce":38725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":38725},{"type":"v1","addr":"172.21.15.28:6825","nonce":38725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":38725},{"type":"v1","addr":"172.21.15.28:6821","nonce":38725}]},"public_addr":"172.21.15.28:6817/38725","cluster_addr":"172.21.15.28:6819/38725","heartbeat_back_addr":"172.21.15.28:6825/38725","heartbeat_front_addr":"172.21.15.28:6821/38725","state":["exists","up"]},{"osd":4,"uuid":"df0bf0ac-6efe-4964-ad27-7c1771a70c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":38828},{"type":"v1","addr":"172.21.15.70:6801","nonce":38828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":38828},{"type":"v1","addr":"172.21.15.70:6803","nonce":38828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":38828},{"type":"v1","addr":"172.21.15.70:6807","nonce":38828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":38828},{"type":"v1","addr":"172.21.15.70:6805","nonce":38828}]},"public_addr":"172.21.15.70:6801/38828","cluster_addr":"172.21.15.70:6803/38828","heartbeat_back_addr":"172.21.15.70:6807/38828","heartbeat_front_addr":"172.21.15.70:6805/38828","state":["exists","up"]},{"osd":5,"uuid":"84921219-65cb-4c4e-b9ed-a773db639034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":38830},{"type":"v1","addr":"172.21.15.70:6810","nonce":38830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6813","nonce":38830},{"type":"v1","addr":"172.21.15.70:6814","nonce":38830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":38830},{"type":"v1","addr":"172.21.15.70:6824","nonce":38830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":38830},{"type":"v1","addr":"172.21.15.70:6819","nonce":38830}]},"public_addr":"172.21.15.70:6810/38830","cluster_addr":"172.21.15.70:6814/38830","heartbeat_back_addr":"172.21.15.70:6824/38830","heartbeat_front_addr":"172.21.15.70:6819/38830","state":["exists","up"]},{"osd":6,"uuid":"c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":38829},{"type":"v1","addr":"172.21.15.70:6812","nonce":38829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":38829},{"type":"v1","addr":"172.21.15.70:6820","nonce":38829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":38829},{"type":"v1","addr":"172.21.15.70:6828","nonce":38829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":38829},{"type":"v1","addr":"172.21.15.70:6825","nonce":38829}]},"public_addr":"172.21.15.70:6812/38829","cluster_addr":"172.21.15.70:6820/38829","heartbeat_back_addr":"172.21.15.70:6828/38829","heartbeat_front_addr":"172.21.15.70:6825/38829","state":["exists","up"]},{"osd":7,"uuid":"e2cdd418-12ce-4eea-9b22-efdad83eb76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":38839},{"type":"v1","addr":"172.21.15.70:6815","nonce":38839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":38839},{"type":"v1","addr":"172.21.15.70:6823","nonce":38839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":38839},{"type":"v1","addr":"172.21.15.70:6831","nonce":38839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6827","nonce":38839},{"type":"v1","addr":"172.21.15.70:6829","nonce":38839}]},"public_addr":"172.21.15.70:6815/38839","cluster_addr":"172.21.15.70:6823/38839","heartbeat_back_addr":"172.21.15.70:6831/38839","heartbeat_front_addr":"172.21.15.70:6829/38839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.544240+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.637637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.352115+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.652916+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.624477+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.570247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.706468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.696574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-16T02:29:38.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.209+0000 7f6a3a1f1640 1 -- 172.21.15.28:0/3311409623 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f6a14065a60 msgr2=0x7f6a14067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:38.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.209+0000 7f6a3a1f1640 1 --2- 172.21.15.28:0/3311409623 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f6a14065a60 0x7f6a14067f20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0ad000 tx=0x7f6a2c008040 comp rx=0 tx=0).stop 2023-11-16T02:29:38.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.209+0000 7f6a3a1f1640 1 -- 172.21.15.28:0/3311409623 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a34148960 msgr2=0x7f6a34136500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:38.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.209+0000 7f6a3a1f1640 1 --2- 172.21.15.28:0/3311409623 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a34148960 0x7f6a34136500 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400c3c0 tx=0x7f6a2400c880 comp rx=0 tx=0).stop 2023-11-16T02:29:38.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.209+0000 7f6a3a1f1640 1 -- 172.21.15.28:0/3311409623 shutdown_connections 2023-11-16T02:29:38.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.209+0000 7f6a3a1f1640 1 --2- 172.21.15.28:0/3311409623 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f6a14065a60 0x7f6a14067f20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:38.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.209+0000 7f6a3a1f1640 1 --2- 172.21.15.28:0/3311409623 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6a34148960 0x7f6a34136500 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:38.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.209+0000 7f6a3a1f1640 1 --2- 172.21.15.28:0/3311409623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a340b8240 0x7f6a34144230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:38.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.209+0000 7f6a3a1f1640 1 --2- 172.21.15.28:0/3311409623 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6a340b3b60 0x7f6a341456d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:38.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.209+0000 7f6a3a1f1640 1 -- 172.21.15.28:0/3311409623 >> 172.21.15.28:0/3311409623 conn(0x7f6a340b9050 msgr2=0x7f6a34071800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:38.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.209+0000 7f6a3a1f1640 1 -- 172.21.15.28:0/3311409623 shutdown_connections 2023-11-16T02:29:38.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.209+0000 7f6a3a1f1640 1 -- 172.21.15.28:0/3311409623 wait complete. 2023-11-16T02:29:38.229 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-16T02:29:38.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.341+0000 7f56dd0ea640 1 Processor -- start 2023-11-16T02:29:38.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.341+0000 7f56dd0ea640 1 -- start start 2023-11-16T02:29:38.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56dd0ea640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f56d80b86d0 0x7f56d80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:38.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56dd0ea640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f56d814b710 0x7f56d8144b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:38.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56dd0ea640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d806c260 con 0x7f56d81446a0 2023-11-16T02:29:38.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56dd0ea640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d80ba470 con 0x7f56d814b710 2023-11-16T02:29:38.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56dd0ea640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d80ba6e0 con 0x7f56d80b86d0 2023-11-16T02:29:38.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56d759e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f56d814b710 0x7f56d8144b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:38.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56d759e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f56d814b710 0x7f56d8144b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38412/0 (socket says 172.21.15.28:38412) 2023-11-16T02:29:38.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56d659c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f56d81446a0 0x7f56d814b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:32828/0 (socket says 172.21.15.28:32828) 2023-11-16T02:29:38.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56d759e640 1 -- 172.21.15.28:0/2106056490 learned_addr learned my addr 172.21.15.28:0/2106056490 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:38.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56d6d9d640 1 --2- 172.21.15.28:0/2106056490 >> v2:172.21.15.70:3300/0 conn(0x7f56d80b86d0 0x7f56d80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:38.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56d759e640 1 -- 172.21.15.28:0/2106056490 >> v2:172.21.15.70:3300/0 conn(0x7f56d80b86d0 msgr2=0x7f56d80b8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:38.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56d759e640 1 --2- 172.21.15.28:0/2106056490 >> v2:172.21.15.70:3300/0 conn(0x7f56d80b86d0 0x7f56d80b8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:38.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56d759e640 1 -- 172.21.15.28:0/2106056490 >> v1:172.21.15.28:6789/0 conn(0x7f56d81446a0 legacy=0x7f56d814b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:38.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56d759e640 1 -- 172.21.15.28:0/2106056490 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d814aae0 con 0x7f56d814b710 2023-11-16T02:29:38.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56d5d9b640 1 -- 172.21.15.28:0/2106056490 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798423326 0 0) 0x7f56d806c260 con 0x7f56d81446a0 2023-11-16T02:29:38.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56d6d9d640 1 --2- 172.21.15.28:0/2106056490 >> v2:172.21.15.70:3300/0 conn(0x7f56d80b86d0 0x7f56d80b8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:38.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56d759e640 1 --2- 172.21.15.28:0/2106056490 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56d814b710 0x7f56d8144b00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f56d806af30 tx=0x7f56d001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a1f581d9727f42 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:38.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56d5d9b640 1 -- 172.21.15.28:0/2106056490 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d00a5880 con 0x7f56d814b710 2023-11-16T02:29:38.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56d5d9b640 1 -- 172.21.15.28:0/2106056490 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d00a59e0 con 0x7f56d814b710 2023-11-16T02:29:38.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56d5d9b640 1 -- 172.21.15.28:0/2106056490 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d00a5d70 con 0x7f56d814b710 2023-11-16T02:29:38.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56dd0ea640 1 -- 172.21.15.28:0/2106056490 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56d814b710 msgr2=0x7f56d8144b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:38.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56dd0ea640 1 --2- 172.21.15.28:0/2106056490 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56d814b710 0x7f56d8144b00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f56d806af30 tx=0x7f56d001c9a0 comp rx=0 tx=0).stop 2023-11-16T02:29:38.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56dd0ea640 1 -- 172.21.15.28:0/2106056490 shutdown_connections 2023-11-16T02:29:38.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56dd0ea640 1 --2- 172.21.15.28:0/2106056490 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56d814b710 0x7f56d8144b00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:38.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56dd0ea640 1 --2- 172.21.15.28:0/2106056490 >> v2:172.21.15.70:3300/0 conn(0x7f56d80b86d0 0x7f56d80b8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:38.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56dd0ea640 1 -- 172.21.15.28:0/2106056490 >> 172.21.15.28:0/2106056490 conn(0x7f56d806b770 msgr2=0x7f56d806bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:38.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56dd0ea640 1 -- 172.21.15.28:0/2106056490 shutdown_connections 2023-11-16T02:29:38.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.345+0000 7f56dd0ea640 1 -- 172.21.15.28:0/2106056490 wait complete. 2023-11-16T02:29:38.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.349+0000 7f56dd0ea640 1 Processor -- start 2023-11-16T02:29:38.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.349+0000 7f56dd0ea640 1 -- start start 2023-11-16T02:29:38.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.349+0000 7f56dd0ea640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f56d80b86d0 0x7f56d81402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:38.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.349+0000 7f56dd0ea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56d81446a0 0x7f56d81e5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:38.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.349+0000 7f56dd0ea640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56d814b710 0x7f56d8135c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:38.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.349+0000 7f56dd0ea640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d8140800 con 0x7f56d814b710 2023-11-16T02:29:38.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.349+0000 7f56dd0ea640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d8138f40 con 0x7f56d81446a0 2023-11-16T02:29:38.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.349+0000 7f56dd0ea640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d814d570 con 0x7f56d80b86d0 2023-11-16T02:29:38.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.349+0000 7f56d759e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56d814b710 0x7f56d8135c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:38.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.349+0000 7f56d759e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56d814b710 0x7f56d8135c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38420/0 (socket says 172.21.15.28:38420) 2023-11-16T02:29:38.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.349+0000 7f56d759e640 1 -- 172.21.15.28:0/758729478 learned_addr learned my addr 172.21.15.28:0/758729478 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:38.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.349+0000 7f56d6d9d640 1 --2- 172.21.15.28:0/758729478 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f56d80b86d0 0x7f56d81402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:38.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.349+0000 7f56d759e640 1 -- 172.21.15.28:0/758729478 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f56d80b86d0 msgr2=0x7f56d81402c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:38.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.349+0000 7f56d659c640 1 --2- 172.21.15.28:0/758729478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56d81446a0 0x7f56d81e5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:38.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.349+0000 7f56d759e640 1 --2- 172.21.15.28:0/758729478 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f56d80b86d0 0x7f56d81402c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:38.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.349+0000 7f56d759e640 1 -- 172.21.15.28:0/758729478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56d81446a0 msgr2=0x7f56d81e5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:38.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.349+0000 7f56d759e640 1 --2- 172.21.15.28:0/758729478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56d81446a0 0x7f56d81e5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:38.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.349+0000 7f56d759e640 1 -- 172.21.15.28:0/758729478 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d0009b30 con 0x7f56d814b710 2023-11-16T02:29:38.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.349+0000 7f56d659c640 1 --2- 172.21.15.28:0/758729478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56d81446a0 0x7f56d81e5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:38.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.349+0000 7f56d759e640 1 --2- 172.21.15.28:0/758729478 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56d814b710 0x7f56d8135c90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f56d00af040 tx=0x7f56d0019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:38.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.349+0000 7f56bf7fe640 1 -- 172.21.15.28:0/758729478 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d00b8880 con 0x7f56d814b710 2023-11-16T02:29:38.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.349+0000 7f56bf7fe640 1 -- 172.21.15.28:0/758729478 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d00b8a00 con 0x7f56d814b710 2023-11-16T02:29:38.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.349+0000 7f56dd0ea640 1 -- 172.21.15.28:0/758729478 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d814c090 con 0x7f56d814b710 2023-11-16T02:29:38.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.349+0000 7f56bf7fe640 1 -- 172.21.15.28:0/758729478 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d00b8db0 con 0x7f56d814b710 2023-11-16T02:29:38.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.349+0000 7f56dd0ea640 1 -- 172.21.15.28:0/758729478 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d813af00 con 0x7f56d814b710 2023-11-16T02:29:38.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.349+0000 7f56dd0ea640 1 -- 172.21.15.28:0/758729478 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d804e8a0 con 0x7f56d814b710 2023-11-16T02:29:38.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.353+0000 7f56bf7fe640 1 -- 172.21.15.28:0/758729478 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f56d00c3460 con 0x7f56d814b710 2023-11-16T02:29:38.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.353+0000 7f56bf7fe640 1 --2- 172.21.15.28:0/758729478 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f56c4065a60 0x7f56c4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:38.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.353+0000 7f56bf7fe640 1 -- 172.21.15.28:0/758729478 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56d011ea00 con 0x7f56d814b710 2023-11-16T02:29:38.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.353+0000 7f56d6d9d640 1 --2- 172.21.15.28:0/758729478 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f56c4065a60 0x7f56c4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:38.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.353+0000 7f56d6d9d640 1 --2- 172.21.15.28:0/758729478 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f56c4065a60 0x7f56c4067f20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f56c8006fd0 tx=0x7f56c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:38.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.357+0000 7f56bf7fe640 1 -- 172.21.15.28:0/758729478 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f56d00ec590 con 0x7f56d814b710 2023-11-16T02:29:38.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.517+0000 7f56dd0ea640 1 -- 172.21.15.28:0/758729478 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56d814d990 con 0x7f56d814b710 2023-11-16T02:29:38.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.521+0000 7f56bf7fe640 1 -- 172.21.15.28:0/758729478 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16002 (secure 0 0 0) 0x7f56d00efbb0 con 0x7f56d814b710 2023-11-16T02:29:38.524 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:38.524 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":21,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","created":"2023-11-16T02:29:13.710567+0000","modified":"2023-11-16T02:29:37.867312+0000","last_up_change":"2023-11-16T02:29:24.841087+0000","last_in_change":"2023-11-16T02:29:16.024490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-16T02:29:26.490910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-16T02:29:36.133224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-16T02:29:36.866156+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dfa8b58d-3481-4e68-86e8-21873d31d0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":38722},{"type":"v1","addr":"172.21.15.28:6809","nonce":38722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":38722},{"type":"v1","addr":"172.21.15.28:6811","nonce":38722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":38722},{"type":"v1","addr":"172.21.15.28:6815","nonce":38722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":38722},{"type":"v1","addr":"172.21.15.28:6813","nonce":38722}]},"public_addr":"172.21.15.28:6809/38722","cluster_addr":"172.21.15.28:6811/38722","heartbeat_back_addr":"172.21.15.28:6815/38722","heartbeat_front_addr":"172.21.15.28:6813/38722","state":["exists","up"]},{"osd":1,"uuid":"1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":38724},{"type":"v1","addr":"172.21.15.28:6824","nonce":38724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":38724},{"type":"v1","addr":"172.21.15.28:6827","nonce":38724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":38724},{"type":"v1","addr":"172.21.15.28:6831","nonce":38724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":38724},{"type":"v1","addr":"172.21.15.28:6829","nonce":38724}]},"public_addr":"172.21.15.28:6824/38724","cluster_addr":"172.21.15.28:6827/38724","heartbeat_back_addr":"172.21.15.28:6831/38724","heartbeat_front_addr":"172.21.15.28:6829/38724","state":["exists","up"]},{"osd":2,"uuid":"e18f39cd-6a35-4d36-9eed-3877794bf2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":38723},{"type":"v1","addr":"172.21.15.28:6801","nonce":38723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":38723},{"type":"v1","addr":"172.21.15.28:6803","nonce":38723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":38723},{"type":"v1","addr":"172.21.15.28:6807","nonce":38723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":38723},{"type":"v1","addr":"172.21.15.28:6805","nonce":38723}]},"public_addr":"172.21.15.28:6801/38723","cluster_addr":"172.21.15.28:6803/38723","heartbeat_back_addr":"172.21.15.28:6807/38723","heartbeat_front_addr":"172.21.15.28:6805/38723","state":["exists","up"]},{"osd":3,"uuid":"303d0728-409d-47d7-b7a6-6eb273f602fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":38725},{"type":"v1","addr":"172.21.15.28:6817","nonce":38725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":38725},{"type":"v1","addr":"172.21.15.28:6819","nonce":38725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":38725},{"type":"v1","addr":"172.21.15.28:6825","nonce":38725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":38725},{"type":"v1","addr":"172.21.15.28:6821","nonce":38725}]},"public_addr":"172.21.15.28:6817/38725","cluster_addr":"172.21.15.28:6819/38725","heartbeat_back_addr":"172.21.15.28:6825/38725","heartbeat_front_addr":"172.21.15.28:6821/38725","state":["exists","up"]},{"osd":4,"uuid":"df0bf0ac-6efe-4964-ad27-7c1771a70c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":38828},{"type":"v1","addr":"172.21.15.70:6801","nonce":38828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":38828},{"type":"v1","addr":"172.21.15.70:6803","nonce":38828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":38828},{"type":"v1","addr":"172.21.15.70:6807","nonce":38828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":38828},{"type":"v1","addr":"172.21.15.70:6805","nonce":38828}]},"public_addr":"172.21.15.70:6801/38828","cluster_addr":"172.21.15.70:6803/38828","heartbeat_back_addr":"172.21.15.70:6807/38828","heartbeat_front_addr":"172.21.15.70:6805/38828","state":["exists","up"]},{"osd":5,"uuid":"84921219-65cb-4c4e-b9ed-a773db639034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":38830},{"type":"v1","addr":"172.21.15.70:6810","nonce":38830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6813","nonce":38830},{"type":"v1","addr":"172.21.15.70:6814","nonce":38830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":38830},{"type":"v1","addr":"172.21.15.70:6824","nonce":38830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":38830},{"type":"v1","addr":"172.21.15.70:6819","nonce":38830}]},"public_addr":"172.21.15.70:6810/38830","cluster_addr":"172.21.15.70:6814/38830","heartbeat_back_addr":"172.21.15.70:6824/38830","heartbeat_front_addr":"172.21.15.70:6819/38830","state":["exists","up"]},{"osd":6,"uuid":"c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":38829},{"type":"v1","addr":"172.21.15.70:6812","nonce":38829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":38829},{"type":"v1","addr":"172.21.15.70:6820","nonce":38829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":38829},{"type":"v1","addr":"172.21.15.70:6828","nonce":38829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":38829},{"type":"v1","addr":"172.21.15.70:6825","nonce":38829}]},"public_addr":"172.21.15.70:6812/38829","cluster_addr":"172.21.15.70:6820/38829","heartbeat_back_addr":"172.21.15.70:6828/38829","heartbeat_front_addr":"172.21.15.70:6825/38829","state":["exists","up"]},{"osd":7,"uuid":"e2cdd418-12ce-4eea-9b22-efdad83eb76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":38839},{"type":"v1","addr":"172.21.15.70:6815","nonce":38839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":38839},{"type":"v1","addr":"172.21.15.70:6823","nonce":38839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":38839},{"type":"v1","addr":"172.21.15.70:6831","nonce":38839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6827","nonce":38839},{"type":"v1","addr":"172.21.15.70:6829","nonce":38839}]},"public_addr":"172.21.15.70:6815/38839","cluster_addr":"172.21.15.70:6823/38839","heartbeat_back_addr":"172.21.15.70:6831/38839","heartbeat_front_addr":"172.21.15.70:6829/38839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.544240+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.637637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.352115+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.652916+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.624477+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.570247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.706468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.696574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-16T02:29:38.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.521+0000 7f56dd0ea640 1 -- 172.21.15.28:0/758729478 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f56c4065a60 msgr2=0x7f56c4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:38.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.521+0000 7f56dd0ea640 1 --2- 172.21.15.28:0/758729478 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f56c4065a60 0x7f56c4067f20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f56c8006fd0 tx=0x7f56c8008040 comp rx=0 tx=0).stop 2023-11-16T02:29:38.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.521+0000 7f56dd0ea640 1 -- 172.21.15.28:0/758729478 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56d814b710 msgr2=0x7f56d8135c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:38.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.521+0000 7f56dd0ea640 1 --2- 172.21.15.28:0/758729478 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56d814b710 0x7f56d8135c90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f56d00af040 tx=0x7f56d0019740 comp rx=0 tx=0).stop 2023-11-16T02:29:38.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.521+0000 7f56dd0ea640 1 -- 172.21.15.28:0/758729478 shutdown_connections 2023-11-16T02:29:38.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.521+0000 7f56dd0ea640 1 --2- 172.21.15.28:0/758729478 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f56c4065a60 0x7f56c4067f20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:38.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.521+0000 7f56dd0ea640 1 --2- 172.21.15.28:0/758729478 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f56d814b710 0x7f56d8135c90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:38.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.521+0000 7f56dd0ea640 1 --2- 172.21.15.28:0/758729478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56d81446a0 0x7f56d81e5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:38.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.521+0000 7f56dd0ea640 1 --2- 172.21.15.28:0/758729478 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f56d80b86d0 0x7f56d81402c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:38.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.521+0000 7f56dd0ea640 1 -- 172.21.15.28:0/758729478 >> 172.21.15.28:0/758729478 conn(0x7f56d806b770 msgr2=0x7f56d80b7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:38.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.521+0000 7f56dd0ea640 1 -- 172.21.15.28:0/758729478 shutdown_connections 2023-11-16T02:29:38.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.521+0000 7f56dd0ea640 1 -- 172.21.15.28:0/758729478 wait complete. 2023-11-16T02:29:38.543 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-16T02:29:38.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.669+0000 7f4cbe9c5640 1 Processor -- start 2023-11-16T02:29:38.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.669+0000 7f4cbe9c5640 1 -- start start 2023-11-16T02:29:38.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.669+0000 7f4cbe9c5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4cb80702d0 0x7f4cb8071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:38.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.669+0000 7f4cbe9c5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4cb81417e0 0x7f4cb8141c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:38.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.669+0000 7f4cbe9c5640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb814b1f0 con 0x7f4cb806a3d0 2023-11-16T02:29:38.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.669+0000 7f4cbe9c5640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb814bd90 con 0x7f4cb81417e0 2023-11-16T02:29:38.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.669+0000 7f4cbe9c5640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb814aec0 con 0x7f4cb80702d0 2023-11-16T02:29:38.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.669+0000 7f4cbcf62640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4cb81417e0 0x7f4cb8141c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:38.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.669+0000 7f4cbcf62640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4cb81417e0 0x7f4cb8141c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38436/0 (socket says 172.21.15.28:38436) 2023-11-16T02:29:38.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.669+0000 7f4cbcf62640 1 -- 172.21.15.28:0/2974868592 learned_addr learned my addr 172.21.15.28:0/2974868592 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:38.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.669+0000 7f4caffff640 1 --2- 172.21.15.28:0/2974868592 >> v2:172.21.15.70:3300/0 conn(0x7f4cb80702d0 0x7f4cb8071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:38.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.669+0000 7f4cbcf62640 1 -- 172.21.15.28:0/2974868592 >> v2:172.21.15.70:3300/0 conn(0x7f4cb80702d0 msgr2=0x7f4cb8071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:38.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.669+0000 7f4cbcf62640 1 --2- 172.21.15.28:0/2974868592 >> v2:172.21.15.70:3300/0 conn(0x7f4cb80702d0 0x7f4cb8071090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:38.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.669+0000 7f4cbcf62640 1 -- 172.21.15.28:0/2974868592 >> v1:172.21.15.70:6789/0 conn(0x7f4cb806a3d0 legacy=0x7f4cb814b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:38.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.669+0000 7f4cbcf62640 1 -- 172.21.15.28:0/2974868592 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb80716b0 con 0x7f4cb81417e0 2023-11-16T02:29:38.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4cbcf62640 1 --2- 172.21.15.28:0/2974868592 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cb81417e0 0x7f4cb8141c90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4cb80b32b0 tx=0x7f4cb001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36943e13229e65c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:38.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4cb77fe640 1 -- 172.21.15.28:0/2974868592 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb00a57b0 con 0x7f4cb81417e0 2023-11-16T02:29:38.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4cb77fe640 1 -- 172.21.15.28:0/2974868592 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb00a5910 con 0x7f4cb81417e0 2023-11-16T02:29:38.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4cb77fe640 1 -- 172.21.15.28:0/2974868592 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb00a5ca0 con 0x7f4cb81417e0 2023-11-16T02:29:38.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4cbe9c5640 1 -- 172.21.15.28:0/2974868592 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cb81417e0 msgr2=0x7f4cb8141c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:38.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4cbe9c5640 1 --2- 172.21.15.28:0/2974868592 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cb81417e0 0x7f4cb8141c90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4cb80b32b0 tx=0x7f4cb001c9d0 comp rx=0 tx=0).stop 2023-11-16T02:29:38.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4cbe9c5640 1 -- 172.21.15.28:0/2974868592 shutdown_connections 2023-11-16T02:29:38.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4cbe9c5640 1 --2- 172.21.15.28:0/2974868592 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cb81417e0 0x7f4cb8141c90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:38.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4cbe9c5640 1 --2- 172.21.15.28:0/2974868592 >> v2:172.21.15.70:3300/0 conn(0x7f4cb80702d0 0x7f4cb8071090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:38.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4cbe9c5640 1 -- 172.21.15.28:0/2974868592 >> 172.21.15.28:0/2974868592 conn(0x7f4cb80bc5a0 msgr2=0x7f4cb80bc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:38.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4cbe9c5640 1 -- 172.21.15.28:0/2974868592 shutdown_connections 2023-11-16T02:29:38.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4cbe9c5640 1 -- 172.21.15.28:0/2974868592 wait complete. 2023-11-16T02:29:38.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4cbe9c5640 1 Processor -- start 2023-11-16T02:29:38.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4cbe9c5640 1 -- start start 2023-11-16T02:29:38.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4cbe9c5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cb806a3d0 0x7f4cb8146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:38.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4cbe9c5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cb80702d0 0x7f4cb8145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:38.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4cbe9c5640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4cb81417e0 0x7f4cb8147620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:38.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4cbe9c5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb8146e40 con 0x7f4cb80702d0 2023-11-16T02:29:38.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4cbe9c5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb8145690 con 0x7f4cb806a3d0 2023-11-16T02:29:38.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4cbe9c5640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb813aa40 con 0x7f4cb81417e0 2023-11-16T02:29:38.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4caffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cb80702d0 0x7f4cb8145dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:38.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4caffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cb80702d0 0x7f4cb8145dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38442/0 (socket says 172.21.15.28:38442) 2023-11-16T02:29:38.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4caffff640 1 -- 172.21.15.28:0/1935317144 learned_addr learned my addr 172.21.15.28:0/1935317144 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:38.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4cb7fff640 1 --2- 172.21.15.28:0/1935317144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cb806a3d0 0x7f4cb8146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:38.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4cbcf62640 1 --2- 172.21.15.28:0/1935317144 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4cb81417e0 0x7f4cb8147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:38.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4caffff640 1 -- 172.21.15.28:0/1935317144 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4cb81417e0 msgr2=0x7f4cb8147620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:38.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4caffff640 1 --2- 172.21.15.28:0/1935317144 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4cb81417e0 0x7f4cb8147620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:38.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4caffff640 1 -- 172.21.15.28:0/1935317144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cb806a3d0 msgr2=0x7f4cb8146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:38.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4caffff640 1 --2- 172.21.15.28:0/1935317144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cb806a3d0 0x7f4cb8146900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:38.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4caffff640 1 -- 172.21.15.28:0/1935317144 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb0009b30 con 0x7f4cb80702d0 2023-11-16T02:29:38.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4caffff640 1 --2- 172.21.15.28:0/1935317144 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cb80702d0 0x7f4cb8145dc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000d7d0 tx=0x7f4ca000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:38.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4cb57fa640 1 -- 172.21.15.28:0/1935317144 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0018070 con 0x7f4cb80702d0 2023-11-16T02:29:38.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4cb57fa640 1 -- 172.21.15.28:0/1935317144 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca0004020 con 0x7f4cb80702d0 2023-11-16T02:29:38.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4cbe9c5640 1 -- 172.21.15.28:0/1935317144 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb813ad20 con 0x7f4cb80702d0 2023-11-16T02:29:38.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.673+0000 7f4cb57fa640 1 -- 172.21.15.28:0/1935317144 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca00041d0 con 0x7f4cb80702d0 2023-11-16T02:29:38.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.677+0000 7f4cbe9c5640 1 -- 172.21.15.28:0/1935317144 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb81e3ea0 con 0x7f4cb80702d0 2023-11-16T02:29:38.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.677+0000 7f4cbe9c5640 1 -- 172.21.15.28:0/1935317144 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb804e8a0 con 0x7f4cb80702d0 2023-11-16T02:29:38.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.677+0000 7f4cb57fa640 1 -- 172.21.15.28:0/1935317144 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4ca0004330 con 0x7f4cb80702d0 2023-11-16T02:29:38.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.677+0000 7f4cb57fa640 1 --2- 172.21.15.28:0/1935317144 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4c98065a60 0x7f4c98067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:38.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.677+0000 7f4cb57fa640 1 -- 172.21.15.28:0/1935317144 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ca0082f90 con 0x7f4cb80702d0 2023-11-16T02:29:38.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.677+0000 7f4cb7fff640 1 --2- 172.21.15.28:0/1935317144 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4c98065a60 0x7f4c98067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:38.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.677+0000 7f4cb7fff640 1 --2- 172.21.15.28:0/1935317144 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4c98065a60 0x7f4c98067f20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8007fd0 tx=0x7f4ca8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:38.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.681+0000 7f4cb57fa640 1 -- 172.21.15.28:0/1935317144 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f4ca00b4070 con 0x7f4cb80702d0 2023-11-16T02:29:38.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:38.873+0000 7f4cbe9c5640 1 -- 172.21.15.28:0/1935317144 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4cb806fa50 con 0x7f4cb80702d0 2023-11-16T02:29:39.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:39.877+0000 7f4cb57fa640 1 -- 172.21.15.28:0/1935317144 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4ca0050950 con 0x7f4cb80702d0 2023-11-16T02:29:39.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:39.881+0000 7f4cbe9c5640 1 -- 172.21.15.28:0/1935317144 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4c98065a60 msgr2=0x7f4c98067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:39.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:39.881+0000 7f4cbe9c5640 1 --2- 172.21.15.28:0/1935317144 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4c98065a60 0x7f4c98067f20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8007fd0 tx=0x7f4ca8009040 comp rx=0 tx=0).stop 2023-11-16T02:29:39.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:39.881+0000 7f4cbe9c5640 1 -- 172.21.15.28:0/1935317144 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cb80702d0 msgr2=0x7f4cb8145dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:39.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:39.881+0000 7f4cbe9c5640 1 --2- 172.21.15.28:0/1935317144 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cb80702d0 0x7f4cb8145dc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000d7d0 tx=0x7f4ca000dc90 comp rx=0 tx=0).stop 2023-11-16T02:29:39.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:39.881+0000 7f4cbe9c5640 1 -- 172.21.15.28:0/1935317144 shutdown_connections 2023-11-16T02:29:39.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:39.881+0000 7f4cbe9c5640 1 --2- 172.21.15.28:0/1935317144 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4c98065a60 0x7f4c98067f20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:39.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:39.881+0000 7f4cbe9c5640 1 --2- 172.21.15.28:0/1935317144 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4cb81417e0 0x7f4cb8147620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:39.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:39.881+0000 7f4cbe9c5640 1 --2- 172.21.15.28:0/1935317144 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cb80702d0 0x7f4cb8145dc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:39.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:39.881+0000 7f4cbe9c5640 1 --2- 172.21.15.28:0/1935317144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cb806a3d0 0x7f4cb8146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:39.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:39.881+0000 7f4cbe9c5640 1 -- 172.21.15.28:0/1935317144 >> 172.21.15.28:0/1935317144 conn(0x7f4cb80bc5a0 msgr2=0x7f4cb80731d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:39.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:39.881+0000 7f4cbe9c5640 1 -- 172.21.15.28:0/1935317144 shutdown_connections 2023-11-16T02:29:39.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:39.881+0000 7f4cbe9c5640 1 -- 172.21.15.28:0/1935317144 wait complete. 2023-11-16T02:29:39.909 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-16T02:29:39.909 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-16T02:29:40.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd833aa640 1 Processor -- start 2023-11-16T02:29:40.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd833aa640 1 -- start start 2023-11-16T02:29:40.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd833aa640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd7c0702d0 0x7efd7c071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:40.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd833aa640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7c14b1f0 con 0x7efd7c1417e0 2023-11-16T02:29:40.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd833aa640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7c14aec0 con 0x7efd7c06a3d0 2023-11-16T02:29:40.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd833aa640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c14bd90 con 0x7efd7c0702d0 2023-11-16T02:29:40.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd81947640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7efd7c1417e0 0x7efd7c1521b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:39668/0 (socket says 172.21.15.28:39668) 2023-11-16T02:29:40.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd81947640 1 -- 172.21.15.28:0/3378764472 learned_addr learned my addr 172.21.15.28:0/3378764472 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:40.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd80945640 1 --2- 172.21.15.28:0/3378764472 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd7c0702d0 0x7efd7c071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:40.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd73fff640 1 -- 172.21.15.28:0/3378764472 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316216273 0 0) 0x7efd7c14b1f0 con 0x7efd7c1417e0 2023-11-16T02:29:40.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd73fff640 1 -- 172.21.15.28:0/3378764472 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd68003530 con 0x7efd7c1417e0 2023-11-16T02:29:40.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd73fff640 1 -- 172.21.15.28:0/3378764472 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 785399016 0 0) 0x7efd68003530 con 0x7efd7c1417e0 2023-11-16T02:29:40.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd73fff640 1 -- 172.21.15.28:0/3378764472 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd7c0702d0 msgr2=0x7efd7c071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:40.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd73fff640 1 --2- 172.21.15.28:0/3378764472 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd7c0702d0 0x7efd7c071090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:40.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd73fff640 1 -- 172.21.15.28:0/3378764472 >> v1:172.21.15.70:6789/0 conn(0x7efd7c06a3d0 legacy=0x7efd7c14b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:40.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd73fff640 1 -- 172.21.15.28:0/3378764472 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7c0716b0 con 0x7efd7c1417e0 2023-11-16T02:29:40.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd73fff640 1 -- 172.21.15.28:0/3378764472 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7efd74001a00 con 0x7efd7c1417e0 2023-11-16T02:29:40.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd73fff640 1 -- 172.21.15.28:0/3378764472 >> v1:172.21.15.28:6789/0 conn(0x7efd7c1417e0 legacy=0x7efd7c1521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:40.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd73fff640 1 --2- 172.21.15.28:0/3378764472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd680039b0 0x7efd68003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:40.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd73fff640 1 --2- 172.21.15.28:0/3378764472 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd680047d0 0x7efd68004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:40.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd73fff640 1 --2- 172.21.15.28:0/3378764472 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd7c0702d0 0x7efd68005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:40.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd73fff640 1 -- 172.21.15.28:0/3378764472 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c14bd90 con 0x7efd680047d0 2023-11-16T02:29:40.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd73fff640 1 -- 172.21.15.28:0/3378764472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6800ba40 con 0x7efd680039b0 2023-11-16T02:29:40.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd73fff640 1 -- 172.21.15.28:0/3378764472 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6800bc00 con 0x7efd7c0702d0 2023-11-16T02:29:40.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd80945640 1 --2- 172.21.15.28:0/3378764472 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd680047d0 0x7efd68004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:40.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd81146640 1 --2- 172.21.15.28:0/3378764472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd680039b0 0x7efd68003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:40.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd81947640 1 --2- 172.21.15.28:0/3378764472 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd7c0702d0 0x7efd68005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:40.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd80945640 1 -- 172.21.15.28:0/3378764472 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd7c0702d0 msgr2=0x7efd68005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:40.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd80945640 1 --2- 172.21.15.28:0/3378764472 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd7c0702d0 0x7efd68005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:40.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd80945640 1 -- 172.21.15.28:0/3378764472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd680039b0 msgr2=0x7efd68003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:40.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd80945640 1 --2- 172.21.15.28:0/3378764472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd680039b0 0x7efd68003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:40.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.041+0000 7efd80945640 1 -- 172.21.15.28:0/3378764472 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd68003530 con 0x7efd680047d0 2023-11-16T02:29:40.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.045+0000 7efd80945640 1 --2- 172.21.15.28:0/3378764472 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd680047d0 0x7efd68004c50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efd7c070710 tx=0x7efd6c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148e7eea5c230606 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:40.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.045+0000 7efd73fff640 1 -- 172.21.15.28:0/3378764472 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c0a55c0 con 0x7efd680047d0 2023-11-16T02:29:40.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.045+0000 7efd73fff640 1 -- 172.21.15.28:0/3378764472 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6c0a5720 con 0x7efd680047d0 2023-11-16T02:29:40.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.045+0000 7efd73fff640 1 -- 172.21.15.28:0/3378764472 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c0a5a90 con 0x7efd680047d0 2023-11-16T02:29:40.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.045+0000 7efd833aa640 1 -- 172.21.15.28:0/3378764472 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd680047d0 msgr2=0x7efd68004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:40.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.045+0000 7efd833aa640 1 --2- 172.21.15.28:0/3378764472 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd680047d0 0x7efd68004c50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efd7c070710 tx=0x7efd6c01c9d0 comp rx=0 tx=0).stop 2023-11-16T02:29:40.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.045+0000 7efd81947640 1 -- 172.21.15.28:0/3378764472 reap_dead start 2023-11-16T02:29:40.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.045+0000 7efd833aa640 1 -- 172.21.15.28:0/3378764472 shutdown_connections 2023-11-16T02:29:40.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.045+0000 7efd833aa640 1 -- 172.21.15.28:0/3378764472 >> 172.21.15.28:0/3378764472 conn(0x7efd7c0bc5a0 msgr2=0x7efd7c0bc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:40.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.045+0000 7efd833aa640 1 -- 172.21.15.28:0/3378764472 shutdown_connections 2023-11-16T02:29:40.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.045+0000 7efd833aa640 1 -- 172.21.15.28:0/3378764472 wait complete. 2023-11-16T02:29:40.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.045+0000 7efd833aa640 1 Processor -- start 2023-11-16T02:29:40.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.045+0000 7efd833aa640 1 -- start start 2023-11-16T02:29:40.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd833aa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd680047d0 0x7efd7c148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:40.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd833aa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd7c0bb710 0x7efd7c1e2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:40.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd833aa640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd7c13a100 0x7efd7c13a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:40.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd833aa640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c147440 con 0x7efd680047d0 2023-11-16T02:29:40.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd833aa640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c0bbb70 con 0x7efd7c0bb710 2023-11-16T02:29:40.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd833aa640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c1459d0 con 0x7efd7c13a100 2023-11-16T02:29:40.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd81146640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd680047d0 0x7efd7c148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:40.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd81146640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd680047d0 0x7efd7c148080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40762/0 (socket says 172.21.15.28:40762) 2023-11-16T02:29:40.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd81146640 1 -- 172.21.15.28:0/33339416 learned_addr learned my addr 172.21.15.28:0/33339416 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:40.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd80945640 1 --2- 172.21.15.28:0/33339416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd7c0bb710 0x7efd7c1e2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:40.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd81947640 1 --2- 172.21.15.28:0/33339416 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd7c13a100 0x7efd7c13a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:40.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd81146640 1 -- 172.21.15.28:0/33339416 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd7c13a100 msgr2=0x7efd7c13a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:40.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd81146640 1 --2- 172.21.15.28:0/33339416 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd7c13a100 0x7efd7c13a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:40.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd81146640 1 -- 172.21.15.28:0/33339416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd7c0bb710 msgr2=0x7efd7c1e2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:40.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd81146640 1 --2- 172.21.15.28:0/33339416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd7c0bb710 0x7efd7c1e2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:40.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd81146640 1 -- 172.21.15.28:0/33339416 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7c145cb0 con 0x7efd680047d0 2023-11-16T02:29:40.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd81947640 1 --2- 172.21.15.28:0/33339416 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd7c13a100 0x7efd7c13a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:40.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd81146640 1 --2- 172.21.15.28:0/33339416 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd680047d0 0x7efd7c148080 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efd7800e550 tx=0x7efd7800ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:40.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd71ffb640 1 -- 172.21.15.28:0/33339416 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd780052e0 con 0x7efd680047d0 2023-11-16T02:29:40.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd71ffb640 1 -- 172.21.15.28:0/33339416 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd78005440 con 0x7efd680047d0 2023-11-16T02:29:40.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd833aa640 1 -- 172.21.15.28:0/33339416 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd7c145f90 con 0x7efd680047d0 2023-11-16T02:29:40.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd71ffb640 1 -- 172.21.15.28:0/33339416 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd78003820 con 0x7efd680047d0 2023-11-16T02:29:40.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd833aa640 1 -- 172.21.15.28:0/33339416 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd7c13aac0 con 0x7efd680047d0 2023-11-16T02:29:40.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd833aa640 1 -- 172.21.15.28:0/33339416 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd7c04e8a0 con 0x7efd680047d0 2023-11-16T02:29:40.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd71ffb640 1 -- 172.21.15.28:0/33339416 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efd78003980 con 0x7efd680047d0 2023-11-16T02:29:40.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd71ffb640 1 --2- 172.21.15.28:0/33339416 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7efd60065a60 0x7efd60067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:40.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd71ffb640 1 -- 172.21.15.28:0/33339416 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd780839d0 con 0x7efd680047d0 2023-11-16T02:29:40.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd80945640 1 --2- 172.21.15.28:0/33339416 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7efd60065a60 0x7efd60067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:40.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.049+0000 7efd80945640 1 --2- 172.21.15.28:0/33339416 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7efd60065a60 0x7efd60067f20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efd6c0af000 tx=0x7efd6c0046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:40.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.053+0000 7efd71ffb640 1 -- 172.21.15.28:0/33339416 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7efd78051470 con 0x7efd680047d0 2023-11-16T02:29:40.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.249+0000 7efd833aa640 1 -- 172.21.15.28:0/33339416 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7efd7c0b7350 con 0x7efd680047d0 2023-11-16T02:29:40.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.885+0000 7efd71ffb640 1 -- 172.21.15.28:0/33339416 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7efd78054a90 con 0x7efd680047d0 2023-11-16T02:29:40.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.889+0000 7efd833aa640 1 -- 172.21.15.28:0/33339416 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7efd60065a60 msgr2=0x7efd60067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:40.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.889+0000 7efd833aa640 1 --2- 172.21.15.28:0/33339416 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7efd60065a60 0x7efd60067f20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efd6c0af000 tx=0x7efd6c0046d0 comp rx=0 tx=0).stop 2023-11-16T02:29:40.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.889+0000 7efd833aa640 1 -- 172.21.15.28:0/33339416 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd680047d0 msgr2=0x7efd7c148080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:40.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.889+0000 7efd833aa640 1 --2- 172.21.15.28:0/33339416 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd680047d0 0x7efd7c148080 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efd7800e550 tx=0x7efd7800ea10 comp rx=0 tx=0).stop 2023-11-16T02:29:40.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.889+0000 7efd833aa640 1 -- 172.21.15.28:0/33339416 shutdown_connections 2023-11-16T02:29:40.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.889+0000 7efd833aa640 1 --2- 172.21.15.28:0/33339416 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7efd60065a60 0x7efd60067f20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:40.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.889+0000 7efd833aa640 1 --2- 172.21.15.28:0/33339416 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd7c13a100 0x7efd7c13a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:40.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.889+0000 7efd833aa640 1 --2- 172.21.15.28:0/33339416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd7c0bb710 0x7efd7c1e2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:40.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.889+0000 7efd833aa640 1 --2- 172.21.15.28:0/33339416 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd680047d0 0x7efd7c148080 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:40.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.889+0000 7efd833aa640 1 -- 172.21.15.28:0/33339416 >> 172.21.15.28:0/33339416 conn(0x7efd7c0bc5a0 msgr2=0x7efd7c06ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:40.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.889+0000 7efd833aa640 1 -- 172.21.15.28:0/33339416 shutdown_connections 2023-11-16T02:29:40.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:40.889+0000 7efd833aa640 1 -- 172.21.15.28:0/33339416 wait complete. 2023-11-16T02:29:40.911 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-16T02:29:40.911 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-16T02:29:41.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.037+0000 7fee62d08640 1 Processor -- start 2023-11-16T02:29:41.039 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.037+0000 7fee62d08640 1 -- start start 2023-11-16T02:29:41.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.037+0000 7fee62d08640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fee5c0b50c0 0x7fee5c154270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:41.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.037+0000 7fee62d08640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5c14bef0 con 0x7fee5c14cbf0 2023-11-16T02:29:41.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.037+0000 7fee62d08640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5c0bb2b0 con 0x7fee5c0bb9a0 2023-11-16T02:29:41.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.037+0000 7fee62d08640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee5c143190 con 0x7fee5c0b50c0 2023-11-16T02:29:41.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.037+0000 7fee60aa4640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fee5c14cbf0 0x7fee5c0baba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:39682/0 (socket says 172.21.15.28:39682) 2023-11-16T02:29:41.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.037+0000 7fee60aa4640 1 -- 172.21.15.28:0/1505283512 learned_addr learned my addr 172.21.15.28:0/1505283512 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:41.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.037+0000 7fee612a5640 1 --2- 172.21.15.28:0/1505283512 >> v2:172.21.15.28:3300/0 conn(0x7fee5c0b50c0 0x7fee5c154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:41.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.037+0000 7fee5b7fe640 1 -- 172.21.15.28:0/1505283512 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2778226462 0 0) 0x7fee5c14bef0 con 0x7fee5c14cbf0 2023-11-16T02:29:41.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.037+0000 7fee5b7fe640 1 -- 172.21.15.28:0/1505283512 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee44003530 con 0x7fee5c14cbf0 2023-11-16T02:29:41.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.037+0000 7fee612a5640 1 -- 172.21.15.28:0/1505283512 >> v1:172.21.15.70:6789/0 conn(0x7fee5c0bb9a0 legacy=0x7fee5c0b7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:41.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.037+0000 7fee612a5640 1 -- 172.21.15.28:0/1505283512 >> v1:172.21.15.28:6789/0 conn(0x7fee5c14cbf0 legacy=0x7fee5c0baba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:41.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.037+0000 7fee612a5640 1 -- 172.21.15.28:0/1505283512 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c0b5ba0 con 0x7fee5c0b50c0 2023-11-16T02:29:41.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee612a5640 1 --2- 172.21.15.28:0/1505283512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee5c0b50c0 0x7fee5c154270 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fee540097a0 tx=0x7fee5401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3adb703d4e0b8a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:41.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee5b7fe640 1 -- 172.21.15.28:0/1505283512 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee540a8950 con 0x7fee5c0b50c0 2023-11-16T02:29:41.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee5b7fe640 1 -- 172.21.15.28:0/1505283512 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee540a8ab0 con 0x7fee5c0b50c0 2023-11-16T02:29:41.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee5b7fe640 1 -- 172.21.15.28:0/1505283512 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee540a8e40 con 0x7fee5c0b50c0 2023-11-16T02:29:41.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee62d08640 1 -- 172.21.15.28:0/1505283512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee5c0b50c0 msgr2=0x7fee5c154270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:41.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee62d08640 1 --2- 172.21.15.28:0/1505283512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee5c0b50c0 0x7fee5c154270 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fee540097a0 tx=0x7fee5401ec50 comp rx=0 tx=0).stop 2023-11-16T02:29:41.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee62d08640 1 -- 172.21.15.28:0/1505283512 shutdown_connections 2023-11-16T02:29:41.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee62d08640 1 --2- 172.21.15.28:0/1505283512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee5c0b50c0 0x7fee5c154270 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee62d08640 1 -- 172.21.15.28:0/1505283512 >> 172.21.15.28:0/1505283512 conn(0x7fee5c06eae0 msgr2=0x7fee5c06eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:41.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee62d08640 1 -- 172.21.15.28:0/1505283512 shutdown_connections 2023-11-16T02:29:41.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee62d08640 1 -- 172.21.15.28:0/1505283512 wait complete. 2023-11-16T02:29:41.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee62d08640 1 Processor -- start 2023-11-16T02:29:41.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee62d08640 1 -- start start 2023-11-16T02:29:41.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee62d08640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee5c0b50c0 0x7fee5c13fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:41.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee62d08640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee5c0bb9a0 0x7fee5c145a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:41.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee62d08640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fee5c14cbf0 0x7fee5c13d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:41.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee62d08640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c145fb0 con 0x7fee5c0b50c0 2023-11-16T02:29:41.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee62d08640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c13f470 con 0x7fee5c0bb9a0 2023-11-16T02:29:41.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee62d08640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c140210 con 0x7fee5c14cbf0 2023-11-16T02:29:41.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee60aa4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee5c0b50c0 0x7fee5c13fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:41.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee60aa4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee5c0b50c0 0x7fee5c13fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40782/0 (socket says 172.21.15.28:40782) 2023-11-16T02:29:41.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee60aa4640 1 -- 172.21.15.28:0/1601059305 learned_addr learned my addr 172.21.15.28:0/1601059305 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:41.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee612a5640 1 --2- 172.21.15.28:0/1601059305 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fee5c14cbf0 0x7fee5c13d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:41.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee5bfff640 1 --2- 172.21.15.28:0/1601059305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee5c0bb9a0 0x7fee5c145a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:41.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee60aa4640 1 -- 172.21.15.28:0/1601059305 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fee5c14cbf0 msgr2=0x7fee5c13d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:41.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee60aa4640 1 --2- 172.21.15.28:0/1601059305 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fee5c14cbf0 0x7fee5c13d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee60aa4640 1 -- 172.21.15.28:0/1601059305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee5c0bb9a0 msgr2=0x7fee5c145a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:41.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee60aa4640 1 --2- 172.21.15.28:0/1601059305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee5c0bb9a0 0x7fee5c145a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee60aa4640 1 -- 172.21.15.28:0/1601059305 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee54009400 con 0x7fee5c0b50c0 2023-11-16T02:29:41.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.041+0000 7fee612a5640 1 --2- 172.21.15.28:0/1601059305 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fee5c14cbf0 0x7fee5c13d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:41.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.045+0000 7fee60aa4640 1 --2- 172.21.15.28:0/1601059305 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee5c0b50c0 0x7fee5c13fb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00cbc0 tx=0x7fee4c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:41.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.045+0000 7fee597fa640 1 -- 172.21.15.28:0/1601059305 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c00ad40 con 0x7fee5c0b50c0 2023-11-16T02:29:41.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.045+0000 7fee597fa640 1 -- 172.21.15.28:0/1601059305 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4c012400 con 0x7fee5c0b50c0 2023-11-16T02:29:41.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.045+0000 7fee62d08640 1 -- 172.21.15.28:0/1601059305 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee5c13ebd0 con 0x7fee5c0b50c0 2023-11-16T02:29:41.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.045+0000 7fee597fa640 1 -- 172.21.15.28:0/1601059305 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c00aea0 con 0x7fee5c0b50c0 2023-11-16T02:29:41.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.045+0000 7fee62d08640 1 -- 172.21.15.28:0/1601059305 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee5c13f190 con 0x7fee5c0b50c0 2023-11-16T02:29:41.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.045+0000 7fee62d08640 1 -- 172.21.15.28:0/1601059305 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee5c04e8a0 con 0x7fee5c0b50c0 2023-11-16T02:29:41.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.045+0000 7fee597fa640 1 -- 172.21.15.28:0/1601059305 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fee4c007070 con 0x7fee5c0b50c0 2023-11-16T02:29:41.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.045+0000 7fee597fa640 1 --2- 172.21.15.28:0/1601059305 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fee48065a60 0x7fee48067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:41.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.045+0000 7fee597fa640 1 -- 172.21.15.28:0/1601059305 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee4c083160 con 0x7fee5c0b50c0 2023-11-16T02:29:41.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.045+0000 7fee5bfff640 1 --2- 172.21.15.28:0/1601059305 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fee48065a60 0x7fee48067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:41.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.045+0000 7fee5bfff640 1 --2- 172.21.15.28:0/1601059305 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fee48065a60 0x7fee48067f20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fee5c140de0 tx=0x7fee50009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:41.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.049+0000 7fee597fa640 1 -- 172.21.15.28:0/1601059305 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fee4c050b20 con 0x7fee5c0b50c0 2023-11-16T02:29:41.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.237+0000 7fee62d08640 1 -- 172.21.15.28:0/1601059305 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee5c14a170 con 0x7fee5c0b50c0 2023-11-16T02:29:41.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.237+0000 7fee597fa640 1 -- 172.21.15.28:0/1601059305 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3883 (secure 0 0 0) 0x7fee4c054140 con 0x7fee5c0b50c0 2023-11-16T02:29:41.243 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:41.243 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/4054669002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":4054669002},{"type":"v1","addr":"172.21.15.28:6836","nonce":4054669002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/903740631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":903740631},{"type":"v1","addr":"172.21.15.70:6833","nonce":903740631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-16T02:29:37.868031+0000","modified":"2023-11-16T02:29:40.877544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6837/1025130674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1025130674},{"type":"v1","addr":"172.21.15.28:6837","nonce":1025130674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-16T02:29:41.243 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 7 2023-11-16T02:29:41.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.241+0000 7fee62d08640 1 -- 172.21.15.28:0/1601059305 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fee48065a60 msgr2=0x7fee48067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:41.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.241+0000 7fee62d08640 1 --2- 172.21.15.28:0/1601059305 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fee48065a60 0x7fee48067f20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fee5c140de0 tx=0x7fee50009040 comp rx=0 tx=0).stop 2023-11-16T02:29:41.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.241+0000 7fee62d08640 1 -- 172.21.15.28:0/1601059305 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee5c0b50c0 msgr2=0x7fee5c13fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:41.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.241+0000 7fee62d08640 1 --2- 172.21.15.28:0/1601059305 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee5c0b50c0 0x7fee5c13fb30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00cbc0 tx=0x7fee4c00a430 comp rx=0 tx=0).stop 2023-11-16T02:29:41.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.241+0000 7fee62d08640 1 -- 172.21.15.28:0/1601059305 shutdown_connections 2023-11-16T02:29:41.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.241+0000 7fee62d08640 1 --2- 172.21.15.28:0/1601059305 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fee48065a60 0x7fee48067f20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.241+0000 7fee62d08640 1 --2- 172.21.15.28:0/1601059305 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fee5c14cbf0 0x7fee5c13d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.241+0000 7fee62d08640 1 --2- 172.21.15.28:0/1601059305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee5c0bb9a0 0x7fee5c145a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.241+0000 7fee62d08640 1 --2- 172.21.15.28:0/1601059305 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee5c0b50c0 0x7fee5c13fb30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.241+0000 7fee62d08640 1 -- 172.21.15.28:0/1601059305 >> 172.21.15.28:0/1601059305 conn(0x7fee5c06eae0 msgr2=0x7fee5c0b7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:41.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.241+0000 7fee62d08640 1 -- 172.21.15.28:0/1601059305 shutdown_connections 2023-11-16T02:29:41.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.241+0000 7fee62d08640 1 -- 172.21.15.28:0/1601059305 wait complete. 2023-11-16T02:29:41.261 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-16T02:29:41.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.385+0000 7fdfeae70640 1 Processor -- start 2023-11-16T02:29:41.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.385+0000 7fdfeae70640 1 -- start start 2023-11-16T02:29:41.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.385+0000 7fdfeae70640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fdfe4148a00 0x7fdfe409bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:41.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.385+0000 7fdfeae70640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdfe40700e0 0x7fdfe4153230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:41.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.385+0000 7fdfeae70640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfe406fc50 con 0x7fdfe406cc40 2023-11-16T02:29:41.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.385+0000 7fdfeae70640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfe4070550 con 0x7fdfe4148a00 2023-11-16T02:29:41.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.385+0000 7fdfeae70640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe4071ad0 con 0x7fdfe40700e0 2023-11-16T02:29:41.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe8c0c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fdfe406cc40 0x7fdfe4145c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:39690/0 (socket says 172.21.15.28:39690) 2023-11-16T02:29:41.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe8c0c640 1 -- 172.21.15.28:0/2899684338 learned_addr learned my addr 172.21.15.28:0/2899684338 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:41.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe3fff640 1 --2- 172.21.15.28:0/2899684338 >> v2:172.21.15.70:3300/0 conn(0x7fdfe4148a00 0x7fdfe409bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:41.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe940d640 1 --2- 172.21.15.28:0/2899684338 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdfe40700e0 0x7fdfe4153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:41.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe37fe640 1 -- 172.21.15.28:0/2899684338 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463651743 0 0) 0x7fdfe406fc50 con 0x7fdfe406cc40 2023-11-16T02:29:41.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe37fe640 1 -- 172.21.15.28:0/2899684338 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfd4003530 con 0x7fdfe406cc40 2023-11-16T02:29:41.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe37fe640 1 -- 172.21.15.28:0/2899684338 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2782266143 0 0) 0x7fdfd4003530 con 0x7fdfe406cc40 2023-11-16T02:29:41.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe37fe640 1 -- 172.21.15.28:0/2899684338 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdfe40700e0 msgr2=0x7fdfe4153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:41.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe37fe640 1 --2- 172.21.15.28:0/2899684338 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdfe40700e0 0x7fdfe4153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe37fe640 1 -- 172.21.15.28:0/2899684338 >> v2:172.21.15.70:3300/0 conn(0x7fdfe4148a00 msgr2=0x7fdfe409bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:41.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe37fe640 1 --2- 172.21.15.28:0/2899684338 >> v2:172.21.15.70:3300/0 conn(0x7fdfe4148a00 0x7fdfe409bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe37fe640 1 -- 172.21.15.28:0/2899684338 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe4071d50 con 0x7fdfe406cc40 2023-11-16T02:29:41.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe37fe640 1 -- 172.21.15.28:0/2899684338 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7fdfd8001680 con 0x7fdfe406cc40 2023-11-16T02:29:41.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe37fe640 1 -- 172.21.15.28:0/2899684338 >> v1:172.21.15.28:6789/0 conn(0x7fdfe406cc40 legacy=0x7fdfe4145c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:41.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe37fe640 1 --2- 172.21.15.28:0/2899684338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfd4003980 0x7fdfd4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:41.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe37fe640 1 --2- 172.21.15.28:0/2899684338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfd40047d0 0x7fdfd4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:41.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe37fe640 1 --2- 172.21.15.28:0/2899684338 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdfe40700e0 0x7fdfd4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:41.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe37fe640 1 -- 172.21.15.28:0/2899684338 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe4070550 con 0x7fdfd4003980 2023-11-16T02:29:41.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe37fe640 1 -- 172.21.15.28:0/2899684338 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe4071ad0 con 0x7fdfd40047d0 2023-11-16T02:29:41.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe37fe640 1 -- 172.21.15.28:0/2899684338 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd400b990 con 0x7fdfe40700e0 2023-11-16T02:29:41.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe8c0c640 1 --2- 172.21.15.28:0/2899684338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfd4003980 0x7fdfd4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:41.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe3fff640 1 --2- 172.21.15.28:0/2899684338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfd40047d0 0x7fdfd4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:41.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe8c0c640 1 -- 172.21.15.28:0/2899684338 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdfe40700e0 msgr2=0x7fdfd4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:41.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe8c0c640 1 --2- 172.21.15.28:0/2899684338 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdfe40700e0 0x7fdfd4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe8c0c640 1 -- 172.21.15.28:0/2899684338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfd40047d0 msgr2=0x7fdfd4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:41.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe8c0c640 1 --2- 172.21.15.28:0/2899684338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfd40047d0 0x7fdfd4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe8c0c640 1 -- 172.21.15.28:0/2899684338 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd4003530 con 0x7fdfd4003980 2023-11-16T02:29:41.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe3fff640 1 --2- 172.21.15.28:0/2899684338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfd40047d0 0x7fdfd4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:41.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe8c0c640 1 --2- 172.21.15.28:0/2899684338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfd4003980 0x7fdfd4003da0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdfd800c210 tx=0x7fdfd801f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821259127ce487d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:41.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe37fe640 1 -- 172.21.15.28:0/2899684338 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd80058e0 con 0x7fdfd4003980 2023-11-16T02:29:41.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe37fe640 1 -- 172.21.15.28:0/2899684338 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd8005a40 con 0x7fdfd4003980 2023-11-16T02:29:41.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe37fe640 1 -- 172.21.15.28:0/2899684338 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd8005df0 con 0x7fdfd4003980 2023-11-16T02:29:41.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfeae70640 1 -- 172.21.15.28:0/2899684338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfd4003980 msgr2=0x7fdfd4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:41.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfeae70640 1 --2- 172.21.15.28:0/2899684338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfd4003980 0x7fdfd4003da0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdfd800c210 tx=0x7fdfd801f3d0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.389+0000 7fdfe940d640 1 -- 172.21.15.28:0/2899684338 reap_dead start 2023-11-16T02:29:41.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfeae70640 1 -- 172.21.15.28:0/2899684338 shutdown_connections 2023-11-16T02:29:41.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfeae70640 1 -- 172.21.15.28:0/2899684338 >> 172.21.15.28:0/2899684338 conn(0x7fdfe406bec0 msgr2=0x7fdfe406c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:41.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfeae70640 1 -- 172.21.15.28:0/2899684338 shutdown_connections 2023-11-16T02:29:41.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfeae70640 1 -- 172.21.15.28:0/2899684338 wait complete. 2023-11-16T02:29:41.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfeae70640 1 Processor -- start 2023-11-16T02:29:41.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfeae70640 1 -- start start 2023-11-16T02:29:41.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfeae70640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdfd4003980 0x7fdfe41e10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:41.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfeae70640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfe40bc2a0 0x7fdfe41402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:41.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfeae70640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfe409c410 0x7fdfe409c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:41.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfeae70640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe41407e0 con 0x7fdfe409c410 2023-11-16T02:29:41.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfeae70640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe4149af0 con 0x7fdfe40bc2a0 2023-11-16T02:29:41.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfeae70640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe414ac10 con 0x7fdfd4003980 2023-11-16T02:29:41.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfe940d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfe409c410 0x7fdfe409c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:41.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfe940d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfe409c410 0x7fdfe409c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40806/0 (socket says 172.21.15.28:40806) 2023-11-16T02:29:41.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfe940d640 1 -- 172.21.15.28:0/2028834531 learned_addr learned my addr 172.21.15.28:0/2028834531 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:41.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfe3fff640 1 --2- 172.21.15.28:0/2028834531 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfe40bc2a0 0x7fdfe41402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:41.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfe8c0c640 1 --2- 172.21.15.28:0/2028834531 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdfd4003980 0x7fdfe41e10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:41.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfe940d640 1 -- 172.21.15.28:0/2028834531 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdfd4003980 msgr2=0x7fdfe41e10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:41.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfe940d640 1 --2- 172.21.15.28:0/2028834531 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdfd4003980 0x7fdfe41e10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfe940d640 1 -- 172.21.15.28:0/2028834531 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfe40bc2a0 msgr2=0x7fdfe41402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:41.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfe940d640 1 --2- 172.21.15.28:0/2028834531 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfe40bc2a0 0x7fdfe41402a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfe940d640 1 -- 172.21.15.28:0/2028834531 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe40bb800 con 0x7fdfe409c410 2023-11-16T02:29:41.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfe3fff640 1 --2- 172.21.15.28:0/2028834531 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfe40bc2a0 0x7fdfe41402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:29:41.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfe940d640 1 --2- 172.21.15.28:0/2028834531 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfe409c410 0x7fdfe409c8c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdfe414cfc0 tx=0x7fdfdc00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:41.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfe17fa640 1 -- 172.21.15.28:0/2028834531 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc010040 con 0x7fdfe409c410 2023-11-16T02:29:41.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfe17fa640 1 -- 172.21.15.28:0/2028834531 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfdc00bb10 con 0x7fdfe409c410 2023-11-16T02:29:41.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfe17fa640 1 -- 172.21.15.28:0/2028834531 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc00bea0 con 0x7fdfe409c410 2023-11-16T02:29:41.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfeae70640 1 -- 172.21.15.28:0/2028834531 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe40bbaa0 con 0x7fdfe409c410 2023-11-16T02:29:41.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfeae70640 1 -- 172.21.15.28:0/2028834531 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfe409bfe0 con 0x7fdfe409c410 2023-11-16T02:29:41.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.393+0000 7fdfeae70640 1 -- 172.21.15.28:0/2028834531 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfe404e8a0 con 0x7fdfe409c410 2023-11-16T02:29:41.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.397+0000 7fdfe17fa640 1 -- 172.21.15.28:0/2028834531 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdfdc01d400 con 0x7fdfe409c410 2023-11-16T02:29:41.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.397+0000 7fdfe17fa640 1 --2- 172.21.15.28:0/2028834531 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fdfc8065a60 0x7fdfc8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:41.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.397+0000 7fdfe17fa640 1 -- 172.21.15.28:0/2028834531 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfdc0837c0 con 0x7fdfe409c410 2023-11-16T02:29:41.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.397+0000 7fdfe8c0c640 1 --2- 172.21.15.28:0/2028834531 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fdfc8065a60 0x7fdfc8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:41.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.397+0000 7fdfe8c0c640 1 --2- 172.21.15.28:0/2028834531 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fdfc8065a60 0x7fdfc8067f20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdfd80ae000 tx=0x7fdfd80aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:41.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.401+0000 7fdfe17fa640 1 -- 172.21.15.28:0/2028834531 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fdfdc051210 con 0x7fdfe409c410 2023-11-16T02:29:41.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.549+0000 7fdfeae70640 1 -- 172.21.15.28:0/2028834531 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfe40bbf50 con 0x7fdfe409c410 2023-11-16T02:29:41.555 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.553+0000 7fdfe17fa640 1 -- 172.21.15.28:0/2028834531 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15989 (secure 0 0 0) 0x7fdfdc054830 con 0x7fdfe409c410 2023-11-16T02:29:41.555 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:41.556 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":22,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","created":"2023-11-16T02:29:13.710567+0000","modified":"2023-11-16T02:29:38.871066+0000","last_up_change":"2023-11-16T02:29:24.841087+0000","last_in_change":"2023-11-16T02:29:16.024490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-16T02:29:26.490910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-16T02:29:36.133224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-16T02:29:36.866156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dfa8b58d-3481-4e68-86e8-21873d31d0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":38722},{"type":"v1","addr":"172.21.15.28:6809","nonce":38722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":38722},{"type":"v1","addr":"172.21.15.28:6811","nonce":38722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":38722},{"type":"v1","addr":"172.21.15.28:6815","nonce":38722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":38722},{"type":"v1","addr":"172.21.15.28:6813","nonce":38722}]},"public_addr":"172.21.15.28:6809/38722","cluster_addr":"172.21.15.28:6811/38722","heartbeat_back_addr":"172.21.15.28:6815/38722","heartbeat_front_addr":"172.21.15.28:6813/38722","state":["exists","up"]},{"osd":1,"uuid":"1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":38724},{"type":"v1","addr":"172.21.15.28:6824","nonce":38724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":38724},{"type":"v1","addr":"172.21.15.28:6827","nonce":38724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":38724},{"type":"v1","addr":"172.21.15.28:6831","nonce":38724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":38724},{"type":"v1","addr":"172.21.15.28:6829","nonce":38724}]},"public_addr":"172.21.15.28:6824/38724","cluster_addr":"172.21.15.28:6827/38724","heartbeat_back_addr":"172.21.15.28:6831/38724","heartbeat_front_addr":"172.21.15.28:6829/38724","state":["exists","up"]},{"osd":2,"uuid":"e18f39cd-6a35-4d36-9eed-3877794bf2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":38723},{"type":"v1","addr":"172.21.15.28:6801","nonce":38723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":38723},{"type":"v1","addr":"172.21.15.28:6803","nonce":38723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":38723},{"type":"v1","addr":"172.21.15.28:6807","nonce":38723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":38723},{"type":"v1","addr":"172.21.15.28:6805","nonce":38723}]},"public_addr":"172.21.15.28:6801/38723","cluster_addr":"172.21.15.28:6803/38723","heartbeat_back_addr":"172.21.15.28:6807/38723","heartbeat_front_addr":"172.21.15.28:6805/38723","state":["exists","up"]},{"osd":3,"uuid":"303d0728-409d-47d7-b7a6-6eb273f602fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":38725},{"type":"v1","addr":"172.21.15.28:6817","nonce":38725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":38725},{"type":"v1","addr":"172.21.15.28:6819","nonce":38725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":38725},{"type":"v1","addr":"172.21.15.28:6825","nonce":38725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":38725},{"type":"v1","addr":"172.21.15.28:6821","nonce":38725}]},"public_addr":"172.21.15.28:6817/38725","cluster_addr":"172.21.15.28:6819/38725","heartbeat_back_addr":"172.21.15.28:6825/38725","heartbeat_front_addr":"172.21.15.28:6821/38725","state":["exists","up"]},{"osd":4,"uuid":"df0bf0ac-6efe-4964-ad27-7c1771a70c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":38828},{"type":"v1","addr":"172.21.15.70:6801","nonce":38828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":38828},{"type":"v1","addr":"172.21.15.70:6803","nonce":38828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":38828},{"type":"v1","addr":"172.21.15.70:6807","nonce":38828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":38828},{"type":"v1","addr":"172.21.15.70:6805","nonce":38828}]},"public_addr":"172.21.15.70:6801/38828","cluster_addr":"172.21.15.70:6803/38828","heartbeat_back_addr":"172.21.15.70:6807/38828","heartbeat_front_addr":"172.21.15.70:6805/38828","state":["exists","up"]},{"osd":5,"uuid":"84921219-65cb-4c4e-b9ed-a773db639034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":38830},{"type":"v1","addr":"172.21.15.70:6810","nonce":38830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6813","nonce":38830},{"type":"v1","addr":"172.21.15.70:6814","nonce":38830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":38830},{"type":"v1","addr":"172.21.15.70:6824","nonce":38830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":38830},{"type":"v1","addr":"172.21.15.70:6819","nonce":38830}]},"public_addr":"172.21.15.70:6810/38830","cluster_addr":"172.21.15.70:6814/38830","heartbeat_back_addr":"172.21.15.70:6824/38830","heartbeat_front_addr":"172.21.15.70:6819/38830","state":["exists","up"]},{"osd":6,"uuid":"c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":38829},{"type":"v1","addr":"172.21.15.70:6812","nonce":38829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":38829},{"type":"v1","addr":"172.21.15.70:6820","nonce":38829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":38829},{"type":"v1","addr":"172.21.15.70:6828","nonce":38829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":38829},{"type":"v1","addr":"172.21.15.70:6825","nonce":38829}]},"public_addr":"172.21.15.70:6812/38829","cluster_addr":"172.21.15.70:6820/38829","heartbeat_back_addr":"172.21.15.70:6828/38829","heartbeat_front_addr":"172.21.15.70:6825/38829","state":["exists","up"]},{"osd":7,"uuid":"e2cdd418-12ce-4eea-9b22-efdad83eb76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":38839},{"type":"v1","addr":"172.21.15.70:6815","nonce":38839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":38839},{"type":"v1","addr":"172.21.15.70:6823","nonce":38839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":38839},{"type":"v1","addr":"172.21.15.70:6831","nonce":38839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6827","nonce":38839},{"type":"v1","addr":"172.21.15.70:6829","nonce":38839}]},"public_addr":"172.21.15.70:6815/38839","cluster_addr":"172.21.15.70:6823/38839","heartbeat_back_addr":"172.21.15.70:6831/38839","heartbeat_front_addr":"172.21.15.70:6829/38839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.544240+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.637637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.352115+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.652916+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.624477+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.570247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.706468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.696574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-16T02:29:41.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.553+0000 7fdfeae70640 1 -- 172.21.15.28:0/2028834531 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fdfc8065a60 msgr2=0x7fdfc8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:41.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.553+0000 7fdfeae70640 1 --2- 172.21.15.28:0/2028834531 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fdfc8065a60 0x7fdfc8067f20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdfd80ae000 tx=0x7fdfd80aa070 comp rx=0 tx=0).stop 2023-11-16T02:29:41.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.553+0000 7fdfeae70640 1 -- 172.21.15.28:0/2028834531 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfe409c410 msgr2=0x7fdfe409c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:41.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.553+0000 7fdfeae70640 1 --2- 172.21.15.28:0/2028834531 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfe409c410 0x7fdfe409c8c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdfe414cfc0 tx=0x7fdfdc00b480 comp rx=0 tx=0).stop 2023-11-16T02:29:41.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.553+0000 7fdfeae70640 1 -- 172.21.15.28:0/2028834531 shutdown_connections 2023-11-16T02:29:41.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.553+0000 7fdfeae70640 1 --2- 172.21.15.28:0/2028834531 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fdfc8065a60 0x7fdfc8067f20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.553+0000 7fdfeae70640 1 --2- 172.21.15.28:0/2028834531 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdfe409c410 0x7fdfe409c8c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.553+0000 7fdfeae70640 1 --2- 172.21.15.28:0/2028834531 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdfe40bc2a0 0x7fdfe41402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.553+0000 7fdfeae70640 1 --2- 172.21.15.28:0/2028834531 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdfd4003980 0x7fdfe41e10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.553+0000 7fdfeae70640 1 -- 172.21.15.28:0/2028834531 >> 172.21.15.28:0/2028834531 conn(0x7fdfe406bec0 msgr2=0x7fdfe40b8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:41.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.553+0000 7fdfeae70640 1 -- 172.21.15.28:0/2028834531 shutdown_connections 2023-11-16T02:29:41.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.553+0000 7fdfeae70640 1 -- 172.21.15.28:0/2028834531 wait complete. 2023-11-16T02:29:41.572 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-16T02:29:41.572 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-16T02:29:41.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.689+0000 7fed53962640 1 Processor -- start 2023-11-16T02:29:41.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.689+0000 7fed53962640 1 -- start start 2023-11-16T02:29:41.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.693+0000 7fed53962640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fed4c0bc900 0x7fed4c0b82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:41.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.693+0000 7fed53962640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fed4c148370 0x7fed4c141b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:41.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.693+0000 7fed53962640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed4c0712b0 con 0x7fed4c1416d0 2023-11-16T02:29:41.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.693+0000 7fed53962640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4c071b50 con 0x7fed4c0bc900 2023-11-16T02:29:41.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.693+0000 7fed53962640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c071590 con 0x7fed4c148370 2023-11-16T02:29:41.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.693+0000 7fed516fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fed4c0bc900 0x7fed4c0b82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:41.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.693+0000 7fed516fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fed4c0bc900 0x7fed4c0b82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40812/0 (socket says 172.21.15.28:40812) 2023-11-16T02:29:41.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.693+0000 7fed516fe640 1 -- 172.21.15.28:0/3927622090 learned_addr learned my addr 172.21.15.28:0/3927622090 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:41.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.693+0000 7fed51eff640 1 --2- 172.21.15.28:0/3927622090 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fed4c148370 0x7fed4c141b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:41.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.693+0000 7fed516fe640 1 -- 172.21.15.28:0/3927622090 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fed4c148370 msgr2=0x7fed4c141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:41.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.693+0000 7fed516fe640 1 --2- 172.21.15.28:0/3927622090 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fed4c148370 0x7fed4c141b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.693+0000 7fed516fe640 1 -- 172.21.15.28:0/3927622090 >> v1:172.21.15.70:6789/0 conn(0x7fed4c1416d0 legacy=0x7fed4c147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:41.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.693+0000 7fed516fe640 1 -- 172.21.15.28:0/3927622090 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c071870 con 0x7fed4c0bc900 2023-11-16T02:29:41.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed516fe640 1 --2- 172.21.15.28:0/3927622090 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed4c0bc900 0x7fed4c0b82c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fed3c009e50 tx=0x7fed3c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6318946db9109e0b server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:41.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed4bfff640 1 -- 172.21.15.28:0/3927622090 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c0a5760 con 0x7fed4c0bc900 2023-11-16T02:29:41.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed4bfff640 1 -- 172.21.15.28:0/3927622090 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3c0a58c0 con 0x7fed4c0bc900 2023-11-16T02:29:41.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed4bfff640 1 -- 172.21.15.28:0/3927622090 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c0a5c50 con 0x7fed4c0bc900 2023-11-16T02:29:41.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed53962640 1 -- 172.21.15.28:0/3927622090 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed4c0bc900 msgr2=0x7fed4c0b82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:41.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed53962640 1 --2- 172.21.15.28:0/3927622090 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed4c0bc900 0x7fed4c0b82c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fed3c009e50 tx=0x7fed3c01c9d0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed53962640 1 -- 172.21.15.28:0/3927622090 shutdown_connections 2023-11-16T02:29:41.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed53962640 1 --2- 172.21.15.28:0/3927622090 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fed4c148370 0x7fed4c141b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed53962640 1 --2- 172.21.15.28:0/3927622090 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed4c0bc900 0x7fed4c0b82c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed53962640 1 -- 172.21.15.28:0/3927622090 >> 172.21.15.28:0/3927622090 conn(0x7fed4c0b9050 msgr2=0x7fed4c0bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:41.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed53962640 1 -- 172.21.15.28:0/3927622090 shutdown_connections 2023-11-16T02:29:41.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed53962640 1 -- 172.21.15.28:0/3927622090 wait complete. 2023-11-16T02:29:41.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed53962640 1 Processor -- start 2023-11-16T02:29:41.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed53962640 1 -- start start 2023-11-16T02:29:41.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed53962640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed4c0bc900 0x7fed4c0bb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:41.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed53962640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed4c1416d0 0x7fed4c1e65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:41.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed53962640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fed4c148370 0x7fed4c1e6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:41.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed53962640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0bb9b0 con 0x7fed4c1416d0 2023-11-16T02:29:41.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed53962640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c1e6150 con 0x7fed4c0bc900 2023-11-16T02:29:41.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed53962640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c144010 con 0x7fed4c148370 2023-11-16T02:29:41.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed50efd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed4c1416d0 0x7fed4c1e65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:41.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed50efd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed4c1416d0 0x7fed4c1e65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40824/0 (socket says 172.21.15.28:40824) 2023-11-16T02:29:41.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed50efd640 1 -- 172.21.15.28:0/626435672 learned_addr learned my addr 172.21.15.28:0/626435672 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:41.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed516fe640 1 --2- 172.21.15.28:0/626435672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed4c0bc900 0x7fed4c0bb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:41.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed50efd640 1 -- 172.21.15.28:0/626435672 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fed4c148370 msgr2=0x7fed4c1e6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:41.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed51eff640 1 --2- 172.21.15.28:0/626435672 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fed4c148370 0x7fed4c1e6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:41.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed50efd640 1 --2- 172.21.15.28:0/626435672 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fed4c148370 0x7fed4c1e6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed50efd640 1 -- 172.21.15.28:0/626435672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed4c0bc900 msgr2=0x7fed4c0bb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:41.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed50efd640 1 --2- 172.21.15.28:0/626435672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed4c0bc900 0x7fed4c0bb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed50efd640 1 -- 172.21.15.28:0/626435672 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3c009b30 con 0x7fed4c1416d0 2023-11-16T02:29:41.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed516fe640 1 --2- 172.21.15.28:0/626435672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed4c0bc900 0x7fed4c0bb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:41.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed50efd640 1 --2- 172.21.15.28:0/626435672 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed4c1416d0 0x7fed4c1e65e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fed4000c450 tx=0x7fed4000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:41.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed49ffb640 1 -- 172.21.15.28:0/626435672 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed40012830 con 0x7fed4c1416d0 2023-11-16T02:29:41.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed49ffb640 1 -- 172.21.15.28:0/626435672 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed400129b0 con 0x7fed4c1416d0 2023-11-16T02:29:41.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed53962640 1 -- 172.21.15.28:0/626435672 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4c1427e0 con 0x7fed4c1416d0 2023-11-16T02:29:41.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed49ffb640 1 -- 172.21.15.28:0/626435672 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed40012d60 con 0x7fed4c1416d0 2023-11-16T02:29:41.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.697+0000 7fed53962640 1 -- 172.21.15.28:0/626435672 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4c142da0 con 0x7fed4c1416d0 2023-11-16T02:29:41.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.701+0000 7fed53962640 1 -- 172.21.15.28:0/626435672 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed4c142fc0 con 0x7fed4c1416d0 2023-11-16T02:29:41.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.701+0000 7fed49ffb640 1 -- 172.21.15.28:0/626435672 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fed4001c460 con 0x7fed4c1416d0 2023-11-16T02:29:41.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.701+0000 7fed49ffb640 1 --2- 172.21.15.28:0/626435672 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fed38065a60 0x7fed38067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:41.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.701+0000 7fed49ffb640 1 -- 172.21.15.28:0/626435672 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed40082f50 con 0x7fed4c1416d0 2023-11-16T02:29:41.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.701+0000 7fed516fe640 1 --2- 172.21.15.28:0/626435672 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fed38065a60 0x7fed38067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:41.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.701+0000 7fed516fe640 1 --2- 172.21.15.28:0/626435672 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fed38065a60 0x7fed38067f20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0ae000 tx=0x7fed3c0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:41.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.705+0000 7fed49ffb640 1 -- 172.21.15.28:0/626435672 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fed400509a0 con 0x7fed4c1416d0 2023-11-16T02:29:41.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.853+0000 7fed53962640 1 -- 172.21.15.28:0/626435672 --> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed4c1549b0 con 0x7fed38065a60 2023-11-16T02:29:41.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.869+0000 7fed49ffb640 1 -- 172.21.15.28:0/626435672 <== mgr.4104 v2:172.21.15.28:6832/38651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250849 (secure 0 0 0) 0x7fed3c009290 con 0x7fed38065a60 2023-11-16T02:29:41.874 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:41.877 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-11-16T02:29:41.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.873+0000 7fed53962640 1 -- 172.21.15.28:0/626435672 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fed38065a60 msgr2=0x7fed38067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:41.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.873+0000 7fed53962640 1 --2- 172.21.15.28:0/626435672 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fed38065a60 0x7fed38067f20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fed3c0ae000 tx=0x7fed3c0a7070 comp rx=0 tx=0).stop 2023-11-16T02:29:41.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.873+0000 7fed53962640 1 -- 172.21.15.28:0/626435672 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed4c1416d0 msgr2=0x7fed4c1e65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:41.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.873+0000 7fed53962640 1 --2- 172.21.15.28:0/626435672 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed4c1416d0 0x7fed4c1e65e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fed4000c450 tx=0x7fed4000c910 comp rx=0 tx=0).stop 2023-11-16T02:29:41.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.873+0000 7fed53962640 1 -- 172.21.15.28:0/626435672 shutdown_connections 2023-11-16T02:29:41.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.873+0000 7fed53962640 1 --2- 172.21.15.28:0/626435672 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fed38065a60 0x7fed38067f20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.873+0000 7fed53962640 1 --2- 172.21.15.28:0/626435672 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fed4c148370 0x7fed4c1e6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.873+0000 7fed53962640 1 --2- 172.21.15.28:0/626435672 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed4c1416d0 0x7fed4c1e65e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.873+0000 7fed53962640 1 --2- 172.21.15.28:0/626435672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed4c0bc900 0x7fed4c0bb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:41.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.873+0000 7fed53962640 1 -- 172.21.15.28:0/626435672 >> 172.21.15.28:0/626435672 conn(0x7fed4c0b9050 msgr2=0x7fed4c0b6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:41.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.873+0000 7fed53962640 1 -- 172.21.15.28:0/626435672 shutdown_connections 2023-11-16T02:29:41.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:41.873+0000 7fed53962640 1 -- 172.21.15.28:0/626435672 wait complete. 2023-11-16T02:29:41.894 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-11-16T02:29:40.416612+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":14,"acting":14,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":250936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754723784,"statfs":{"total":773094113280,"available":772837154816,"internally_reserved":0,"allocated":2613248,"data_stored":1614487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001269"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930738+0000","last_change":"2023-11-16T02:29:37.890129+0000","last_active":"2023-11-16T02:29:38.930738+0000","last_peered":"2023-11-16T02:29:38.930738+0000","last_clean":"2023-11-16T02:29:38.930738+0000","last_became_active":"2023-11-16T02:29:37.889784+0000","last_became_peered":"2023-11-16T02:29:37.889784+0000","last_unstale":"2023-11-16T02:29:38.930738+0000","last_undegraded":"2023-11-16T02:29:38.930738+0000","last_fullsized":"2023-11-16T02:29:38.930738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:57:07.831898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930582+0000","last_change":"2023-11-16T02:29:37.912688+0000","last_active":"2023-11-16T02:29:38.930582+0000","last_peered":"2023-11-16T02:29:38.930582+0000","last_clean":"2023-11-16T02:29:38.930582+0000","last_became_active":"2023-11-16T02:29:37.912482+0000","last_became_peered":"2023-11-16T02:29:37.912482+0000","last_unstale":"2023-11-16T02:29:38.930582+0000","last_undegraded":"2023-11-16T02:29:38.930582+0000","last_fullsized":"2023-11-16T02:29:38.930582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:36:55.256000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930434+0000","last_change":"2023-11-16T02:29:37.507129+0000","last_active":"2023-11-16T02:29:38.930434+0000","last_peered":"2023-11-16T02:29:38.930434+0000","last_clean":"2023-11-16T02:29:38.930434+0000","last_became_active":"2023-11-16T02:29:37.506617+0000","last_became_peered":"2023-11-16T02:29:37.506617+0000","last_unstale":"2023-11-16T02:29:38.930434+0000","last_undegraded":"2023-11-16T02:29:38.930434+0000","last_fullsized":"2023-11-16T02:29:38.930434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T09:52:00.933962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930772+0000","last_change":"2023-11-16T02:29:37.513345+0000","last_active":"2023-11-16T02:29:38.930772+0000","last_peered":"2023-11-16T02:29:38.930772+0000","last_clean":"2023-11-16T02:29:38.930772+0000","last_became_active":"2023-11-16T02:29:37.512642+0000","last_became_peered":"2023-11-16T02:29:37.512642+0000","last_unstale":"2023-11-16T02:29:38.930772+0000","last_undegraded":"2023-11-16T02:29:38.930772+0000","last_fullsized":"2023-11-16T02:29:38.930772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:03:19.516009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930777+0000","last_change":"2023-11-16T02:29:37.544475+0000","last_active":"2023-11-16T02:29:38.930777+0000","last_peered":"2023-11-16T02:29:38.930777+0000","last_clean":"2023-11-16T02:29:38.930777+0000","last_became_active":"2023-11-16T02:29:37.544180+0000","last_became_peered":"2023-11-16T02:29:37.544180+0000","last_unstale":"2023-11-16T02:29:38.930777+0000","last_undegraded":"2023-11-16T02:29:38.930777+0000","last_fullsized":"2023-11-16T02:29:38.930777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:24:09.474240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":160,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-16T02:29:29.234191+0000","last_change":"2023-11-16T02:29:27.538359+0000","last_active":"2023-11-16T02:29:29.234191+0000","last_peered":"2023-11-16T02:29:29.234191+0000","last_clean":"2023-11-16T02:29:29.234191+0000","last_became_active":"2023-11-16T02:29:27.536606+0000","last_became_peered":"2023-11-16T02:29:27.536606+0000","last_unstale":"2023-11-16T02:29:29.234191+0000","last_undegraded":"2023-11-16T02:29:29.234191+0000","last_fullsized":"2023-11-16T02:29:29.234191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:26.491990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:26.491990+0000","last_clean_scrub_stamp":"2023-11-16T02:29:26.491990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:29:40.434297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930813+0000","last_change":"2023-11-16T02:29:37.508498+0000","last_active":"2023-11-16T02:29:38.930813+0000","last_peered":"2023-11-16T02:29:38.930813+0000","last_clean":"2023-11-16T02:29:38.930813+0000","last_became_active":"2023-11-16T02:29:37.508091+0000","last_became_peered":"2023-11-16T02:29:37.508091+0000","last_unstale":"2023-11-16T02:29:38.930813+0000","last_undegraded":"2023-11-16T02:29:38.930813+0000","last_fullsized":"2023-11-16T02:29:38.930813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:31:57.230585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":8,"acting":8,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":765952,"data_stored":641441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]}]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31216,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340624,"statfs":{"total":96636764160,"available":96604798976,"internally_reserved":0,"allocated":172032,"data_stored":51073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.034}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31216,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340624,"statfs":{"total":96636764160,"available":96604798976,"internally_reserved":0,"allocated":172032,"data_stored":51073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31216,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340624,"statfs":{"total":96636764160,"available":96604798976,"internally_reserved":0,"allocated":172032,"data_stored":51073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.284}]}]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31216,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340624,"statfs":{"total":96636764160,"available":96604798976,"internally_reserved":0,"allocated":172032,"data_stored":51073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]}]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31216,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340624,"statfs":{"total":96636764160,"available":96604798976,"internally_reserved":0,"allocated":172032,"data_stored":51073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":765952,"data_stored":641441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3160000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31264,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340576,"statfs":{"total":96636764160,"available":96604749824,"internally_reserved":0,"allocated":221184,"data_stored":76240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-16T02:29:41.899 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-16T02:29:42.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.041+0000 7f557d01c640 1 Processor -- start 2023-11-16T02:29:42.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.041+0000 7f557d01c640 1 -- start start 2023-11-16T02:29:42.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.045+0000 7f557d01c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f55780ba070 0x7f55780b5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:42.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.045+0000 7f557d01c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f55780bb770 0x7f5578142aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:42.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.045+0000 7f557d01c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5578142fe0 0x7f55780b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:42.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.045+0000 7f557d01c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55780b6530 con 0x7f5578142fe0 2023-11-16T02:29:42.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.045+0000 7f557d01c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55780b6b60 con 0x7f55780ba070 2023-11-16T02:29:42.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.045+0000 7f557d01c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55780bb190 con 0x7f55780bb770 2023-11-16T02:29:42.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.045+0000 7f557759e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5578142fe0 0x7f55780b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:42.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.045+0000 7f557759e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5578142fe0 0x7f55780b78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40830/0 (socket says 172.21.15.28:40830) 2023-11-16T02:29:42.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.045+0000 7f557759e640 1 -- 172.21.15.28:0/1661248893 learned_addr learned my addr 172.21.15.28:0/1661248893 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:42.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.045+0000 7f557659c640 1 --2- 172.21.15.28:0/1661248893 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f55780bb770 0x7f5578142aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:42.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.045+0000 7f5576d9d640 1 --2- 172.21.15.28:0/1661248893 >> v2:172.21.15.70:3300/0 conn(0x7f55780ba070 0x7f55780b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:42.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.045+0000 7f557759e640 1 -- 172.21.15.28:0/1661248893 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f55780bb770 msgr2=0x7f5578142aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:42.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.045+0000 7f557759e640 1 --2- 172.21.15.28:0/1661248893 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f55780bb770 0x7f5578142aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.045+0000 7f557759e640 1 -- 172.21.15.28:0/1661248893 >> v2:172.21.15.70:3300/0 conn(0x7f55780ba070 msgr2=0x7f55780b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:42.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.045+0000 7f557759e640 1 --2- 172.21.15.28:0/1661248893 >> v2:172.21.15.70:3300/0 conn(0x7f55780ba070 0x7f55780b5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.045+0000 7f557759e640 1 -- 172.21.15.28:0/1661248893 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55780bb410 con 0x7f5578142fe0 2023-11-16T02:29:42.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.045+0000 7f557759e640 1 --2- 172.21.15.28:0/1661248893 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5578142fe0 0x7f55780b78f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f55780b5430 tx=0x7f557001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a358c5a7a4d08da9 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:42.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f5575d9b640 1 -- 172.21.15.28:0/1661248893 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700a5790 con 0x7f5578142fe0 2023-11-16T02:29:42.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f5575d9b640 1 -- 172.21.15.28:0/1661248893 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55700a58f0 con 0x7f5578142fe0 2023-11-16T02:29:42.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f5575d9b640 1 -- 172.21.15.28:0/1661248893 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700a5c80 con 0x7f5578142fe0 2023-11-16T02:29:42.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f557d01c640 1 -- 172.21.15.28:0/1661248893 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5578142fe0 msgr2=0x7f55780b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:42.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f557d01c640 1 --2- 172.21.15.28:0/1661248893 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5578142fe0 0x7f55780b78f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f55780b5430 tx=0x7f557001c910 comp rx=0 tx=0).stop 2023-11-16T02:29:42.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f557d01c640 1 -- 172.21.15.28:0/1661248893 shutdown_connections 2023-11-16T02:29:42.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f557d01c640 1 --2- 172.21.15.28:0/1661248893 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5578142fe0 0x7f55780b78f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f557d01c640 1 --2- 172.21.15.28:0/1661248893 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f55780bb770 0x7f5578142aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f557d01c640 1 --2- 172.21.15.28:0/1661248893 >> v2:172.21.15.70:3300/0 conn(0x7f55780ba070 0x7f55780b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f557d01c640 1 -- 172.21.15.28:0/1661248893 >> 172.21.15.28:0/1661248893 conn(0x7f5578070f70 msgr2=0x7f5578071350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:42.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f557d01c640 1 -- 172.21.15.28:0/1661248893 shutdown_connections 2023-11-16T02:29:42.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f557d01c640 1 -- 172.21.15.28:0/1661248893 wait complete. 2023-11-16T02:29:42.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f557d01c640 1 Processor -- start 2023-11-16T02:29:42.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f557d01c640 1 -- start start 2023-11-16T02:29:42.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f557d01c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55780ba070 0x7f55780bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:42.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f557d01c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55780bb770 0x7f55781e6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:42.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f557d01c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5578142fe0 0x7f55781e67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:42.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f557d01c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55781e5e40 con 0x7f55780ba070 2023-11-16T02:29:42.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f557d01c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55780be4a0 con 0x7f55780bb770 2023-11-16T02:29:42.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f557d01c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5578149d80 con 0x7f5578142fe0 2023-11-16T02:29:42.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f5576d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55780ba070 0x7f55780bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:42.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f5576d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55780ba070 0x7f55780bdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40842/0 (socket says 172.21.15.28:40842) 2023-11-16T02:29:42.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f5576d9d640 1 -- 172.21.15.28:0/1567123484 learned_addr learned my addr 172.21.15.28:0/1567123484 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:42.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f557659c640 1 --2- 172.21.15.28:0/1567123484 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55780bb770 0x7f55781e6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:42.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f557759e640 1 --2- 172.21.15.28:0/1567123484 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5578142fe0 0x7f55781e67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:42.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f5576d9d640 1 -- 172.21.15.28:0/1567123484 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5578142fe0 msgr2=0x7f55781e67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:42.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f5576d9d640 1 --2- 172.21.15.28:0/1567123484 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5578142fe0 0x7f55781e67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f5576d9d640 1 -- 172.21.15.28:0/1567123484 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55780bb770 msgr2=0x7f55781e6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:42.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f5576d9d640 1 --2- 172.21.15.28:0/1567123484 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55780bb770 0x7f55781e6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f5576d9d640 1 -- 172.21.15.28:0/1567123484 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5570009b30 con 0x7f55780ba070 2023-11-16T02:29:42.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f557659c640 1 --2- 172.21.15.28:0/1567123484 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55780bb770 0x7f55781e6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:29:42.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f5576d9d640 1 --2- 172.21.15.28:0/1567123484 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55780ba070 0x7f55780bdf60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f556800d800 tx=0x7f556800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:42.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f555f7fe640 1 -- 172.21.15.28:0/1567123484 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55680096a0 con 0x7f55780ba070 2023-11-16T02:29:42.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f555f7fe640 1 -- 172.21.15.28:0/1567123484 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5568009800 con 0x7f55780ba070 2023-11-16T02:29:42.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f557d01c640 1 -- 172.21.15.28:0/1567123484 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f557806af90 con 0x7f55780ba070 2023-11-16T02:29:42.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f555f7fe640 1 -- 172.21.15.28:0/1567123484 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5568009bb0 con 0x7f55780ba070 2023-11-16T02:29:42.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.049+0000 7f557d01c640 1 -- 172.21.15.28:0/1567123484 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f557806b550 con 0x7f55780ba070 2023-11-16T02:29:42.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.053+0000 7f557d01c640 1 -- 172.21.15.28:0/1567123484 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55781e60b0 con 0x7f55780ba070 2023-11-16T02:29:42.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.053+0000 7f555f7fe640 1 -- 172.21.15.28:0/1567123484 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5568009d10 con 0x7f55780ba070 2023-11-16T02:29:42.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.053+0000 7f555f7fe640 1 --2- 172.21.15.28:0/1567123484 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5564065a60 0x7f5564067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:42.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.053+0000 7f555f7fe640 1 -- 172.21.15.28:0/1567123484 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5568083640 con 0x7f55780ba070 2023-11-16T02:29:42.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.053+0000 7f557659c640 1 --2- 172.21.15.28:0/1567123484 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5564065a60 0x7f5564067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:42.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.053+0000 7f557659c640 1 --2- 172.21.15.28:0/1567123484 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5564065a60 0x7f5564067f20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5578152930 tx=0x7f556c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:42.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.057+0000 7f555f7fe640 1 -- 172.21.15.28:0/1567123484 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f5568050ff0 con 0x7f55780ba070 2023-11-16T02:29:42.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.201+0000 7f557d01c640 1 -- 172.21.15.28:0/1567123484 --> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f55780b8240 con 0x7f5564065a60 2023-11-16T02:29:42.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.213+0000 7f555f7fe640 1 -- 172.21.15.28:0/1567123484 <== mgr.4104 v2:172.21.15.28:6832/38651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250849 (secure 0 0 0) 0x7f556c007710 con 0x7f5564065a60 2023-11-16T02:29:42.220 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:42.221 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-11-16T02:29:42.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.217+0000 7f557d01c640 1 -- 172.21.15.28:0/1567123484 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5564065a60 msgr2=0x7f5564067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:42.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.217+0000 7f557d01c640 1 --2- 172.21.15.28:0/1567123484 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5564065a60 0x7f5564067f20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5578152930 tx=0x7f556c008040 comp rx=0 tx=0).stop 2023-11-16T02:29:42.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.217+0000 7f557d01c640 1 -- 172.21.15.28:0/1567123484 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55780ba070 msgr2=0x7f55780bdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:42.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.217+0000 7f557d01c640 1 --2- 172.21.15.28:0/1567123484 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55780ba070 0x7f55780bdf60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f556800d800 tx=0x7f556800dcc0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.217+0000 7f557d01c640 1 -- 172.21.15.28:0/1567123484 shutdown_connections 2023-11-16T02:29:42.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.217+0000 7f557d01c640 1 --2- 172.21.15.28:0/1567123484 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5564065a60 0x7f5564067f20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.217+0000 7f557d01c640 1 --2- 172.21.15.28:0/1567123484 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5578142fe0 0x7f55781e67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.217+0000 7f557d01c640 1 --2- 172.21.15.28:0/1567123484 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55780bb770 0x7f55781e6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.217+0000 7f557d01c640 1 --2- 172.21.15.28:0/1567123484 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f55780ba070 0x7f55780bdf60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.217+0000 7f557d01c640 1 -- 172.21.15.28:0/1567123484 >> 172.21.15.28:0/1567123484 conn(0x7f5578070f70 msgr2=0x7f557813cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:42.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.217+0000 7f557d01c640 1 -- 172.21.15.28:0/1567123484 shutdown_connections 2023-11-16T02:29:42.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.217+0000 7f557d01c640 1 -- 172.21.15.28:0/1567123484 wait complete. 2023-11-16T02:29:42.235 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-11-16T02:29:40.416612+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":14,"acting":14,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":250936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754723784,"statfs":{"total":773094113280,"available":772837154816,"internally_reserved":0,"allocated":2613248,"data_stored":1614487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001269"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930738+0000","last_change":"2023-11-16T02:29:37.890129+0000","last_active":"2023-11-16T02:29:38.930738+0000","last_peered":"2023-11-16T02:29:38.930738+0000","last_clean":"2023-11-16T02:29:38.930738+0000","last_became_active":"2023-11-16T02:29:37.889784+0000","last_became_peered":"2023-11-16T02:29:37.889784+0000","last_unstale":"2023-11-16T02:29:38.930738+0000","last_undegraded":"2023-11-16T02:29:38.930738+0000","last_fullsized":"2023-11-16T02:29:38.930738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:57:07.831898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930582+0000","last_change":"2023-11-16T02:29:37.912688+0000","last_active":"2023-11-16T02:29:38.930582+0000","last_peered":"2023-11-16T02:29:38.930582+0000","last_clean":"2023-11-16T02:29:38.930582+0000","last_became_active":"2023-11-16T02:29:37.912482+0000","last_became_peered":"2023-11-16T02:29:37.912482+0000","last_unstale":"2023-11-16T02:29:38.930582+0000","last_undegraded":"2023-11-16T02:29:38.930582+0000","last_fullsized":"2023-11-16T02:29:38.930582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:36:55.256000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930434+0000","last_change":"2023-11-16T02:29:37.507129+0000","last_active":"2023-11-16T02:29:38.930434+0000","last_peered":"2023-11-16T02:29:38.930434+0000","last_clean":"2023-11-16T02:29:38.930434+0000","last_became_active":"2023-11-16T02:29:37.506617+0000","last_became_peered":"2023-11-16T02:29:37.506617+0000","last_unstale":"2023-11-16T02:29:38.930434+0000","last_undegraded":"2023-11-16T02:29:38.930434+0000","last_fullsized":"2023-11-16T02:29:38.930434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T09:52:00.933962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930772+0000","last_change":"2023-11-16T02:29:37.513345+0000","last_active":"2023-11-16T02:29:38.930772+0000","last_peered":"2023-11-16T02:29:38.930772+0000","last_clean":"2023-11-16T02:29:38.930772+0000","last_became_active":"2023-11-16T02:29:37.512642+0000","last_became_peered":"2023-11-16T02:29:37.512642+0000","last_unstale":"2023-11-16T02:29:38.930772+0000","last_undegraded":"2023-11-16T02:29:38.930772+0000","last_fullsized":"2023-11-16T02:29:38.930772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:03:19.516009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930777+0000","last_change":"2023-11-16T02:29:37.544475+0000","last_active":"2023-11-16T02:29:38.930777+0000","last_peered":"2023-11-16T02:29:38.930777+0000","last_clean":"2023-11-16T02:29:38.930777+0000","last_became_active":"2023-11-16T02:29:37.544180+0000","last_became_peered":"2023-11-16T02:29:37.544180+0000","last_unstale":"2023-11-16T02:29:38.930777+0000","last_undegraded":"2023-11-16T02:29:38.930777+0000","last_fullsized":"2023-11-16T02:29:38.930777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:24:09.474240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":160,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-16T02:29:29.234191+0000","last_change":"2023-11-16T02:29:27.538359+0000","last_active":"2023-11-16T02:29:29.234191+0000","last_peered":"2023-11-16T02:29:29.234191+0000","last_clean":"2023-11-16T02:29:29.234191+0000","last_became_active":"2023-11-16T02:29:27.536606+0000","last_became_peered":"2023-11-16T02:29:27.536606+0000","last_unstale":"2023-11-16T02:29:29.234191+0000","last_undegraded":"2023-11-16T02:29:29.234191+0000","last_fullsized":"2023-11-16T02:29:29.234191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:26.491990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:26.491990+0000","last_clean_scrub_stamp":"2023-11-16T02:29:26.491990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:29:40.434297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930813+0000","last_change":"2023-11-16T02:29:37.508498+0000","last_active":"2023-11-16T02:29:38.930813+0000","last_peered":"2023-11-16T02:29:38.930813+0000","last_clean":"2023-11-16T02:29:38.930813+0000","last_became_active":"2023-11-16T02:29:37.508091+0000","last_became_peered":"2023-11-16T02:29:37.508091+0000","last_unstale":"2023-11-16T02:29:38.930813+0000","last_undegraded":"2023-11-16T02:29:38.930813+0000","last_fullsized":"2023-11-16T02:29:38.930813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:31:57.230585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:37.482318+0000","last_change":"2023-11-16T02:29:37.482318+0000","last_active":"2023-11-16T02:29:37.482318+0000","last_peered":"2023-11-16T02:29:37.482318+0000","last_clean":"2023-11-16T02:29:37.482318+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:37.482318+0000","last_undegraded":"2023-11-16T02:29:37.482318+0000","last_fullsized":"2023-11-16T02:29:37.482318+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:29:36.471974+0000","last_change":"2023-11-16T02:29:36.471974+0000","last_active":"2023-11-16T02:29:36.471974+0000","last_peered":"2023-11-16T02:29:36.471974+0000","last_clean":"2023-11-16T02:29:36.471974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:29:36.471974+0000","last_undegraded":"2023-11-16T02:29:36.471974+0000","last_fullsized":"2023-11-16T02:29:36.471974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":4,"acting":4,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":8,"acting":8,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":765952,"data_stored":641441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]}]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31216,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340624,"statfs":{"total":96636764160,"available":96604798976,"internally_reserved":0,"allocated":172032,"data_stored":51073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.034}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31216,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340624,"statfs":{"total":96636764160,"available":96604798976,"internally_reserved":0,"allocated":172032,"data_stored":51073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31216,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340624,"statfs":{"total":96636764160,"available":96604798976,"internally_reserved":0,"allocated":172032,"data_stored":51073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.284}]}]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31216,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340624,"statfs":{"total":96636764160,"available":96604798976,"internally_reserved":0,"allocated":172032,"data_stored":51073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]}]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31216,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340624,"statfs":{"total":96636764160,"available":96604798976,"internally_reserved":0,"allocated":172032,"data_stored":51073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":765952,"data_stored":641441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3160000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31264,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340576,"statfs":{"total":96636764160,"available":96604749824,"internally_reserved":0,"allocated":221184,"data_stored":76240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-16T02:29:42.239 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-16T02:29:42.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.393+0000 7f3ce5e3c640 1 Processor -- start 2023-11-16T02:29:42.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.393+0000 7f3ce5e3c640 1 -- start start 2023-11-16T02:29:42.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.397+0000 7f3ce5e3c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3ce00b8ab0 0x7f3ce014b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:42.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.397+0000 7f3ce5e3c640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce006c260 con 0x7f3ce00b86d0 2023-11-16T02:29:42.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.397+0000 7f3ce5e3c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce00ba470 con 0x7f3ce014b540 2023-11-16T02:29:42.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.397+0000 7f3ce5e3c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce00b8f10 con 0x7f3ce00b8ab0 2023-11-16T02:29:42.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.397+0000 7f3cdeffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3ce00b8ab0 0x7f3ce014b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:42.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.397+0000 7f3cdf7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f3ce00b86d0 0x7f3ce01446a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:39700/0 (socket says 172.21.15.28:39700) 2023-11-16T02:29:42.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.397+0000 7f3cdf7fe640 1 -- 172.21.15.28:0/2608919415 learned_addr learned my addr 172.21.15.28:0/2608919415 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:42.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.397+0000 7f3cdeffd640 1 -- 172.21.15.28:0/2608919415 >> v1:172.21.15.70:6789/0 conn(0x7f3ce014b540 legacy=0x7f3ce01553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:42.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.397+0000 7f3cdeffd640 1 -- 172.21.15.28:0/2608919415 >> v1:172.21.15.28:6789/0 conn(0x7f3ce00b86d0 legacy=0x7f3ce01446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:42.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.397+0000 7f3cde7fc640 1 -- 172.21.15.28:0/2608919415 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686672044 0 0) 0x7f3ce006c260 con 0x7f3ce00b86d0 2023-11-16T02:29:42.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.397+0000 7f3cdeffd640 1 -- 172.21.15.28:0/2608919415 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce00ba6e0 con 0x7f3ce00b8ab0 2023-11-16T02:29:42.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.397+0000 7f3cdeffd640 1 --2- 172.21.15.28:0/2608919415 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ce00b8ab0 0x7f3ce014b000 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3cd40097c0 tx=0x7f3cd401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50d6711719dccf2a server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:42.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.397+0000 7f3cde7fc640 1 -- 172.21.15.28:0/2608919415 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd40ab650 con 0x7f3ce00b8ab0 2023-11-16T02:29:42.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.397+0000 7f3cde7fc640 1 -- 172.21.15.28:0/2608919415 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd40ab7b0 con 0x7f3ce00b8ab0 2023-11-16T02:29:42.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3cde7fc640 1 -- 172.21.15.28:0/2608919415 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd40abb40 con 0x7f3ce00b8ab0 2023-11-16T02:29:42.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3ce5e3c640 1 -- 172.21.15.28:0/2608919415 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ce00b8ab0 msgr2=0x7f3ce014b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:42.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3ce5e3c640 1 --2- 172.21.15.28:0/2608919415 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ce00b8ab0 0x7f3ce014b000 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3cd40097c0 tx=0x7f3cd401c450 comp rx=0 tx=0).stop 2023-11-16T02:29:42.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3ce5e3c640 1 -- 172.21.15.28:0/2608919415 shutdown_connections 2023-11-16T02:29:42.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3ce5e3c640 1 --2- 172.21.15.28:0/2608919415 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ce00b8ab0 0x7f3ce014b000 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3ce5e3c640 1 -- 172.21.15.28:0/2608919415 >> 172.21.15.28:0/2608919415 conn(0x7f3ce006b770 msgr2=0x7f3ce006bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:42.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3ce5e3c640 1 -- 172.21.15.28:0/2608919415 shutdown_connections 2023-11-16T02:29:42.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3ce5e3c640 1 -- 172.21.15.28:0/2608919415 wait complete. 2023-11-16T02:29:42.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3ce5e3c640 1 Processor -- start 2023-11-16T02:29:42.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3ce5e3c640 1 -- start start 2023-11-16T02:29:42.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3ce5e3c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ce00b86d0 0x7f3ce014db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:42.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3ce5e3c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3ce00b8ab0 0x7f3ce01404a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:42.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3ce5e3c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ce014b540 0x7f3ce01409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:42.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3ce5e3c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce0139fc0 con 0x7f3ce014b540 2023-11-16T02:29:42.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3ce5e3c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce01418f0 con 0x7f3ce00b86d0 2023-11-16T02:29:42.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3ce5e3c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce013a1f0 con 0x7f3ce00b8ab0 2023-11-16T02:29:42.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3cdffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ce014b540 0x7f3ce01409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:42.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3cdffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ce014b540 0x7f3ce01409e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40860/0 (socket says 172.21.15.28:40860) 2023-11-16T02:29:42.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3cdffff640 1 -- 172.21.15.28:0/1327833540 learned_addr learned my addr 172.21.15.28:0/1327833540 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:42.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3cdf7fe640 1 --2- 172.21.15.28:0/1327833540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ce00b86d0 0x7f3ce014db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:42.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3cdeffd640 1 --2- 172.21.15.28:0/1327833540 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3ce00b8ab0 0x7f3ce01404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:42.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3cdffff640 1 -- 172.21.15.28:0/1327833540 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3ce00b8ab0 msgr2=0x7f3ce01404a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:42.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3cdffff640 1 --2- 172.21.15.28:0/1327833540 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3ce00b8ab0 0x7f3ce01404a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3cdffff640 1 -- 172.21.15.28:0/1327833540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ce00b86d0 msgr2=0x7f3ce014db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:42.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3cdffff640 1 --2- 172.21.15.28:0/1327833540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ce00b86d0 0x7f3ce014db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3cdffff640 1 -- 172.21.15.28:0/1327833540 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd4009420 con 0x7f3ce014b540 2023-11-16T02:29:42.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3cdeffd640 1 --2- 172.21.15.28:0/1327833540 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3ce00b8ab0 0x7f3ce01404a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:42.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3cdffff640 1 --2- 172.21.15.28:0/1327833540 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ce014b540 0x7f3ce01409e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3cd800c730 tx=0x7f3cd800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:42.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3cc7fff640 1 -- 172.21.15.28:0/1327833540 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8003b80 con 0x7f3ce014b540 2023-11-16T02:29:42.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3cc7fff640 1 -- 172.21.15.28:0/1327833540 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd8003ce0 con 0x7f3ce014b540 2023-11-16T02:29:42.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3cc7fff640 1 -- 172.21.15.28:0/1327833540 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd800aa30 con 0x7f3ce014b540 2023-11-16T02:29:42.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.401+0000 7f3ce5e3c640 1 -- 172.21.15.28:0/1327833540 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce014bd60 con 0x7f3ce014b540 2023-11-16T02:29:42.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.405+0000 7f3ce5e3c640 1 -- 172.21.15.28:0/1327833540 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce013ff80 con 0x7f3ce014b540 2023-11-16T02:29:42.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.405+0000 7f3ce5e3c640 1 -- 172.21.15.28:0/1327833540 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce004e8a0 con 0x7f3ce014b540 2023-11-16T02:29:42.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.405+0000 7f3cc7fff640 1 -- 172.21.15.28:0/1327833540 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3cd800ab90 con 0x7f3ce014b540 2023-11-16T02:29:42.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.405+0000 7f3cc7fff640 1 --2- 172.21.15.28:0/1327833540 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3ccc065a60 0x7f3ccc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:42.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.405+0000 7f3cc7fff640 1 -- 172.21.15.28:0/1327833540 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3cd8082ea0 con 0x7f3ce014b540 2023-11-16T02:29:42.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.405+0000 7f3cdf7fe640 1 --2- 172.21.15.28:0/1327833540 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3ccc065a60 0x7f3ccc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:42.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.405+0000 7f3cdf7fe640 1 --2- 172.21.15.28:0/1327833540 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3ccc065a60 0x7f3ccc067f20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0007fd0 tx=0x7f3cd0007ba0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:42.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.409+0000 7f3cc7fff640 1 -- 172.21.15.28:0/1327833540 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f3cd80508f0 con 0x7f3ce014b540 2023-11-16T02:29:42.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.557+0000 7f3ce5e3c640 1 -- 172.21.15.28:0/1327833540 --> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ce00bcaf0 con 0x7f3ccc065a60 2023-11-16T02:29:42.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.573+0000 7f3cc7fff640 1 -- 172.21.15.28:0/1327833540 <== mgr.4104 v2:172.21.15.28:6832/38651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264579 (secure 0 0 0) 0x7f3cd0007170 con 0x7f3ccc065a60 2023-11-16T02:29:42.580 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:42.582 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-11-16T02:29:42.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.577+0000 7f3ce5e3c640 1 -- 172.21.15.28:0/1327833540 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3ccc065a60 msgr2=0x7f3ccc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:42.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.577+0000 7f3ce5e3c640 1 --2- 172.21.15.28:0/1327833540 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3ccc065a60 0x7f3ccc067f20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0007fd0 tx=0x7f3cd0007ba0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.577+0000 7f3ce5e3c640 1 -- 172.21.15.28:0/1327833540 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ce014b540 msgr2=0x7f3ce01409e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:42.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.577+0000 7f3ce5e3c640 1 --2- 172.21.15.28:0/1327833540 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ce014b540 0x7f3ce01409e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3cd800c730 tx=0x7f3cd800cbf0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.577+0000 7f3ce5e3c640 1 -- 172.21.15.28:0/1327833540 shutdown_connections 2023-11-16T02:29:42.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.577+0000 7f3ce5e3c640 1 --2- 172.21.15.28:0/1327833540 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3ccc065a60 0x7f3ccc067f20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.577+0000 7f3ce5e3c640 1 --2- 172.21.15.28:0/1327833540 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ce014b540 0x7f3ce01409e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.577+0000 7f3ce5e3c640 1 --2- 172.21.15.28:0/1327833540 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3ce00b8ab0 0x7f3ce01404a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.577+0000 7f3ce5e3c640 1 --2- 172.21.15.28:0/1327833540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ce00b86d0 0x7f3ce014db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.577+0000 7f3ce5e3c640 1 -- 172.21.15.28:0/1327833540 >> 172.21.15.28:0/1327833540 conn(0x7f3ce006b770 msgr2=0x7f3ce0138160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:42.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.577+0000 7f3ce5e3c640 1 -- 172.21.15.28:0/1327833540 shutdown_connections 2023-11-16T02:29:42.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.577+0000 7f3ce5e3c640 1 -- 172.21.15.28:0/1327833540 wait complete. 2023-11-16T02:29:42.597 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-16T02:29:42.417175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":145,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":251288,"kb_used_data":2904,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754723432,"statfs":{"total":773094113280,"available":772836794368,"internally_reserved":0,"allocated":2973696,"data_stored":1770180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":57,"apply_latency_ms":57,"commit_latency_ns":57000000,"apply_latency_ns":57000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.933472"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893446+0000","last_change":"2023-11-16T02:29:37.934110+0000","last_active":"2023-11-16T02:29:39.893446+0000","last_peered":"2023-11-16T02:29:39.893446+0000","last_clean":"2023-11-16T02:29:39.893446+0000","last_became_active":"2023-11-16T02:29:37.933578+0000","last_became_peered":"2023-11-16T02:29:37.933578+0000","last_unstale":"2023-11-16T02:29:39.893446+0000","last_undegraded":"2023-11-16T02:29:39.893446+0000","last_fullsized":"2023-11-16T02:29:39.893446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:40:54.967365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879002+0000","last_change":"2023-11-16T02:29:37.889075+0000","last_active":"2023-11-16T02:29:38.879002+0000","last_peered":"2023-11-16T02:29:38.879002+0000","last_clean":"2023-11-16T02:29:38.879002+0000","last_became_active":"2023-11-16T02:29:37.888736+0000","last_became_peered":"2023-11-16T02:29:37.888736+0000","last_unstale":"2023-11-16T02:29:38.879002+0000","last_undegraded":"2023-11-16T02:29:38.879002+0000","last_fullsized":"2023-11-16T02:29:38.879002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:25:48.005968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892513+0000","last_change":"2023-11-16T02:29:37.888531+0000","last_active":"2023-11-16T02:29:39.892513+0000","last_peered":"2023-11-16T02:29:39.892513+0000","last_clean":"2023-11-16T02:29:39.892513+0000","last_became_active":"2023-11-16T02:29:37.888011+0000","last_became_peered":"2023-11-16T02:29:37.888011+0000","last_unstale":"2023-11-16T02:29:39.892513+0000","last_undegraded":"2023-11-16T02:29:39.892513+0000","last_fullsized":"2023-11-16T02:29:39.892513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:27:01.501132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879881+0000","last_change":"2023-11-16T02:29:37.933231+0000","last_active":"2023-11-16T02:29:38.879881+0000","last_peered":"2023-11-16T02:29:38.879881+0000","last_clean":"2023-11-16T02:29:38.879881+0000","last_became_active":"2023-11-16T02:29:37.932560+0000","last_became_peered":"2023-11-16T02:29:37.932560+0000","last_unstale":"2023-11-16T02:29:38.879881+0000","last_undegraded":"2023-11-16T02:29:38.879881+0000","last_fullsized":"2023-11-16T02:29:38.879881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:40:54.967365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893326+0000","last_change":"2023-11-16T02:29:37.924836+0000","last_active":"2023-11-16T02:29:39.893326+0000","last_peered":"2023-11-16T02:29:39.893326+0000","last_clean":"2023-11-16T02:29:39.893326+0000","last_became_active":"2023-11-16T02:29:37.923955+0000","last_became_peered":"2023-11-16T02:29:37.923955+0000","last_unstale":"2023-11-16T02:29:39.893326+0000","last_undegraded":"2023-11-16T02:29:39.893326+0000","last_fullsized":"2023-11-16T02:29:39.893326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:16:52.591980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879892+0000","last_change":"2023-11-16T02:29:37.927564+0000","last_active":"2023-11-16T02:29:38.879892+0000","last_peered":"2023-11-16T02:29:38.879892+0000","last_clean":"2023-11-16T02:29:38.879892+0000","last_became_active":"2023-11-16T02:29:37.925508+0000","last_became_peered":"2023-11-16T02:29:37.925508+0000","last_unstale":"2023-11-16T02:29:38.879892+0000","last_undegraded":"2023-11-16T02:29:38.879892+0000","last_fullsized":"2023-11-16T02:29:38.879892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:53:52.129290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892495+0000","last_change":"2023-11-16T02:29:37.908302+0000","last_active":"2023-11-16T02:29:39.892495+0000","last_peered":"2023-11-16T02:29:39.892495+0000","last_clean":"2023-11-16T02:29:39.892495+0000","last_became_active":"2023-11-16T02:29:37.907469+0000","last_became_peered":"2023-11-16T02:29:37.907469+0000","last_unstale":"2023-11-16T02:29:39.892495+0000","last_undegraded":"2023-11-16T02:29:39.892495+0000","last_fullsized":"2023-11-16T02:29:39.892495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:30:42.074843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891934+0000","last_change":"2023-11-16T02:29:37.936720+0000","last_active":"2023-11-16T02:29:39.891934+0000","last_peered":"2023-11-16T02:29:39.891934+0000","last_clean":"2023-11-16T02:29:39.891934+0000","last_became_active":"2023-11-16T02:29:37.936424+0000","last_became_peered":"2023-11-16T02:29:37.936424+0000","last_unstale":"2023-11-16T02:29:39.891934+0000","last_undegraded":"2023-11-16T02:29:39.891934+0000","last_fullsized":"2023-11-16T02:29:39.891934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:53:52.129290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893619+0000","last_change":"2023-11-16T02:29:37.941366+0000","last_active":"2023-11-16T02:29:39.893619+0000","last_peered":"2023-11-16T02:29:39.893619+0000","last_clean":"2023-11-16T02:29:39.893619+0000","last_became_active":"2023-11-16T02:29:37.940672+0000","last_became_peered":"2023-11-16T02:29:37.940672+0000","last_unstale":"2023-11-16T02:29:39.893619+0000","last_undegraded":"2023-11-16T02:29:39.893619+0000","last_fullsized":"2023-11-16T02:29:39.893619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:45:26.924071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881259+0000","last_change":"2023-11-16T02:29:37.925689+0000","last_active":"2023-11-16T02:29:38.881259+0000","last_peered":"2023-11-16T02:29:38.881259+0000","last_clean":"2023-11-16T02:29:38.881259+0000","last_became_active":"2023-11-16T02:29:37.925132+0000","last_became_peered":"2023-11-16T02:29:37.925132+0000","last_unstale":"2023-11-16T02:29:38.881259+0000","last_undegraded":"2023-11-16T02:29:38.881259+0000","last_fullsized":"2023-11-16T02:29:38.881259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:16:58.785873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880724+0000","last_change":"2023-11-16T02:29:37.927099+0000","last_active":"2023-11-16T02:29:38.880724+0000","last_peered":"2023-11-16T02:29:38.880724+0000","last_clean":"2023-11-16T02:29:38.880724+0000","last_became_active":"2023-11-16T02:29:37.926533+0000","last_became_peered":"2023-11-16T02:29:37.926533+0000","last_unstale":"2023-11-16T02:29:38.880724+0000","last_undegraded":"2023-11-16T02:29:38.880724+0000","last_fullsized":"2023-11-16T02:29:38.880724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:43:20.665096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893022+0000","last_change":"2023-11-16T02:29:37.902388+0000","last_active":"2023-11-16T02:29:39.893022+0000","last_peered":"2023-11-16T02:29:39.893022+0000","last_clean":"2023-11-16T02:29:39.893022+0000","last_became_active":"2023-11-16T02:29:37.901626+0000","last_became_peered":"2023-11-16T02:29:37.901626+0000","last_unstale":"2023-11-16T02:29:39.893022+0000","last_undegraded":"2023-11-16T02:29:39.893022+0000","last_fullsized":"2023-11-16T02:29:39.893022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:09:39.001233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891187+0000","last_change":"2023-11-16T02:29:37.907449+0000","last_active":"2023-11-16T02:29:39.891187+0000","last_peered":"2023-11-16T02:29:39.891187+0000","last_clean":"2023-11-16T02:29:39.891187+0000","last_became_active":"2023-11-16T02:29:37.907166+0000","last_became_peered":"2023-11-16T02:29:37.907166+0000","last_unstale":"2023-11-16T02:29:39.891187+0000","last_undegraded":"2023-11-16T02:29:39.891187+0000","last_fullsized":"2023-11-16T02:29:39.891187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:37:34.233429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891915+0000","last_change":"2023-11-16T02:29:37.892022+0000","last_active":"2023-11-16T02:29:39.891915+0000","last_peered":"2023-11-16T02:29:39.891915+0000","last_clean":"2023-11-16T02:29:39.891915+0000","last_became_active":"2023-11-16T02:29:37.891566+0000","last_became_peered":"2023-11-16T02:29:37.891566+0000","last_unstale":"2023-11-16T02:29:39.891915+0000","last_undegraded":"2023-11-16T02:29:39.891915+0000","last_fullsized":"2023-11-16T02:29:39.891915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:06:12.705211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878687+0000","last_change":"2023-11-16T02:29:37.924750+0000","last_active":"2023-11-16T02:29:38.878687+0000","last_peered":"2023-11-16T02:29:38.878687+0000","last_clean":"2023-11-16T02:29:38.878687+0000","last_became_active":"2023-11-16T02:29:37.924471+0000","last_became_peered":"2023-11-16T02:29:37.924471+0000","last_unstale":"2023-11-16T02:29:38.878687+0000","last_undegraded":"2023-11-16T02:29:38.878687+0000","last_fullsized":"2023-11-16T02:29:38.878687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:43:20.665096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879402+0000","last_change":"2023-11-16T02:29:37.912953+0000","last_active":"2023-11-16T02:29:38.879402+0000","last_peered":"2023-11-16T02:29:38.879402+0000","last_clean":"2023-11-16T02:29:38.879402+0000","last_became_active":"2023-11-16T02:29:37.912132+0000","last_became_peered":"2023-11-16T02:29:37.912132+0000","last_unstale":"2023-11-16T02:29:38.879402+0000","last_undegraded":"2023-11-16T02:29:38.879402+0000","last_fullsized":"2023-11-16T02:29:38.879402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:52:41.161159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.882380+0000","last_change":"2023-11-16T02:29:37.933833+0000","last_active":"2023-11-16T02:29:38.882380+0000","last_peered":"2023-11-16T02:29:38.882380+0000","last_clean":"2023-11-16T02:29:38.882380+0000","last_became_active":"2023-11-16T02:29:37.933117+0000","last_became_peered":"2023-11-16T02:29:37.933117+0000","last_unstale":"2023-11-16T02:29:38.882380+0000","last_undegraded":"2023-11-16T02:29:38.882380+0000","last_fullsized":"2023-11-16T02:29:38.882380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:16:52.591980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930738+0000","last_change":"2023-11-16T02:29:37.890129+0000","last_active":"2023-11-16T02:29:38.930738+0000","last_peered":"2023-11-16T02:29:38.930738+0000","last_clean":"2023-11-16T02:29:38.930738+0000","last_became_active":"2023-11-16T02:29:37.889784+0000","last_became_peered":"2023-11-16T02:29:37.889784+0000","last_unstale":"2023-11-16T02:29:38.930738+0000","last_undegraded":"2023-11-16T02:29:38.930738+0000","last_fullsized":"2023-11-16T02:29:38.930738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:57:07.831898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893749+0000","last_change":"2023-11-16T02:29:37.916610+0000","last_active":"2023-11-16T02:29:39.893749+0000","last_peered":"2023-11-16T02:29:39.893749+0000","last_clean":"2023-11-16T02:29:39.893749+0000","last_became_active":"2023-11-16T02:29:37.915744+0000","last_became_peered":"2023-11-16T02:29:37.915744+0000","last_unstale":"2023-11-16T02:29:39.893749+0000","last_undegraded":"2023-11-16T02:29:39.893749+0000","last_fullsized":"2023-11-16T02:29:39.893749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:39:21.513129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880946+0000","last_change":"2023-11-16T02:29:37.928237+0000","last_active":"2023-11-16T02:29:38.880946+0000","last_peered":"2023-11-16T02:29:38.880946+0000","last_clean":"2023-11-16T02:29:38.880946+0000","last_became_active":"2023-11-16T02:29:37.927434+0000","last_became_peered":"2023-11-16T02:29:37.927434+0000","last_unstale":"2023-11-16T02:29:38.880946+0000","last_undegraded":"2023-11-16T02:29:38.880946+0000","last_fullsized":"2023-11-16T02:29:38.880946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:37:34.233429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891411+0000","last_change":"2023-11-16T02:29:37.919211+0000","last_active":"2023-11-16T02:29:39.891411+0000","last_peered":"2023-11-16T02:29:39.891411+0000","last_clean":"2023-11-16T02:29:39.891411+0000","last_became_active":"2023-11-16T02:29:37.918942+0000","last_became_peered":"2023-11-16T02:29:37.918942+0000","last_unstale":"2023-11-16T02:29:39.891411+0000","last_undegraded":"2023-11-16T02:29:39.891411+0000","last_fullsized":"2023-11-16T02:29:39.891411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:02:14.259774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879910+0000","last_change":"2023-11-16T02:29:37.926517+0000","last_active":"2023-11-16T02:29:38.879910+0000","last_peered":"2023-11-16T02:29:38.879910+0000","last_clean":"2023-11-16T02:29:38.879910+0000","last_became_active":"2023-11-16T02:29:37.924700+0000","last_became_peered":"2023-11-16T02:29:37.924700+0000","last_unstale":"2023-11-16T02:29:38.879910+0000","last_undegraded":"2023-11-16T02:29:38.879910+0000","last_fullsized":"2023-11-16T02:29:38.879910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:39:21.513129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891489+0000","last_change":"2023-11-16T02:29:37.936251+0000","last_active":"2023-11-16T02:29:39.891489+0000","last_peered":"2023-11-16T02:29:39.891489+0000","last_clean":"2023-11-16T02:29:39.891489+0000","last_became_active":"2023-11-16T02:29:37.935980+0000","last_became_peered":"2023-11-16T02:29:37.935980+0000","last_unstale":"2023-11-16T02:29:39.891489+0000","last_undegraded":"2023-11-16T02:29:39.891489+0000","last_fullsized":"2023-11-16T02:29:39.891489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:02:14.259774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879581+0000","last_change":"2023-11-16T02:29:37.929521+0000","last_active":"2023-11-16T02:29:38.879581+0000","last_peered":"2023-11-16T02:29:38.879581+0000","last_clean":"2023-11-16T02:29:38.879581+0000","last_became_active":"2023-11-16T02:29:37.924137+0000","last_became_peered":"2023-11-16T02:29:37.924137+0000","last_unstale":"2023-11-16T02:29:38.879581+0000","last_undegraded":"2023-11-16T02:29:38.879581+0000","last_fullsized":"2023-11-16T02:29:38.879581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:05:26.649663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892396+0000","last_change":"2023-11-16T02:29:37.935340+0000","last_active":"2023-11-16T02:29:39.892396+0000","last_peered":"2023-11-16T02:29:39.892396+0000","last_clean":"2023-11-16T02:29:39.892396+0000","last_became_active":"2023-11-16T02:29:37.934955+0000","last_became_peered":"2023-11-16T02:29:37.934955+0000","last_unstale":"2023-11-16T02:29:39.892396+0000","last_undegraded":"2023-11-16T02:29:39.892396+0000","last_fullsized":"2023-11-16T02:29:39.892396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:10:43.990221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881491+0000","last_change":"2023-11-16T02:29:37.929426+0000","last_active":"2023-11-16T02:29:38.881491+0000","last_peered":"2023-11-16T02:29:38.881491+0000","last_clean":"2023-11-16T02:29:38.881491+0000","last_became_active":"2023-11-16T02:29:37.928780+0000","last_became_peered":"2023-11-16T02:29:37.928780+0000","last_unstale":"2023-11-16T02:29:38.881491+0000","last_undegraded":"2023-11-16T02:29:38.881491+0000","last_fullsized":"2023-11-16T02:29:38.881491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:05:26.649663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878825+0000","last_change":"2023-11-16T02:29:37.893720+0000","last_active":"2023-11-16T02:29:38.878825+0000","last_peered":"2023-11-16T02:29:38.878825+0000","last_clean":"2023-11-16T02:29:38.878825+0000","last_became_active":"2023-11-16T02:29:37.893429+0000","last_became_peered":"2023-11-16T02:29:37.893429+0000","last_unstale":"2023-11-16T02:29:38.878825+0000","last_undegraded":"2023-11-16T02:29:38.878825+0000","last_fullsized":"2023-11-16T02:29:38.878825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T02:48:20.525493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892100+0000","last_change":"2023-11-16T02:29:37.935318+0000","last_active":"2023-11-16T02:29:39.892100+0000","last_peered":"2023-11-16T02:29:39.892100+0000","last_clean":"2023-11-16T02:29:39.892100+0000","last_became_active":"2023-11-16T02:29:37.934951+0000","last_became_peered":"2023-11-16T02:29:37.934951+0000","last_unstale":"2023-11-16T02:29:39.892100+0000","last_undegraded":"2023-11-16T02:29:39.892100+0000","last_fullsized":"2023-11-16T02:29:39.892100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:16:58.785873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891486+0000","last_change":"2023-11-16T02:29:37.894800+0000","last_active":"2023-11-16T02:29:39.891486+0000","last_peered":"2023-11-16T02:29:39.891486+0000","last_clean":"2023-11-16T02:29:39.891486+0000","last_became_active":"2023-11-16T02:29:37.894404+0000","last_became_peered":"2023-11-16T02:29:37.894404+0000","last_unstale":"2023-11-16T02:29:39.891486+0000","last_undegraded":"2023-11-16T02:29:39.891486+0000","last_fullsized":"2023-11-16T02:29:39.891486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:37:34.233429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880139+0000","last_change":"2023-11-16T02:29:37.920827+0000","last_active":"2023-11-16T02:29:38.880139+0000","last_peered":"2023-11-16T02:29:38.880139+0000","last_clean":"2023-11-16T02:29:38.880139+0000","last_became_active":"2023-11-16T02:29:37.911702+0000","last_became_peered":"2023-11-16T02:29:37.911702+0000","last_unstale":"2023-11-16T02:29:38.880139+0000","last_undegraded":"2023-11-16T02:29:38.880139+0000","last_fullsized":"2023-11-16T02:29:38.880139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:46:36.525784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930582+0000","last_change":"2023-11-16T02:29:37.912688+0000","last_active":"2023-11-16T02:29:38.930582+0000","last_peered":"2023-11-16T02:29:38.930582+0000","last_clean":"2023-11-16T02:29:38.930582+0000","last_became_active":"2023-11-16T02:29:37.912482+0000","last_became_peered":"2023-11-16T02:29:37.912482+0000","last_unstale":"2023-11-16T02:29:38.930582+0000","last_undegraded":"2023-11-16T02:29:38.930582+0000","last_fullsized":"2023-11-16T02:29:38.930582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:36:55.256000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880120+0000","last_change":"2023-11-16T02:29:37.897293+0000","last_active":"2023-11-16T02:29:38.880120+0000","last_peered":"2023-11-16T02:29:38.880120+0000","last_clean":"2023-11-16T02:29:38.880120+0000","last_became_active":"2023-11-16T02:29:37.895087+0000","last_became_peered":"2023-11-16T02:29:37.895087+0000","last_unstale":"2023-11-16T02:29:38.880120+0000","last_undegraded":"2023-11-16T02:29:38.880120+0000","last_fullsized":"2023-11-16T02:29:38.880120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T02:48:20.525493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892526+0000","last_change":"2023-11-16T02:29:37.886782+0000","last_active":"2023-11-16T02:29:39.892526+0000","last_peered":"2023-11-16T02:29:39.892526+0000","last_clean":"2023-11-16T02:29:39.892526+0000","last_became_active":"2023-11-16T02:29:37.885874+0000","last_became_peered":"2023-11-16T02:29:37.885874+0000","last_unstale":"2023-11-16T02:29:39.892526+0000","last_undegraded":"2023-11-16T02:29:39.892526+0000","last_fullsized":"2023-11-16T02:29:39.892526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:21:32.772781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891317+0000","last_change":"2023-11-16T02:29:37.538231+0000","last_active":"2023-11-16T02:29:39.891317+0000","last_peered":"2023-11-16T02:29:39.891317+0000","last_clean":"2023-11-16T02:29:39.891317+0000","last_became_active":"2023-11-16T02:29:37.537831+0000","last_became_peered":"2023-11-16T02:29:37.537831+0000","last_unstale":"2023-11-16T02:29:39.891317+0000","last_undegraded":"2023-11-16T02:29:39.891317+0000","last_fullsized":"2023-11-16T02:29:39.891317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:07:57.498670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891555+0000","last_change":"2023-11-16T02:29:37.928329+0000","last_active":"2023-11-16T02:29:39.891555+0000","last_peered":"2023-11-16T02:29:39.891555+0000","last_clean":"2023-11-16T02:29:39.891555+0000","last_became_active":"2023-11-16T02:29:37.927587+0000","last_became_peered":"2023-11-16T02:29:37.927587+0000","last_unstale":"2023-11-16T02:29:39.891555+0000","last_undegraded":"2023-11-16T02:29:39.891555+0000","last_fullsized":"2023-11-16T02:29:39.891555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:25:48.005968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880624+0000","last_change":"2023-11-16T02:29:37.540421+0000","last_active":"2023-11-16T02:29:38.880624+0000","last_peered":"2023-11-16T02:29:38.880624+0000","last_clean":"2023-11-16T02:29:38.880624+0000","last_became_active":"2023-11-16T02:29:37.539777+0000","last_became_peered":"2023-11-16T02:29:37.539777+0000","last_unstale":"2023-11-16T02:29:38.880624+0000","last_undegraded":"2023-11-16T02:29:38.880624+0000","last_fullsized":"2023-11-16T02:29:38.880624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:07:57.498670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891713+0000","last_change":"2023-11-16T02:29:37.524313+0000","last_active":"2023-11-16T02:29:39.891713+0000","last_peered":"2023-11-16T02:29:39.891713+0000","last_clean":"2023-11-16T02:29:39.891713+0000","last_became_active":"2023-11-16T02:29:37.523846+0000","last_became_peered":"2023-11-16T02:29:37.523846+0000","last_unstale":"2023-11-16T02:29:39.891713+0000","last_undegraded":"2023-11-16T02:29:39.891713+0000","last_fullsized":"2023-11-16T02:29:39.891713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:10:34.206728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892088+0000","last_change":"2023-11-16T02:29:37.885752+0000","last_active":"2023-11-16T02:29:39.892088+0000","last_peered":"2023-11-16T02:29:39.892088+0000","last_clean":"2023-11-16T02:29:39.892088+0000","last_became_active":"2023-11-16T02:29:37.885481+0000","last_became_peered":"2023-11-16T02:29:37.885481+0000","last_unstale":"2023-11-16T02:29:39.892088+0000","last_undegraded":"2023-11-16T02:29:39.892088+0000","last_fullsized":"2023-11-16T02:29:39.892088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:05:12.707357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879852+0000","last_change":"2023-11-16T02:29:37.528549+0000","last_active":"2023-11-16T02:29:38.879852+0000","last_peered":"2023-11-16T02:29:38.879852+0000","last_clean":"2023-11-16T02:29:38.879852+0000","last_became_active":"2023-11-16T02:29:37.527762+0000","last_became_peered":"2023-11-16T02:29:37.527762+0000","last_unstale":"2023-11-16T02:29:38.879852+0000","last_undegraded":"2023-11-16T02:29:38.879852+0000","last_fullsized":"2023-11-16T02:29:38.879852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:45:11.372719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878450+0000","last_change":"2023-11-16T02:29:37.892686+0000","last_active":"2023-11-16T02:29:38.878450+0000","last_peered":"2023-11-16T02:29:38.878450+0000","last_clean":"2023-11-16T02:29:38.878450+0000","last_became_active":"2023-11-16T02:29:37.892384+0000","last_became_peered":"2023-11-16T02:29:37.892384+0000","last_unstale":"2023-11-16T02:29:38.878450+0000","last_undegraded":"2023-11-16T02:29:38.878450+0000","last_fullsized":"2023-11-16T02:29:38.878450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:37:34.233429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880554+0000","last_change":"2023-11-16T02:29:37.545696+0000","last_active":"2023-11-16T02:29:38.880554+0000","last_peered":"2023-11-16T02:29:38.880554+0000","last_clean":"2023-11-16T02:29:38.880554+0000","last_became_active":"2023-11-16T02:29:37.545073+0000","last_became_peered":"2023-11-16T02:29:37.545073+0000","last_unstale":"2023-11-16T02:29:38.880554+0000","last_undegraded":"2023-11-16T02:29:38.880554+0000","last_fullsized":"2023-11-16T02:29:38.880554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:04:23.421210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881635+0000","last_change":"2023-11-16T02:29:37.929853+0000","last_active":"2023-11-16T02:29:38.881635+0000","last_peered":"2023-11-16T02:29:38.881635+0000","last_clean":"2023-11-16T02:29:38.881635+0000","last_became_active":"2023-11-16T02:29:37.929199+0000","last_became_peered":"2023-11-16T02:29:37.929199+0000","last_unstale":"2023-11-16T02:29:38.881635+0000","last_undegraded":"2023-11-16T02:29:38.881635+0000","last_fullsized":"2023-11-16T02:29:38.881635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:30:42.074843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881944+0000","last_change":"2023-11-16T02:29:37.537469+0000","last_active":"2023-11-16T02:29:38.881944+0000","last_peered":"2023-11-16T02:29:38.881944+0000","last_clean":"2023-11-16T02:29:38.881944+0000","last_became_active":"2023-11-16T02:29:37.536939+0000","last_became_peered":"2023-11-16T02:29:37.536939+0000","last_unstale":"2023-11-16T02:29:38.881944+0000","last_undegraded":"2023-11-16T02:29:38.881944+0000","last_fullsized":"2023-11-16T02:29:38.881944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:42:27.512040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891189+0000","last_change":"2023-11-16T02:29:37.928255+0000","last_active":"2023-11-16T02:29:39.891189+0000","last_peered":"2023-11-16T02:29:39.891189+0000","last_clean":"2023-11-16T02:29:39.891189+0000","last_became_active":"2023-11-16T02:29:37.927823+0000","last_became_peered":"2023-11-16T02:29:37.927823+0000","last_unstale":"2023-11-16T02:29:39.891189+0000","last_undegraded":"2023-11-16T02:29:39.891189+0000","last_fullsized":"2023-11-16T02:29:39.891189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:16:58.785873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878823+0000","last_change":"2023-11-16T02:29:37.538934+0000","last_active":"2023-11-16T02:29:38.878823+0000","last_peered":"2023-11-16T02:29:38.878823+0000","last_clean":"2023-11-16T02:29:38.878823+0000","last_became_active":"2023-11-16T02:29:37.538493+0000","last_became_peered":"2023-11-16T02:29:37.538493+0000","last_unstale":"2023-11-16T02:29:38.878823+0000","last_undegraded":"2023-11-16T02:29:38.878823+0000","last_fullsized":"2023-11-16T02:29:38.878823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:38:57.277934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893023+0000","last_change":"2023-11-16T02:29:37.919752+0000","last_active":"2023-11-16T02:29:39.893023+0000","last_peered":"2023-11-16T02:29:39.893023+0000","last_clean":"2023-11-16T02:29:39.893023+0000","last_became_active":"2023-11-16T02:29:37.919021+0000","last_became_peered":"2023-11-16T02:29:37.919021+0000","last_unstale":"2023-11-16T02:29:39.893023+0000","last_undegraded":"2023-11-16T02:29:39.893023+0000","last_fullsized":"2023-11-16T02:29:39.893023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:38:58.288279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881202+0000","last_change":"2023-11-16T02:29:37.512625+0000","last_active":"2023-11-16T02:29:38.881202+0000","last_peered":"2023-11-16T02:29:38.881202+0000","last_clean":"2023-11-16T02:29:38.881202+0000","last_became_active":"2023-11-16T02:29:37.511862+0000","last_became_peered":"2023-11-16T02:29:37.511862+0000","last_unstale":"2023-11-16T02:29:38.881202+0000","last_undegraded":"2023-11-16T02:29:38.881202+0000","last_fullsized":"2023-11-16T02:29:38.881202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:45:11.372719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893382+0000","last_change":"2023-11-16T02:29:37.907846+0000","last_active":"2023-11-16T02:29:39.893382+0000","last_peered":"2023-11-16T02:29:39.893382+0000","last_clean":"2023-11-16T02:29:39.893382+0000","last_became_active":"2023-11-16T02:29:37.906680+0000","last_became_peered":"2023-11-16T02:29:37.906680+0000","last_unstale":"2023-11-16T02:29:39.893382+0000","last_undegraded":"2023-11-16T02:29:39.893382+0000","last_fullsized":"2023-11-16T02:29:39.893382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:46:36.525784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891620+0000","last_change":"2023-11-16T02:29:37.516156+0000","last_active":"2023-11-16T02:29:39.891620+0000","last_peered":"2023-11-16T02:29:39.891620+0000","last_clean":"2023-11-16T02:29:39.891620+0000","last_became_active":"2023-11-16T02:29:37.508947+0000","last_became_peered":"2023-11-16T02:29:37.508947+0000","last_unstale":"2023-11-16T02:29:39.891620+0000","last_undegraded":"2023-11-16T02:29:39.891620+0000","last_fullsized":"2023-11-16T02:29:39.891620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:28:03.017758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892055+0000","last_change":"2023-11-16T02:29:37.917898+0000","last_active":"2023-11-16T02:29:39.892055+0000","last_peered":"2023-11-16T02:29:39.892055+0000","last_clean":"2023-11-16T02:29:39.892055+0000","last_became_active":"2023-11-16T02:29:37.917588+0000","last_became_peered":"2023-11-16T02:29:37.917588+0000","last_unstale":"2023-11-16T02:29:39.892055+0000","last_undegraded":"2023-11-16T02:29:39.892055+0000","last_fullsized":"2023-11-16T02:29:39.892055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:43:20.665096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880128+0000","last_change":"2023-11-16T02:29:37.535755+0000","last_active":"2023-11-16T02:29:38.880128+0000","last_peered":"2023-11-16T02:29:38.880128+0000","last_clean":"2023-11-16T02:29:38.880128+0000","last_became_active":"2023-11-16T02:29:37.535030+0000","last_became_peered":"2023-11-16T02:29:37.535030+0000","last_unstale":"2023-11-16T02:29:38.880128+0000","last_undegraded":"2023-11-16T02:29:38.880128+0000","last_fullsized":"2023-11-16T02:29:38.880128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:10:34.206728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893470+0000","last_change":"2023-11-16T02:29:37.943232+0000","last_active":"2023-11-16T02:29:39.893470+0000","last_peered":"2023-11-16T02:29:39.893470+0000","last_clean":"2023-11-16T02:29:39.893470+0000","last_became_active":"2023-11-16T02:29:37.942561+0000","last_became_peered":"2023-11-16T02:29:37.942561+0000","last_unstale":"2023-11-16T02:29:39.893470+0000","last_undegraded":"2023-11-16T02:29:39.893470+0000","last_fullsized":"2023-11-16T02:29:39.893470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:06:38.108558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880346+0000","last_change":"2023-11-16T02:29:37.540351+0000","last_active":"2023-11-16T02:29:38.880346+0000","last_peered":"2023-11-16T02:29:38.880346+0000","last_clean":"2023-11-16T02:29:38.880346+0000","last_became_active":"2023-11-16T02:29:37.539672+0000","last_became_peered":"2023-11-16T02:29:37.539672+0000","last_unstale":"2023-11-16T02:29:38.880346+0000","last_undegraded":"2023-11-16T02:29:38.880346+0000","last_fullsized":"2023-11-16T02:29:38.880346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:57:02.655084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880380+0000","last_change":"2023-11-16T02:29:37.898389+0000","last_active":"2023-11-16T02:29:38.880380+0000","last_peered":"2023-11-16T02:29:38.880380+0000","last_clean":"2023-11-16T02:29:38.880380+0000","last_became_active":"2023-11-16T02:29:37.896101+0000","last_became_peered":"2023-11-16T02:29:37.896101+0000","last_unstale":"2023-11-16T02:29:38.880380+0000","last_undegraded":"2023-11-16T02:29:38.880380+0000","last_fullsized":"2023-11-16T02:29:38.880380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:27:01.501132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930434+0000","last_change":"2023-11-16T02:29:37.507129+0000","last_active":"2023-11-16T02:29:38.930434+0000","last_peered":"2023-11-16T02:29:38.930434+0000","last_clean":"2023-11-16T02:29:38.930434+0000","last_became_active":"2023-11-16T02:29:37.506617+0000","last_became_peered":"2023-11-16T02:29:37.506617+0000","last_unstale":"2023-11-16T02:29:38.930434+0000","last_undegraded":"2023-11-16T02:29:38.930434+0000","last_fullsized":"2023-11-16T02:29:38.930434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T09:52:00.933962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892753+0000","last_change":"2023-11-16T02:29:37.936934+0000","last_active":"2023-11-16T02:29:39.892753+0000","last_peered":"2023-11-16T02:29:39.892753+0000","last_clean":"2023-11-16T02:29:39.892753+0000","last_became_active":"2023-11-16T02:29:37.936330+0000","last_became_peered":"2023-11-16T02:29:37.936330+0000","last_unstale":"2023-11-16T02:29:39.892753+0000","last_undegraded":"2023-11-16T02:29:39.892753+0000","last_fullsized":"2023-11-16T02:29:39.892753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:10:43.990221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893035+0000","last_change":"2023-11-16T02:29:37.522370+0000","last_active":"2023-11-16T02:29:39.893035+0000","last_peered":"2023-11-16T02:29:39.893035+0000","last_clean":"2023-11-16T02:29:39.893035+0000","last_became_active":"2023-11-16T02:29:37.521575+0000","last_became_peered":"2023-11-16T02:29:37.521575+0000","last_unstale":"2023-11-16T02:29:39.893035+0000","last_undegraded":"2023-11-16T02:29:39.893035+0000","last_fullsized":"2023-11-16T02:29:39.893035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:59:52.538150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.894051+0000","last_change":"2023-11-16T02:29:37.936845+0000","last_active":"2023-11-16T02:29:39.894051+0000","last_peered":"2023-11-16T02:29:39.894051+0000","last_clean":"2023-11-16T02:29:39.894051+0000","last_became_active":"2023-11-16T02:29:37.936190+0000","last_became_peered":"2023-11-16T02:29:37.936190+0000","last_unstale":"2023-11-16T02:29:39.894051+0000","last_undegraded":"2023-11-16T02:29:39.894051+0000","last_fullsized":"2023-11-16T02:29:39.894051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:02:14.259774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930772+0000","last_change":"2023-11-16T02:29:37.513345+0000","last_active":"2023-11-16T02:29:38.930772+0000","last_peered":"2023-11-16T02:29:38.930772+0000","last_clean":"2023-11-16T02:29:38.930772+0000","last_became_active":"2023-11-16T02:29:37.512642+0000","last_became_peered":"2023-11-16T02:29:37.512642+0000","last_unstale":"2023-11-16T02:29:38.930772+0000","last_undegraded":"2023-11-16T02:29:38.930772+0000","last_fullsized":"2023-11-16T02:29:38.930772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:03:19.516009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893760+0000","last_change":"2023-11-16T02:29:37.938095+0000","last_active":"2023-11-16T02:29:39.893760+0000","last_peered":"2023-11-16T02:29:39.893760+0000","last_clean":"2023-11-16T02:29:39.893760+0000","last_became_active":"2023-11-16T02:29:37.937531+0000","last_became_peered":"2023-11-16T02:29:37.937531+0000","last_unstale":"2023-11-16T02:29:39.893760+0000","last_undegraded":"2023-11-16T02:29:39.893760+0000","last_fullsized":"2023-11-16T02:29:39.893760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:53:52.129290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878918+0000","last_change":"2023-11-16T02:29:37.519277+0000","last_active":"2023-11-16T02:29:38.878918+0000","last_peered":"2023-11-16T02:29:38.878918+0000","last_clean":"2023-11-16T02:29:38.878918+0000","last_became_active":"2023-11-16T02:29:37.518833+0000","last_became_peered":"2023-11-16T02:29:37.518833+0000","last_unstale":"2023-11-16T02:29:38.878918+0000","last_undegraded":"2023-11-16T02:29:38.878918+0000","last_fullsized":"2023-11-16T02:29:38.878918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:04:23.421210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881516+0000","last_change":"2023-11-16T02:29:37.916444+0000","last_active":"2023-11-16T02:29:38.881516+0000","last_peered":"2023-11-16T02:29:38.881516+0000","last_clean":"2023-11-16T02:29:38.881516+0000","last_became_active":"2023-11-16T02:29:37.915697+0000","last_became_peered":"2023-11-16T02:29:37.915697+0000","last_unstale":"2023-11-16T02:29:38.881516+0000","last_undegraded":"2023-11-16T02:29:38.881516+0000","last_fullsized":"2023-11-16T02:29:38.881516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:02:14.259774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930777+0000","last_change":"2023-11-16T02:29:37.544475+0000","last_active":"2023-11-16T02:29:38.930777+0000","last_peered":"2023-11-16T02:29:38.930777+0000","last_clean":"2023-11-16T02:29:38.930777+0000","last_became_active":"2023-11-16T02:29:37.544180+0000","last_became_peered":"2023-11-16T02:29:37.544180+0000","last_unstale":"2023-11-16T02:29:38.930777+0000","last_undegraded":"2023-11-16T02:29:38.930777+0000","last_fullsized":"2023-11-16T02:29:38.930777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:24:09.474240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893476+0000","last_change":"2023-11-16T02:29:37.934969+0000","last_active":"2023-11-16T02:29:39.893476+0000","last_peered":"2023-11-16T02:29:39.893476+0000","last_clean":"2023-11-16T02:29:39.893476+0000","last_became_active":"2023-11-16T02:29:37.934382+0000","last_became_peered":"2023-11-16T02:29:37.934382+0000","last_unstale":"2023-11-16T02:29:39.893476+0000","last_undegraded":"2023-11-16T02:29:39.893476+0000","last_fullsized":"2023-11-16T02:29:39.893476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:57:50.326734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":164,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-16T02:29:37.908728+0000","last_change":"2023-11-16T02:29:27.538359+0000","last_active":"2023-11-16T02:29:37.908728+0000","last_peered":"2023-11-16T02:29:37.908728+0000","last_clean":"2023-11-16T02:29:37.908728+0000","last_became_active":"2023-11-16T02:29:27.536606+0000","last_became_peered":"2023-11-16T02:29:27.536606+0000","last_unstale":"2023-11-16T02:29:37.908728+0000","last_undegraded":"2023-11-16T02:29:37.908728+0000","last_fullsized":"2023-11-16T02:29:37.908728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:26.491990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:26.491990+0000","last_clean_scrub_stamp":"2023-11-16T02:29:26.491990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:29:40.434297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879779+0000","last_change":"2023-11-16T02:29:37.529226+0000","last_active":"2023-11-16T02:29:38.879779+0000","last_peered":"2023-11-16T02:29:38.879779+0000","last_clean":"2023-11-16T02:29:38.879779+0000","last_became_active":"2023-11-16T02:29:37.528419+0000","last_became_peered":"2023-11-16T02:29:37.528419+0000","last_unstale":"2023-11-16T02:29:38.879779+0000","last_undegraded":"2023-11-16T02:29:38.879779+0000","last_fullsized":"2023-11-16T02:29:38.879779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:57:02.655084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892100+0000","last_change":"2023-11-16T02:29:37.928597+0000","last_active":"2023-11-16T02:29:39.892100+0000","last_peered":"2023-11-16T02:29:39.892100+0000","last_clean":"2023-11-16T02:29:39.892100+0000","last_became_active":"2023-11-16T02:29:37.928277+0000","last_became_peered":"2023-11-16T02:29:37.928277+0000","last_unstale":"2023-11-16T02:29:39.892100+0000","last_undegraded":"2023-11-16T02:29:39.892100+0000","last_fullsized":"2023-11-16T02:29:39.892100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:46:36.525784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892334+0000","last_change":"2023-11-16T02:29:37.540168+0000","last_active":"2023-11-16T02:29:39.892334+0000","last_peered":"2023-11-16T02:29:39.892334+0000","last_clean":"2023-11-16T02:29:39.892334+0000","last_became_active":"2023-11-16T02:29:37.539604+0000","last_became_peered":"2023-11-16T02:29:37.539604+0000","last_unstale":"2023-11-16T02:29:39.892334+0000","last_undegraded":"2023-11-16T02:29:39.892334+0000","last_fullsized":"2023-11-16T02:29:39.892334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:45:11.372719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.890863+0000","last_change":"2023-11-16T02:29:37.928646+0000","last_active":"2023-11-16T02:29:39.890863+0000","last_peered":"2023-11-16T02:29:39.890863+0000","last_clean":"2023-11-16T02:29:39.890863+0000","last_became_active":"2023-11-16T02:29:37.927520+0000","last_became_peered":"2023-11-16T02:29:37.927520+0000","last_unstale":"2023-11-16T02:29:39.890863+0000","last_undegraded":"2023-11-16T02:29:39.890863+0000","last_fullsized":"2023-11-16T02:29:39.890863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:05:12.707357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930813+0000","last_change":"2023-11-16T02:29:37.508498+0000","last_active":"2023-11-16T02:29:38.930813+0000","last_peered":"2023-11-16T02:29:38.930813+0000","last_clean":"2023-11-16T02:29:38.930813+0000","last_became_active":"2023-11-16T02:29:37.508091+0000","last_became_peered":"2023-11-16T02:29:37.508091+0000","last_unstale":"2023-11-16T02:29:38.930813+0000","last_undegraded":"2023-11-16T02:29:38.930813+0000","last_fullsized":"2023-11-16T02:29:38.930813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:31:57.230585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878450+0000","last_change":"2023-11-16T02:29:37.889506+0000","last_active":"2023-11-16T02:29:38.878450+0000","last_peered":"2023-11-16T02:29:38.878450+0000","last_clean":"2023-11-16T02:29:38.878450+0000","last_became_active":"2023-11-16T02:29:37.884833+0000","last_became_peered":"2023-11-16T02:29:37.884833+0000","last_unstale":"2023-11-16T02:29:38.878450+0000","last_undegraded":"2023-11-16T02:29:38.878450+0000","last_fullsized":"2023-11-16T02:29:38.878450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:05:26.649663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880343+0000","last_change":"2023-11-16T02:29:37.535414+0000","last_active":"2023-11-16T02:29:38.880343+0000","last_peered":"2023-11-16T02:29:38.880343+0000","last_clean":"2023-11-16T02:29:38.880343+0000","last_became_active":"2023-11-16T02:29:37.530060+0000","last_became_peered":"2023-11-16T02:29:37.530060+0000","last_unstale":"2023-11-16T02:29:38.880343+0000","last_undegraded":"2023-11-16T02:29:38.880343+0000","last_fullsized":"2023-11-16T02:29:38.880343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:07:57.498670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.894166+0000","last_change":"2023-11-16T02:29:37.900850+0000","last_active":"2023-11-16T02:29:39.894166+0000","last_peered":"2023-11-16T02:29:39.894166+0000","last_clean":"2023-11-16T02:29:39.894166+0000","last_became_active":"2023-11-16T02:29:37.896204+0000","last_became_peered":"2023-11-16T02:29:37.896204+0000","last_unstale":"2023-11-16T02:29:39.894166+0000","last_undegraded":"2023-11-16T02:29:39.894166+0000","last_fullsized":"2023-11-16T02:29:39.894166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:04:24.431554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878831+0000","last_change":"2023-11-16T02:29:37.515012+0000","last_active":"2023-11-16T02:29:38.878831+0000","last_peered":"2023-11-16T02:29:38.878831+0000","last_clean":"2023-11-16T02:29:38.878831+0000","last_became_active":"2023-11-16T02:29:37.514528+0000","last_became_peered":"2023-11-16T02:29:37.514528+0000","last_unstale":"2023-11-16T02:29:38.878831+0000","last_undegraded":"2023-11-16T02:29:38.878831+0000","last_fullsized":"2023-11-16T02:29:38.878831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:07:57.498670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881961+0000","last_change":"2023-11-16T02:29:37.925316+0000","last_active":"2023-11-16T02:29:38.881961+0000","last_peered":"2023-11-16T02:29:38.881961+0000","last_clean":"2023-11-16T02:29:38.881961+0000","last_became_active":"2023-11-16T02:29:37.924267+0000","last_became_peered":"2023-11-16T02:29:37.924267+0000","last_unstale":"2023-11-16T02:29:38.881961+0000","last_undegraded":"2023-11-16T02:29:38.881961+0000","last_fullsized":"2023-11-16T02:29:38.881961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:06:38.108558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893826+0000","last_change":"2023-11-16T02:29:37.544869+0000","last_active":"2023-11-16T02:29:39.893826+0000","last_peered":"2023-11-16T02:29:39.893826+0000","last_clean":"2023-11-16T02:29:39.893826+0000","last_became_active":"2023-11-16T02:29:37.544275+0000","last_became_peered":"2023-11-16T02:29:37.544275+0000","last_unstale":"2023-11-16T02:29:39.893826+0000","last_undegraded":"2023-11-16T02:29:39.893826+0000","last_fullsized":"2023-11-16T02:29:39.893826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:38:57.277934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878700+0000","last_change":"2023-11-16T02:29:37.884651+0000","last_active":"2023-11-16T02:29:38.878700+0000","last_peered":"2023-11-16T02:29:38.878700+0000","last_clean":"2023-11-16T02:29:38.878700+0000","last_became_active":"2023-11-16T02:29:37.884251+0000","last_became_peered":"2023-11-16T02:29:37.884251+0000","last_unstale":"2023-11-16T02:29:38.878700+0000","last_undegraded":"2023-11-16T02:29:38.878700+0000","last_fullsized":"2023-11-16T02:29:38.878700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:09:55.065210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879054+0000","last_change":"2023-11-16T02:29:37.518697+0000","last_active":"2023-11-16T02:29:38.879054+0000","last_peered":"2023-11-16T02:29:38.879054+0000","last_clean":"2023-11-16T02:29:38.879054+0000","last_became_active":"2023-11-16T02:29:37.518275+0000","last_became_peered":"2023-11-16T02:29:37.518275+0000","last_unstale":"2023-11-16T02:29:38.879054+0000","last_undegraded":"2023-11-16T02:29:38.879054+0000","last_fullsized":"2023-11-16T02:29:38.879054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:45:11.372719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892472+0000","last_change":"2023-11-16T02:29:37.928232+0000","last_active":"2023-11-16T02:29:39.892472+0000","last_peered":"2023-11-16T02:29:39.892472+0000","last_clean":"2023-11-16T02:29:39.892472+0000","last_became_active":"2023-11-16T02:29:37.927841+0000","last_became_peered":"2023-11-16T02:29:37.927841+0000","last_unstale":"2023-11-16T02:29:39.892472+0000","last_undegraded":"2023-11-16T02:29:39.892472+0000","last_fullsized":"2023-11-16T02:29:39.892472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:06:38.108558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880867+0000","last_change":"2023-11-16T02:29:37.533118+0000","last_active":"2023-11-16T02:29:38.880867+0000","last_peered":"2023-11-16T02:29:38.880867+0000","last_clean":"2023-11-16T02:29:38.880867+0000","last_became_active":"2023-11-16T02:29:37.532348+0000","last_became_peered":"2023-11-16T02:29:37.532348+0000","last_unstale":"2023-11-16T02:29:38.880867+0000","last_undegraded":"2023-11-16T02:29:38.880867+0000","last_fullsized":"2023-11-16T02:29:38.880867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:42:27.512040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891116+0000","last_change":"2023-11-16T02:29:37.892758+0000","last_active":"2023-11-16T02:29:39.891116+0000","last_peered":"2023-11-16T02:29:39.891116+0000","last_clean":"2023-11-16T02:29:39.891116+0000","last_became_active":"2023-11-16T02:29:37.892403+0000","last_became_peered":"2023-11-16T02:29:37.892403+0000","last_unstale":"2023-11-16T02:29:39.891116+0000","last_undegraded":"2023-11-16T02:29:39.891116+0000","last_fullsized":"2023-11-16T02:29:39.891116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T02:37:34.677034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892115+0000","last_change":"2023-11-16T02:29:37.539865+0000","last_active":"2023-11-16T02:29:39.892115+0000","last_peered":"2023-11-16T02:29:39.892115+0000","last_clean":"2023-11-16T02:29:39.892115+0000","last_became_active":"2023-11-16T02:29:37.538829+0000","last_became_peered":"2023-11-16T02:29:37.538829+0000","last_unstale":"2023-11-16T02:29:39.892115+0000","last_undegraded":"2023-11-16T02:29:39.892115+0000","last_fullsized":"2023-11-16T02:29:39.892115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:09:37.990889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892445+0000","last_change":"2023-11-16T02:29:37.924136+0000","last_active":"2023-11-16T02:29:39.892445+0000","last_peered":"2023-11-16T02:29:39.892445+0000","last_clean":"2023-11-16T02:29:39.892445+0000","last_became_active":"2023-11-16T02:29:37.922911+0000","last_became_peered":"2023-11-16T02:29:37.922911+0000","last_unstale":"2023-11-16T02:29:39.892445+0000","last_undegraded":"2023-11-16T02:29:39.892445+0000","last_fullsized":"2023-11-16T02:29:39.892445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:45:12.383063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878567+0000","last_change":"2023-11-16T02:29:37.530829+0000","last_active":"2023-11-16T02:29:38.878567+0000","last_peered":"2023-11-16T02:29:38.878567+0000","last_clean":"2023-11-16T02:29:38.878567+0000","last_became_active":"2023-11-16T02:29:37.530464+0000","last_became_peered":"2023-11-16T02:29:37.530464+0000","last_unstale":"2023-11-16T02:29:38.878567+0000","last_undegraded":"2023-11-16T02:29:38.878567+0000","last_fullsized":"2023-11-16T02:29:38.878567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:42:27.512040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892249+0000","last_change":"2023-11-16T02:29:37.886780+0000","last_active":"2023-11-16T02:29:39.892249+0000","last_peered":"2023-11-16T02:29:39.892249+0000","last_clean":"2023-11-16T02:29:39.892249+0000","last_became_active":"2023-11-16T02:29:37.885971+0000","last_became_peered":"2023-11-16T02:29:37.885971+0000","last_unstale":"2023-11-16T02:29:39.892249+0000","last_undegraded":"2023-11-16T02:29:39.892249+0000","last_fullsized":"2023-11-16T02:29:39.892249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:09:55.065210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878991+0000","last_change":"2023-11-16T02:29:37.518075+0000","last_active":"2023-11-16T02:29:38.878991+0000","last_peered":"2023-11-16T02:29:38.878991+0000","last_clean":"2023-11-16T02:29:38.878991+0000","last_became_active":"2023-11-16T02:29:37.517639+0000","last_became_peered":"2023-11-16T02:29:37.517639+0000","last_unstale":"2023-11-16T02:29:38.878991+0000","last_undegraded":"2023-11-16T02:29:38.878991+0000","last_fullsized":"2023-11-16T02:29:38.878991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:57:02.655084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891316+0000","last_change":"2023-11-16T02:29:37.895705+0000","last_active":"2023-11-16T02:29:39.891316+0000","last_peered":"2023-11-16T02:29:39.891316+0000","last_clean":"2023-11-16T02:29:39.891316+0000","last_became_active":"2023-11-16T02:29:37.895416+0000","last_became_peered":"2023-11-16T02:29:37.895416+0000","last_unstale":"2023-11-16T02:29:39.891316+0000","last_undegraded":"2023-11-16T02:29:39.891316+0000","last_fullsized":"2023-11-16T02:29:39.891316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:43:20.665096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893707+0000","last_change":"2023-11-16T02:29:37.544189+0000","last_active":"2023-11-16T02:29:39.893707+0000","last_peered":"2023-11-16T02:29:39.893707+0000","last_clean":"2023-11-16T02:29:39.893707+0000","last_became_active":"2023-11-16T02:29:37.543571+0000","last_became_peered":"2023-11-16T02:29:37.543571+0000","last_unstale":"2023-11-16T02:29:39.893707+0000","last_undegraded":"2023-11-16T02:29:39.893707+0000","last_fullsized":"2023-11-16T02:29:39.893707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:07:57.498670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880376+0000","last_change":"2023-11-16T02:29:37.928251+0000","last_active":"2023-11-16T02:29:38.880376+0000","last_peered":"2023-11-16T02:29:38.880376+0000","last_clean":"2023-11-16T02:29:38.880376+0000","last_became_active":"2023-11-16T02:29:37.927716+0000","last_became_peered":"2023-11-16T02:29:37.927716+0000","last_unstale":"2023-11-16T02:29:38.880376+0000","last_undegraded":"2023-11-16T02:29:38.880376+0000","last_fullsized":"2023-11-16T02:29:38.880376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:25:48.005968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881803+0000","last_change":"2023-11-16T02:29:37.939219+0000","last_active":"2023-11-16T02:29:38.881803+0000","last_peered":"2023-11-16T02:29:38.881803+0000","last_clean":"2023-11-16T02:29:38.881803+0000","last_became_active":"2023-11-16T02:29:37.938582+0000","last_became_peered":"2023-11-16T02:29:37.938582+0000","last_unstale":"2023-11-16T02:29:38.881803+0000","last_undegraded":"2023-11-16T02:29:38.881803+0000","last_fullsized":"2023-11-16T02:29:38.881803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:43:20.665096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893385+0000","last_change":"2023-11-16T02:29:37.549085+0000","last_active":"2023-11-16T02:29:39.893385+0000","last_peered":"2023-11-16T02:29:39.893385+0000","last_clean":"2023-11-16T02:29:39.893385+0000","last_became_active":"2023-11-16T02:29:37.548532+0000","last_became_peered":"2023-11-16T02:29:37.548532+0000","last_unstale":"2023-11-16T02:29:39.893385+0000","last_undegraded":"2023-11-16T02:29:39.893385+0000","last_fullsized":"2023-11-16T02:29:39.893385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:21:31.762437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881938+0000","last_change":"2023-11-16T02:29:37.936750+0000","last_active":"2023-11-16T02:29:38.881938+0000","last_peered":"2023-11-16T02:29:38.881938+0000","last_clean":"2023-11-16T02:29:38.881938+0000","last_became_active":"2023-11-16T02:29:37.936169+0000","last_became_peered":"2023-11-16T02:29:37.936169+0000","last_unstale":"2023-11-16T02:29:38.881938+0000","last_undegraded":"2023-11-16T02:29:38.881938+0000","last_fullsized":"2023-11-16T02:29:38.881938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:10:43.990221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893640+0000","last_change":"2023-11-16T02:29:37.543752+0000","last_active":"2023-11-16T02:29:39.893640+0000","last_peered":"2023-11-16T02:29:39.893640+0000","last_clean":"2023-11-16T02:29:39.893640+0000","last_became_active":"2023-11-16T02:29:37.543157+0000","last_became_peered":"2023-11-16T02:29:37.543157+0000","last_unstale":"2023-11-16T02:29:39.893640+0000","last_undegraded":"2023-11-16T02:29:39.893640+0000","last_fullsized":"2023-11-16T02:29:39.893640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:04:23.421210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891041+0000","last_change":"2023-11-16T02:29:37.928390+0000","last_active":"2023-11-16T02:29:39.891041+0000","last_peered":"2023-11-16T02:29:39.891041+0000","last_clean":"2023-11-16T02:29:39.891041+0000","last_became_active":"2023-11-16T02:29:37.928152+0000","last_became_peered":"2023-11-16T02:29:37.928152+0000","last_unstale":"2023-11-16T02:29:39.891041+0000","last_undegraded":"2023-11-16T02:29:39.891041+0000","last_fullsized":"2023-11-16T02:29:39.891041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:10:43.990221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891480+0000","last_change":"2023-11-16T02:29:37.516960+0000","last_active":"2023-11-16T02:29:39.891480+0000","last_peered":"2023-11-16T02:29:39.891480+0000","last_clean":"2023-11-16T02:29:39.891480+0000","last_became_active":"2023-11-16T02:29:37.516030+0000","last_became_peered":"2023-11-16T02:29:37.516030+0000","last_unstale":"2023-11-16T02:29:39.891480+0000","last_undegraded":"2023-11-16T02:29:39.891480+0000","last_fullsized":"2023-11-16T02:29:39.891480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:44:21.321181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891358+0000","last_change":"2023-11-16T02:29:37.909668+0000","last_active":"2023-11-16T02:29:39.891358+0000","last_peered":"2023-11-16T02:29:39.891358+0000","last_clean":"2023-11-16T02:29:39.891358+0000","last_became_active":"2023-11-16T02:29:37.909339+0000","last_became_peered":"2023-11-16T02:29:37.909339+0000","last_unstale":"2023-11-16T02:29:39.891358+0000","last_undegraded":"2023-11-16T02:29:39.891358+0000","last_fullsized":"2023-11-16T02:29:39.891358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:25:48.005968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891428+0000","last_change":"2023-11-16T02:29:37.537280+0000","last_active":"2023-11-16T02:29:39.891428+0000","last_peered":"2023-11-16T02:29:39.891428+0000","last_clean":"2023-11-16T02:29:39.891428+0000","last_became_active":"2023-11-16T02:29:37.536813+0000","last_became_peered":"2023-11-16T02:29:37.536813+0000","last_unstale":"2023-11-16T02:29:39.891428+0000","last_undegraded":"2023-11-16T02:29:39.891428+0000","last_fullsized":"2023-11-16T02:29:39.891428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:44:21.321181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":660890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31276,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340564,"statfs":{"total":96636764160,"available":96604737536,"internally_reserved":0,"allocated":233472,"data_stored":77804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]}]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31268,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340572,"statfs":{"total":96636764160,"available":96604745728,"internally_reserved":0,"allocated":225280,"data_stored":76330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]}]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31264,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340576,"statfs":{"total":96636764160,"available":96604749824,"internally_reserved":0,"allocated":221184,"data_stored":70066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]}]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31264,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340576,"statfs":{"total":96636764160,"available":96604749824,"internally_reserved":0,"allocated":221184,"data_stored":71504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31272,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340568,"statfs":{"total":96636764160,"available":96604741632,"internally_reserved":0,"allocated":229376,"data_stored":76400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":815104,"data_stored":660946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31264,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340576,"statfs":{"total":96636764160,"available":96604749824,"internally_reserved":0,"allocated":221184,"data_stored":76240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-16T02:29:42.601 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-16T02:29:42.675 INFO:tasks.ceph.mds.a.smithi028.stderr:2023-11-16T02:29:42.673+0000 7fed5b389640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-16T02:29:42.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.761+0000 7f3a7252f640 1 Processor -- start 2023-11-16T02:29:42.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.761+0000 7f3a7252f640 1 -- start start 2023-11-16T02:29:42.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.761+0000 7f3a7252f640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3a6c0b3b60 0x7f3a6c1542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:42.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.761+0000 7f3a7252f640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6c0b52b0 con 0x7f3a6c148960 2023-11-16T02:29:42.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.761+0000 7f3a7252f640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6c0bcdb0 con 0x7f3a6c0b8240 2023-11-16T02:29:42.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.761+0000 7f3a7252f640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a6c0b6220 con 0x7f3a6c0b3b60 2023-11-16T02:29:42.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.761+0000 7f3a6b7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f3a6c148960 0x7f3a6c0b3450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:39702/0 (socket says 172.21.15.28:39702) 2023-11-16T02:29:42.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.761+0000 7f3a6b7fe640 1 -- 172.21.15.28:0/4042401745 learned_addr learned my addr 172.21.15.28:0/4042401745 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:42.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.761+0000 7f3a70acc640 1 --2- 172.21.15.28:0/4042401745 >> v2:172.21.15.70:3300/0 conn(0x7f3a6c0b3b60 0x7f3a6c1542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:42.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.761+0000 7f3a6affd640 1 -- 172.21.15.28:0/4042401745 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2125014401 0 0) 0x7f3a6c0b52b0 con 0x7f3a6c148960 2023-11-16T02:29:42.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.761+0000 7f3a6affd640 1 -- 172.21.15.28:0/4042401745 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a58003530 con 0x7f3a6c148960 2023-11-16T02:29:42.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.761+0000 7f3a6affd640 1 -- 172.21.15.28:0/4042401745 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3605872885 0 0) 0x7f3a58003530 con 0x7f3a6c148960 2023-11-16T02:29:42.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.761+0000 7f3a6affd640 1 -- 172.21.15.28:0/4042401745 >> v2:172.21.15.70:3300/0 conn(0x7f3a6c0b3b60 msgr2=0x7f3a6c1542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:42.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.761+0000 7f3a6affd640 1 --2- 172.21.15.28:0/4042401745 >> v2:172.21.15.70:3300/0 conn(0x7f3a6c0b3b60 0x7f3a6c1542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.761+0000 7f3a6affd640 1 -- 172.21.15.28:0/4042401745 >> v1:172.21.15.70:6789/0 conn(0x7f3a6c0b8240 legacy=0x7f3a6c0bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:42.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.761+0000 7f3a6affd640 1 -- 172.21.15.28:0/4042401745 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6c0b4040 con 0x7f3a6c148960 2023-11-16T02:29:42.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.761+0000 7f3a6affd640 1 -- 172.21.15.28:0/4042401745 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7f3a54001a00 con 0x7f3a6c148960 2023-11-16T02:29:42.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.761+0000 7f3a6affd640 1 -- 172.21.15.28:0/4042401745 >> v1:172.21.15.28:6789/0 conn(0x7f3a6c148960 legacy=0x7f3a6c0b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:42.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.765+0000 7f3a6affd640 1 --2- 172.21.15.28:0/4042401745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a58003980 0x7f3a58003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:42.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.765+0000 7f3a6affd640 1 --2- 172.21.15.28:0/4042401745 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3a580047d0 0x7f3a58004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:42.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.765+0000 7f3a6affd640 1 --2- 172.21.15.28:0/4042401745 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3a58005190 0x7f3a5800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:42.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.765+0000 7f3a6affd640 1 -- 172.21.15.28:0/4042401745 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c0b6220 con 0x7f3a58005190 2023-11-16T02:29:42.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.765+0000 7f3a6affd640 1 -- 172.21.15.28:0/4042401745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5800bfe0 con 0x7f3a58003980 2023-11-16T02:29:42.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.765+0000 7f3a6affd640 1 -- 172.21.15.28:0/4042401745 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5800c1a0 con 0x7f3a580047d0 2023-11-16T02:29:42.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.765+0000 7f3a70acc640 1 --2- 172.21.15.28:0/4042401745 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3a58005190 0x7f3a5800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:42.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.765+0000 7f3a6bfff640 1 --2- 172.21.15.28:0/4042401745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a58003980 0x7f3a58003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:42.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.765+0000 7f3a6b7fe640 1 --2- 172.21.15.28:0/4042401745 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3a580047d0 0x7f3a58004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:42.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.765+0000 7f3a70acc640 1 -- 172.21.15.28:0/4042401745 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3a580047d0 msgr2=0x7f3a58004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:42.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.765+0000 7f3a70acc640 1 --2- 172.21.15.28:0/4042401745 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3a580047d0 0x7f3a58004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.765+0000 7f3a70acc640 1 -- 172.21.15.28:0/4042401745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a58003980 msgr2=0x7f3a58003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:42.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.765+0000 7f3a70acc640 1 --2- 172.21.15.28:0/4042401745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a58003980 0x7f3a58003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.765+0000 7f3a70acc640 1 -- 172.21.15.28:0/4042401745 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a58003530 con 0x7f3a58005190 2023-11-16T02:29:42.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.765+0000 7f3a70acc640 1 -- 172.21.15.28:0/4042401745 reap_dead start 2023-11-16T02:29:42.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.765+0000 7f3a70acc640 1 --2- 172.21.15.28:0/4042401745 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3a58005190 0x7f3a5800b990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c06b580 tx=0x7f3a5c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4fcbe24267f3df server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:42.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.765+0000 7f3a6affd640 1 -- 172.21.15.28:0/4042401745 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0a5620 con 0x7f3a58005190 2023-11-16T02:29:42.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.765+0000 7f3a6affd640 1 -- 172.21.15.28:0/4042401745 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c0a5780 con 0x7f3a58005190 2023-11-16T02:29:42.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.765+0000 7f3a6affd640 1 -- 172.21.15.28:0/4042401745 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0a5b10 con 0x7f3a58005190 2023-11-16T02:29:42.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.765+0000 7f3a7252f640 1 -- 172.21.15.28:0/4042401745 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3a58005190 msgr2=0x7f3a5800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:42.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.765+0000 7f3a7252f640 1 --2- 172.21.15.28:0/4042401745 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3a58005190 0x7f3a5800b990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c06b580 tx=0x7f3a5c01c9f0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.765+0000 7f3a7252f640 1 -- 172.21.15.28:0/4042401745 shutdown_connections 2023-11-16T02:29:42.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.765+0000 7f3a7252f640 1 --2- 172.21.15.28:0/4042401745 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3a58005190 0x7f3a5800b990 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.765+0000 7f3a7252f640 1 -- 172.21.15.28:0/4042401745 >> 172.21.15.28:0/4042401745 conn(0x7f3a6c0b9050 msgr2=0x7f3a6c0bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:42.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.765+0000 7f3a7252f640 1 -- 172.21.15.28:0/4042401745 shutdown_connections 2023-11-16T02:29:42.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.765+0000 7f3a7252f640 1 -- 172.21.15.28:0/4042401745 wait complete. 2023-11-16T02:29:42.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.769+0000 7f3a7252f640 1 Processor -- start 2023-11-16T02:29:42.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.769+0000 7f3a7252f640 1 -- start start 2023-11-16T02:29:42.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.769+0000 7f3a7252f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3a58005190 0x7f3a6c1396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:42.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.769+0000 7f3a7252f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3a6c14b230 0x7f3a6c146790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:42.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.769+0000 7f3a7252f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c145680 0x7f3a6c145b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:42.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.769+0000 7f3a7252f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c139c10 con 0x7f3a58005190 2023-11-16T02:29:42.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.769+0000 7f3a7252f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c149b80 con 0x7f3a6c145680 2023-11-16T02:29:42.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.769+0000 7f3a7252f640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c14c850 con 0x7f3a6c14b230 2023-11-16T02:29:42.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.769+0000 7f3a6bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3a58005190 0x7f3a6c1396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:42.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.769+0000 7f3a6bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3a58005190 0x7f3a6c1396d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40878/0 (socket says 172.21.15.28:40878) 2023-11-16T02:29:42.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.769+0000 7f3a6bfff640 1 -- 172.21.15.28:0/244294772 learned_addr learned my addr 172.21.15.28:0/244294772 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:42.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.769+0000 7f3a6b7fe640 1 --2- 172.21.15.28:0/244294772 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3a6c14b230 0x7f3a6c146790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:42.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.769+0000 7f3a6bfff640 1 -- 172.21.15.28:0/244294772 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3a6c14b230 msgr2=0x7f3a6c146790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:42.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.769+0000 7f3a6bfff640 1 --2- 172.21.15.28:0/244294772 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3a6c14b230 0x7f3a6c146790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.769+0000 7f3a70acc640 1 --2- 172.21.15.28:0/244294772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c145680 0x7f3a6c145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:42.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.769+0000 7f3a6bfff640 1 -- 172.21.15.28:0/244294772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c145680 msgr2=0x7f3a6c145b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:42.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.769+0000 7f3a6bfff640 1 --2- 172.21.15.28:0/244294772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c145680 0x7f3a6c145b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.769+0000 7f3a6bfff640 1 -- 172.21.15.28:0/244294772 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6c149df0 con 0x7f3a58005190 2023-11-16T02:29:42.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.769+0000 7f3a6bfff640 1 --2- 172.21.15.28:0/244294772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3a58005190 0x7f3a6c1396d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400f820 tx=0x7f3a6400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:42.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.769+0000 7f3a68ff9640 1 -- 172.21.15.28:0/244294772 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6400fed0 con 0x7f3a58005190 2023-11-16T02:29:42.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.769+0000 7f3a68ff9640 1 -- 172.21.15.28:0/244294772 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a640052e0 con 0x7f3a58005190 2023-11-16T02:29:42.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.769+0000 7f3a68ff9640 1 -- 172.21.15.28:0/244294772 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6400d970 con 0x7f3a58005190 2023-11-16T02:29:42.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.769+0000 7f3a7252f640 1 -- 172.21.15.28:0/244294772 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a6c14a0d0 con 0x7f3a58005190 2023-11-16T02:29:42.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.769+0000 7f3a7252f640 1 -- 172.21.15.28:0/244294772 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a6c14b6c0 con 0x7f3a58005190 2023-11-16T02:29:42.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.769+0000 7f3a7252f640 1 -- 172.21.15.28:0/244294772 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a6c14a2c0 con 0x7f3a58005190 2023-11-16T02:29:42.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.769+0000 7f3a68ff9640 1 -- 172.21.15.28:0/244294772 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3a6400dad0 con 0x7f3a58005190 2023-11-16T02:29:42.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.773+0000 7f3a68ff9640 1 --2- 172.21.15.28:0/244294772 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3a4c065a60 0x7f3a4c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:42.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.773+0000 7f3a68ff9640 1 -- 172.21.15.28:0/244294772 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a640830f0 con 0x7f3a58005190 2023-11-16T02:29:42.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.773+0000 7f3a6b7fe640 1 --2- 172.21.15.28:0/244294772 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3a4c065a60 0x7f3a4c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:42.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.773+0000 7f3a6b7fe640 1 --2- 172.21.15.28:0/244294772 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3a4c065a60 0x7f3a4c067f20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3a540013e0 tx=0x7f3a54001f00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:42.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.777+0000 7f3a68ff9640 1 -- 172.21.15.28:0/244294772 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f3a64050b40 con 0x7f3a58005190 2023-11-16T02:29:42.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.989+0000 7f3a7252f640 1 -- 172.21.15.28:0/244294772 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f3a6c04e8a0 con 0x7f3a58005190 2023-11-16T02:29:42.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.989+0000 7f3a68ff9640 1 -- 172.21.15.28:0/244294772 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1010 (secure 0 0 0) 0x7f3a64054160 con 0x7f3a58005190 2023-11-16T02:29:42.992 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:42.992 INFO:teuthology.orchestra.run.smithi028.stdout:{"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":22,"num_osds":8,"num_up_osds":8,"osd_up_since":1700101764,"num_in_osds":8,"osd_in_since":1700101756,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592730,"bytes_used":257318912,"bytes_avail":772836794368,"bytes_total":773094113280,"write_bytes_sec":2416,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4263}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-11-16T02:29:13.714364+0000","services":{}},"progress_events":{}} 2023-11-16T02:29:42.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.989+0000 7f3a7252f640 1 -- 172.21.15.28:0/244294772 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3a4c065a60 msgr2=0x7f3a4c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:42.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.989+0000 7f3a7252f640 1 --2- 172.21.15.28:0/244294772 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3a4c065a60 0x7f3a4c067f20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3a540013e0 tx=0x7f3a54001f00 comp rx=0 tx=0).stop 2023-11-16T02:29:42.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.989+0000 7f3a7252f640 1 -- 172.21.15.28:0/244294772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3a58005190 msgr2=0x7f3a6c1396d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:42.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.989+0000 7f3a7252f640 1 --2- 172.21.15.28:0/244294772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3a58005190 0x7f3a6c1396d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400f820 tx=0x7f3a6400fce0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.989+0000 7f3a7252f640 1 -- 172.21.15.28:0/244294772 shutdown_connections 2023-11-16T02:29:42.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.989+0000 7f3a7252f640 1 --2- 172.21.15.28:0/244294772 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3a4c065a60 0x7f3a4c067f20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.989+0000 7f3a7252f640 1 --2- 172.21.15.28:0/244294772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3a6c145680 0x7f3a6c145b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.989+0000 7f3a7252f640 1 --2- 172.21.15.28:0/244294772 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3a6c14b230 0x7f3a6c146790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.989+0000 7f3a7252f640 1 --2- 172.21.15.28:0/244294772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3a58005190 0x7f3a6c1396d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:42.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.989+0000 7f3a7252f640 1 -- 172.21.15.28:0/244294772 >> 172.21.15.28:0/244294772 conn(0x7f3a6c0b9050 msgr2=0x7f3a6c142480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:42.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.993+0000 7f3a7252f640 1 -- 172.21.15.28:0/244294772 shutdown_connections 2023-11-16T02:29:42.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:42.993+0000 7f3a7252f640 1 -- 172.21.15.28:0/244294772 wait complete. 2023-11-16T02:29:43.011 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-16T02:29:43.012 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-16T02:29:43.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.165+0000 7f057d594640 1 Processor -- start 2023-11-16T02:29:43.171 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.169+0000 7f057d594640 1 -- start start 2023-11-16T02:29:43.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.169+0000 7f057d594640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f05780bc830 0x7f05780b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:43.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.169+0000 7f057d594640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f05780714c0 0x7f05780b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:43.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.169+0000 7f057d594640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05780b88a0 con 0x7f05780b7dd0 2023-11-16T02:29:43.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.169+0000 7f057d594640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05780b3450 con 0x7f05780bc830 2023-11-16T02:29:43.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.169+0000 7f057d594640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05780b3fd0 con 0x7f05780714c0 2023-11-16T02:29:43.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.169+0000 7f05767fc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f05780bc830 0x7f05780b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:43.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.169+0000 7f05767fc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f05780bc830 0x7f05780b58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40892/0 (socket says 172.21.15.28:40892) 2023-11-16T02:29:43.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.169+0000 7f05767fc640 1 -- 172.21.15.28:0/2039989230 learned_addr learned my addr 172.21.15.28:0/2039989230 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:43.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.169+0000 7f05777fe640 1 --2- 172.21.15.28:0/2039989230 >> v2:172.21.15.70:3300/0 conn(0x7f05780714c0 0x7f05780b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:43.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.169+0000 7f05767fc640 1 -- 172.21.15.28:0/2039989230 >> v2:172.21.15.70:3300/0 conn(0x7f05780714c0 msgr2=0x7f05780b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:43.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.169+0000 7f05767fc640 1 --2- 172.21.15.28:0/2039989230 >> v2:172.21.15.70:3300/0 conn(0x7f05780714c0 0x7f05780b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:43.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.169+0000 7f05767fc640 1 -- 172.21.15.28:0/2039989230 >> v1:172.21.15.70:6789/0 conn(0x7f05780b7dd0 legacy=0x7f0578142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:43.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.169+0000 7f05767fc640 1 -- 172.21.15.28:0/2039989230 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05780b36a0 con 0x7f05780bc830 2023-11-16T02:29:43.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.169+0000 7f05767fc640 1 --2- 172.21.15.28:0/2039989230 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05780bc830 0x7f05780b58d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f05780bd070 tx=0x7f056c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5b017cb013cf02 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:43.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.169+0000 7f0575ffb640 1 -- 172.21.15.28:0/2039989230 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c0aa660 con 0x7f05780bc830 2023-11-16T02:29:43.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.169+0000 7f0575ffb640 1 -- 172.21.15.28:0/2039989230 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056c0aa7c0 con 0x7f05780bc830 2023-11-16T02:29:43.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.169+0000 7f0575ffb640 1 -- 172.21.15.28:0/2039989230 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c0aab50 con 0x7f05780bc830 2023-11-16T02:29:43.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f057d594640 1 -- 172.21.15.28:0/2039989230 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05780bc830 msgr2=0x7f05780b58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:43.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f057d594640 1 --2- 172.21.15.28:0/2039989230 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05780bc830 0x7f05780b58d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f05780bd070 tx=0x7f056c01c500 comp rx=0 tx=0).stop 2023-11-16T02:29:43.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f057d594640 1 -- 172.21.15.28:0/2039989230 shutdown_connections 2023-11-16T02:29:43.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f057d594640 1 --2- 172.21.15.28:0/2039989230 >> v2:172.21.15.70:3300/0 conn(0x7f05780714c0 0x7f05780b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:43.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f057d594640 1 --2- 172.21.15.28:0/2039989230 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05780bc830 0x7f05780b58d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:43.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f057d594640 1 -- 172.21.15.28:0/2039989230 >> 172.21.15.28:0/2039989230 conn(0x7f05780b9050 msgr2=0x7f05780bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:43.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f057d594640 1 -- 172.21.15.28:0/2039989230 shutdown_connections 2023-11-16T02:29:43.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f057d594640 1 -- 172.21.15.28:0/2039989230 wait complete. 2023-11-16T02:29:43.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f057d594640 1 Processor -- start 2023-11-16T02:29:43.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f057d594640 1 -- start start 2023-11-16T02:29:43.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f057d594640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f05780714c0 0x7f0578136240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:43.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f057d594640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05780b7dd0 0x7f057813cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:43.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f057d594640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05780bc830 0x7f05781e3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:43.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f057d594640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057813dc40 con 0x7f05780bc830 2023-11-16T02:29:43.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f057d594640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05781386e0 con 0x7f05780b7dd0 2023-11-16T02:29:43.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f057d594640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057813e470 con 0x7f05780714c0 2023-11-16T02:29:43.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f05777fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05780bc830 0x7f05781e3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:43.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f05777fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05780bc830 0x7f05781e3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40908/0 (socket says 172.21.15.28:40908) 2023-11-16T02:29:43.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f05777fe640 1 -- 172.21.15.28:0/1196660932 learned_addr learned my addr 172.21.15.28:0/1196660932 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:43.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f05767fc640 1 --2- 172.21.15.28:0/1196660932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05780b7dd0 0x7f057813cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:43.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f0576ffd640 1 --2- 172.21.15.28:0/1196660932 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f05780714c0 0x7f0578136240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:43.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f05777fe640 1 -- 172.21.15.28:0/1196660932 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f05780714c0 msgr2=0x7f0578136240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:43.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f05777fe640 1 --2- 172.21.15.28:0/1196660932 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f05780714c0 0x7f0578136240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:43.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f05777fe640 1 -- 172.21.15.28:0/1196660932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05780b7dd0 msgr2=0x7f057813cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:43.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f05777fe640 1 --2- 172.21.15.28:0/1196660932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05780b7dd0 0x7f057813cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:43.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f05777fe640 1 -- 172.21.15.28:0/1196660932 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c0094d0 con 0x7f05780bc830 2023-11-16T02:29:43.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f05767fc640 1 --2- 172.21.15.28:0/1196660932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05780b7dd0 0x7f057813cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:43.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f0576ffd640 1 --2- 172.21.15.28:0/1196660932 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f05780714c0 0x7f0578136240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:43.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f05777fe640 1 --2- 172.21.15.28:0/1196660932 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05780bc830 0x7f05781e3a60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0570007e70 tx=0x7f057000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:43.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f055f7fe640 1 -- 172.21.15.28:0/1196660932 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0570014620 con 0x7f05780bc830 2023-11-16T02:29:43.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f055f7fe640 1 -- 172.21.15.28:0/1196660932 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05700147a0 con 0x7f05780bc830 2023-11-16T02:29:43.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f055f7fe640 1 -- 172.21.15.28:0/1196660932 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0570014b50 con 0x7f05780bc830 2023-11-16T02:29:43.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f057d594640 1 -- 172.21.15.28:0/1196660932 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057813de20 con 0x7f05780bc830 2023-11-16T02:29:43.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.173+0000 7f057d594640 1 -- 172.21.15.28:0/1196660932 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057813a290 con 0x7f05780bc830 2023-11-16T02:29:43.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.177+0000 7f057d594640 1 -- 172.21.15.28:0/1196660932 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f057804e8a0 con 0x7f05780bc830 2023-11-16T02:29:43.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.177+0000 7f055f7fe640 1 -- 172.21.15.28:0/1196660932 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0570014cb0 con 0x7f05780bc830 2023-11-16T02:29:43.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.177+0000 7f055f7fe640 1 --2- 172.21.15.28:0/1196660932 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0564065a60 0x7f0564067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:43.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.177+0000 7f055f7fe640 1 -- 172.21.15.28:0/1196660932 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0570083a80 con 0x7f05780bc830 2023-11-16T02:29:43.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.177+0000 7f0576ffd640 1 --2- 172.21.15.28:0/1196660932 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0564065a60 0x7f0564067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:43.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.177+0000 7f0576ffd640 1 --2- 172.21.15.28:0/1196660932 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0564065a60 0x7f0564067f20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0568000f70 tx=0x7f0568009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:43.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.181+0000 7f055f7fe640 1 -- 172.21.15.28:0/1196660932 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f05700514d0 con 0x7f05780bc830 2023-11-16T02:29:43.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.333+0000 7f057d594640 1 -- 172.21.15.28:0/1196660932 --> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f05780b81b0 con 0x7f0564065a60 2023-11-16T02:29:43.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.345+0000 7f055f7fe640 1 -- 172.21.15.28:0/1196660932 <== mgr.4104 v2:172.21.15.28:6832/38651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264579 (secure 0 0 0) 0x7f0568001cc0 con 0x7f0564065a60 2023-11-16T02:29:43.352 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:43.354 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-11-16T02:29:43.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.349+0000 7f057d594640 1 -- 172.21.15.28:0/1196660932 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0564065a60 msgr2=0x7f0564067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:43.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.349+0000 7f057d594640 1 --2- 172.21.15.28:0/1196660932 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0564065a60 0x7f0564067f20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0568000f70 tx=0x7f0568009040 comp rx=0 tx=0).stop 2023-11-16T02:29:43.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.349+0000 7f057d594640 1 -- 172.21.15.28:0/1196660932 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05780bc830 msgr2=0x7f05781e3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:43.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.349+0000 7f057d594640 1 --2- 172.21.15.28:0/1196660932 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05780bc830 0x7f05781e3a60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0570007e70 tx=0x7f057000e4b0 comp rx=0 tx=0).stop 2023-11-16T02:29:43.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.349+0000 7f057d594640 1 -- 172.21.15.28:0/1196660932 shutdown_connections 2023-11-16T02:29:43.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.349+0000 7f057d594640 1 --2- 172.21.15.28:0/1196660932 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0564065a60 0x7f0564067f20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:43.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.349+0000 7f057d594640 1 --2- 172.21.15.28:0/1196660932 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05780bc830 0x7f05781e3a60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:43.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.349+0000 7f057d594640 1 --2- 172.21.15.28:0/1196660932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f05780b7dd0 0x7f057813cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:43.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.349+0000 7f057d594640 1 --2- 172.21.15.28:0/1196660932 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f05780714c0 0x7f0578136240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:43.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.349+0000 7f057d594640 1 -- 172.21.15.28:0/1196660932 >> 172.21.15.28:0/1196660932 conn(0x7f05780b9050 msgr2=0x7f057813fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:43.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.349+0000 7f057d594640 1 -- 172.21.15.28:0/1196660932 shutdown_connections 2023-11-16T02:29:43.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:43.349+0000 7f057d594640 1 -- 172.21.15.28:0/1196660932 wait complete. 2023-11-16T02:29:43.375 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-16T02:29:42.417175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":145,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":251288,"kb_used_data":2904,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754723432,"statfs":{"total":773094113280,"available":772836794368,"internally_reserved":0,"allocated":2973696,"data_stored":1770180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":57,"apply_latency_ms":57,"commit_latency_ns":57000000,"apply_latency_ns":57000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.933472"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893446+0000","last_change":"2023-11-16T02:29:37.934110+0000","last_active":"2023-11-16T02:29:39.893446+0000","last_peered":"2023-11-16T02:29:39.893446+0000","last_clean":"2023-11-16T02:29:39.893446+0000","last_became_active":"2023-11-16T02:29:37.933578+0000","last_became_peered":"2023-11-16T02:29:37.933578+0000","last_unstale":"2023-11-16T02:29:39.893446+0000","last_undegraded":"2023-11-16T02:29:39.893446+0000","last_fullsized":"2023-11-16T02:29:39.893446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:40:54.967365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879002+0000","last_change":"2023-11-16T02:29:37.889075+0000","last_active":"2023-11-16T02:29:38.879002+0000","last_peered":"2023-11-16T02:29:38.879002+0000","last_clean":"2023-11-16T02:29:38.879002+0000","last_became_active":"2023-11-16T02:29:37.888736+0000","last_became_peered":"2023-11-16T02:29:37.888736+0000","last_unstale":"2023-11-16T02:29:38.879002+0000","last_undegraded":"2023-11-16T02:29:38.879002+0000","last_fullsized":"2023-11-16T02:29:38.879002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:25:48.005968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892513+0000","last_change":"2023-11-16T02:29:37.888531+0000","last_active":"2023-11-16T02:29:39.892513+0000","last_peered":"2023-11-16T02:29:39.892513+0000","last_clean":"2023-11-16T02:29:39.892513+0000","last_became_active":"2023-11-16T02:29:37.888011+0000","last_became_peered":"2023-11-16T02:29:37.888011+0000","last_unstale":"2023-11-16T02:29:39.892513+0000","last_undegraded":"2023-11-16T02:29:39.892513+0000","last_fullsized":"2023-11-16T02:29:39.892513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:27:01.501132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879881+0000","last_change":"2023-11-16T02:29:37.933231+0000","last_active":"2023-11-16T02:29:38.879881+0000","last_peered":"2023-11-16T02:29:38.879881+0000","last_clean":"2023-11-16T02:29:38.879881+0000","last_became_active":"2023-11-16T02:29:37.932560+0000","last_became_peered":"2023-11-16T02:29:37.932560+0000","last_unstale":"2023-11-16T02:29:38.879881+0000","last_undegraded":"2023-11-16T02:29:38.879881+0000","last_fullsized":"2023-11-16T02:29:38.879881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:40:54.967365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893326+0000","last_change":"2023-11-16T02:29:37.924836+0000","last_active":"2023-11-16T02:29:39.893326+0000","last_peered":"2023-11-16T02:29:39.893326+0000","last_clean":"2023-11-16T02:29:39.893326+0000","last_became_active":"2023-11-16T02:29:37.923955+0000","last_became_peered":"2023-11-16T02:29:37.923955+0000","last_unstale":"2023-11-16T02:29:39.893326+0000","last_undegraded":"2023-11-16T02:29:39.893326+0000","last_fullsized":"2023-11-16T02:29:39.893326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:16:52.591980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879892+0000","last_change":"2023-11-16T02:29:37.927564+0000","last_active":"2023-11-16T02:29:38.879892+0000","last_peered":"2023-11-16T02:29:38.879892+0000","last_clean":"2023-11-16T02:29:38.879892+0000","last_became_active":"2023-11-16T02:29:37.925508+0000","last_became_peered":"2023-11-16T02:29:37.925508+0000","last_unstale":"2023-11-16T02:29:38.879892+0000","last_undegraded":"2023-11-16T02:29:38.879892+0000","last_fullsized":"2023-11-16T02:29:38.879892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:53:52.129290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892495+0000","last_change":"2023-11-16T02:29:37.908302+0000","last_active":"2023-11-16T02:29:39.892495+0000","last_peered":"2023-11-16T02:29:39.892495+0000","last_clean":"2023-11-16T02:29:39.892495+0000","last_became_active":"2023-11-16T02:29:37.907469+0000","last_became_peered":"2023-11-16T02:29:37.907469+0000","last_unstale":"2023-11-16T02:29:39.892495+0000","last_undegraded":"2023-11-16T02:29:39.892495+0000","last_fullsized":"2023-11-16T02:29:39.892495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:30:42.074843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891934+0000","last_change":"2023-11-16T02:29:37.936720+0000","last_active":"2023-11-16T02:29:39.891934+0000","last_peered":"2023-11-16T02:29:39.891934+0000","last_clean":"2023-11-16T02:29:39.891934+0000","last_became_active":"2023-11-16T02:29:37.936424+0000","last_became_peered":"2023-11-16T02:29:37.936424+0000","last_unstale":"2023-11-16T02:29:39.891934+0000","last_undegraded":"2023-11-16T02:29:39.891934+0000","last_fullsized":"2023-11-16T02:29:39.891934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:53:52.129290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893619+0000","last_change":"2023-11-16T02:29:37.941366+0000","last_active":"2023-11-16T02:29:39.893619+0000","last_peered":"2023-11-16T02:29:39.893619+0000","last_clean":"2023-11-16T02:29:39.893619+0000","last_became_active":"2023-11-16T02:29:37.940672+0000","last_became_peered":"2023-11-16T02:29:37.940672+0000","last_unstale":"2023-11-16T02:29:39.893619+0000","last_undegraded":"2023-11-16T02:29:39.893619+0000","last_fullsized":"2023-11-16T02:29:39.893619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:45:26.924071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881259+0000","last_change":"2023-11-16T02:29:37.925689+0000","last_active":"2023-11-16T02:29:38.881259+0000","last_peered":"2023-11-16T02:29:38.881259+0000","last_clean":"2023-11-16T02:29:38.881259+0000","last_became_active":"2023-11-16T02:29:37.925132+0000","last_became_peered":"2023-11-16T02:29:37.925132+0000","last_unstale":"2023-11-16T02:29:38.881259+0000","last_undegraded":"2023-11-16T02:29:38.881259+0000","last_fullsized":"2023-11-16T02:29:38.881259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:16:58.785873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880724+0000","last_change":"2023-11-16T02:29:37.927099+0000","last_active":"2023-11-16T02:29:38.880724+0000","last_peered":"2023-11-16T02:29:38.880724+0000","last_clean":"2023-11-16T02:29:38.880724+0000","last_became_active":"2023-11-16T02:29:37.926533+0000","last_became_peered":"2023-11-16T02:29:37.926533+0000","last_unstale":"2023-11-16T02:29:38.880724+0000","last_undegraded":"2023-11-16T02:29:38.880724+0000","last_fullsized":"2023-11-16T02:29:38.880724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:43:20.665096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893022+0000","last_change":"2023-11-16T02:29:37.902388+0000","last_active":"2023-11-16T02:29:39.893022+0000","last_peered":"2023-11-16T02:29:39.893022+0000","last_clean":"2023-11-16T02:29:39.893022+0000","last_became_active":"2023-11-16T02:29:37.901626+0000","last_became_peered":"2023-11-16T02:29:37.901626+0000","last_unstale":"2023-11-16T02:29:39.893022+0000","last_undegraded":"2023-11-16T02:29:39.893022+0000","last_fullsized":"2023-11-16T02:29:39.893022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:09:39.001233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891187+0000","last_change":"2023-11-16T02:29:37.907449+0000","last_active":"2023-11-16T02:29:39.891187+0000","last_peered":"2023-11-16T02:29:39.891187+0000","last_clean":"2023-11-16T02:29:39.891187+0000","last_became_active":"2023-11-16T02:29:37.907166+0000","last_became_peered":"2023-11-16T02:29:37.907166+0000","last_unstale":"2023-11-16T02:29:39.891187+0000","last_undegraded":"2023-11-16T02:29:39.891187+0000","last_fullsized":"2023-11-16T02:29:39.891187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:37:34.233429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891915+0000","last_change":"2023-11-16T02:29:37.892022+0000","last_active":"2023-11-16T02:29:39.891915+0000","last_peered":"2023-11-16T02:29:39.891915+0000","last_clean":"2023-11-16T02:29:39.891915+0000","last_became_active":"2023-11-16T02:29:37.891566+0000","last_became_peered":"2023-11-16T02:29:37.891566+0000","last_unstale":"2023-11-16T02:29:39.891915+0000","last_undegraded":"2023-11-16T02:29:39.891915+0000","last_fullsized":"2023-11-16T02:29:39.891915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:06:12.705211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878687+0000","last_change":"2023-11-16T02:29:37.924750+0000","last_active":"2023-11-16T02:29:38.878687+0000","last_peered":"2023-11-16T02:29:38.878687+0000","last_clean":"2023-11-16T02:29:38.878687+0000","last_became_active":"2023-11-16T02:29:37.924471+0000","last_became_peered":"2023-11-16T02:29:37.924471+0000","last_unstale":"2023-11-16T02:29:38.878687+0000","last_undegraded":"2023-11-16T02:29:38.878687+0000","last_fullsized":"2023-11-16T02:29:38.878687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:43:20.665096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879402+0000","last_change":"2023-11-16T02:29:37.912953+0000","last_active":"2023-11-16T02:29:38.879402+0000","last_peered":"2023-11-16T02:29:38.879402+0000","last_clean":"2023-11-16T02:29:38.879402+0000","last_became_active":"2023-11-16T02:29:37.912132+0000","last_became_peered":"2023-11-16T02:29:37.912132+0000","last_unstale":"2023-11-16T02:29:38.879402+0000","last_undegraded":"2023-11-16T02:29:38.879402+0000","last_fullsized":"2023-11-16T02:29:38.879402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:52:41.161159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.882380+0000","last_change":"2023-11-16T02:29:37.933833+0000","last_active":"2023-11-16T02:29:38.882380+0000","last_peered":"2023-11-16T02:29:38.882380+0000","last_clean":"2023-11-16T02:29:38.882380+0000","last_became_active":"2023-11-16T02:29:37.933117+0000","last_became_peered":"2023-11-16T02:29:37.933117+0000","last_unstale":"2023-11-16T02:29:38.882380+0000","last_undegraded":"2023-11-16T02:29:38.882380+0000","last_fullsized":"2023-11-16T02:29:38.882380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:16:52.591980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930738+0000","last_change":"2023-11-16T02:29:37.890129+0000","last_active":"2023-11-16T02:29:38.930738+0000","last_peered":"2023-11-16T02:29:38.930738+0000","last_clean":"2023-11-16T02:29:38.930738+0000","last_became_active":"2023-11-16T02:29:37.889784+0000","last_became_peered":"2023-11-16T02:29:37.889784+0000","last_unstale":"2023-11-16T02:29:38.930738+0000","last_undegraded":"2023-11-16T02:29:38.930738+0000","last_fullsized":"2023-11-16T02:29:38.930738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:57:07.831898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893749+0000","last_change":"2023-11-16T02:29:37.916610+0000","last_active":"2023-11-16T02:29:39.893749+0000","last_peered":"2023-11-16T02:29:39.893749+0000","last_clean":"2023-11-16T02:29:39.893749+0000","last_became_active":"2023-11-16T02:29:37.915744+0000","last_became_peered":"2023-11-16T02:29:37.915744+0000","last_unstale":"2023-11-16T02:29:39.893749+0000","last_undegraded":"2023-11-16T02:29:39.893749+0000","last_fullsized":"2023-11-16T02:29:39.893749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:39:21.513129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880946+0000","last_change":"2023-11-16T02:29:37.928237+0000","last_active":"2023-11-16T02:29:38.880946+0000","last_peered":"2023-11-16T02:29:38.880946+0000","last_clean":"2023-11-16T02:29:38.880946+0000","last_became_active":"2023-11-16T02:29:37.927434+0000","last_became_peered":"2023-11-16T02:29:37.927434+0000","last_unstale":"2023-11-16T02:29:38.880946+0000","last_undegraded":"2023-11-16T02:29:38.880946+0000","last_fullsized":"2023-11-16T02:29:38.880946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:37:34.233429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891411+0000","last_change":"2023-11-16T02:29:37.919211+0000","last_active":"2023-11-16T02:29:39.891411+0000","last_peered":"2023-11-16T02:29:39.891411+0000","last_clean":"2023-11-16T02:29:39.891411+0000","last_became_active":"2023-11-16T02:29:37.918942+0000","last_became_peered":"2023-11-16T02:29:37.918942+0000","last_unstale":"2023-11-16T02:29:39.891411+0000","last_undegraded":"2023-11-16T02:29:39.891411+0000","last_fullsized":"2023-11-16T02:29:39.891411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:02:14.259774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879910+0000","last_change":"2023-11-16T02:29:37.926517+0000","last_active":"2023-11-16T02:29:38.879910+0000","last_peered":"2023-11-16T02:29:38.879910+0000","last_clean":"2023-11-16T02:29:38.879910+0000","last_became_active":"2023-11-16T02:29:37.924700+0000","last_became_peered":"2023-11-16T02:29:37.924700+0000","last_unstale":"2023-11-16T02:29:38.879910+0000","last_undegraded":"2023-11-16T02:29:38.879910+0000","last_fullsized":"2023-11-16T02:29:38.879910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:39:21.513129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891489+0000","last_change":"2023-11-16T02:29:37.936251+0000","last_active":"2023-11-16T02:29:39.891489+0000","last_peered":"2023-11-16T02:29:39.891489+0000","last_clean":"2023-11-16T02:29:39.891489+0000","last_became_active":"2023-11-16T02:29:37.935980+0000","last_became_peered":"2023-11-16T02:29:37.935980+0000","last_unstale":"2023-11-16T02:29:39.891489+0000","last_undegraded":"2023-11-16T02:29:39.891489+0000","last_fullsized":"2023-11-16T02:29:39.891489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:02:14.259774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879581+0000","last_change":"2023-11-16T02:29:37.929521+0000","last_active":"2023-11-16T02:29:38.879581+0000","last_peered":"2023-11-16T02:29:38.879581+0000","last_clean":"2023-11-16T02:29:38.879581+0000","last_became_active":"2023-11-16T02:29:37.924137+0000","last_became_peered":"2023-11-16T02:29:37.924137+0000","last_unstale":"2023-11-16T02:29:38.879581+0000","last_undegraded":"2023-11-16T02:29:38.879581+0000","last_fullsized":"2023-11-16T02:29:38.879581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:05:26.649663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892396+0000","last_change":"2023-11-16T02:29:37.935340+0000","last_active":"2023-11-16T02:29:39.892396+0000","last_peered":"2023-11-16T02:29:39.892396+0000","last_clean":"2023-11-16T02:29:39.892396+0000","last_became_active":"2023-11-16T02:29:37.934955+0000","last_became_peered":"2023-11-16T02:29:37.934955+0000","last_unstale":"2023-11-16T02:29:39.892396+0000","last_undegraded":"2023-11-16T02:29:39.892396+0000","last_fullsized":"2023-11-16T02:29:39.892396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:10:43.990221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881491+0000","last_change":"2023-11-16T02:29:37.929426+0000","last_active":"2023-11-16T02:29:38.881491+0000","last_peered":"2023-11-16T02:29:38.881491+0000","last_clean":"2023-11-16T02:29:38.881491+0000","last_became_active":"2023-11-16T02:29:37.928780+0000","last_became_peered":"2023-11-16T02:29:37.928780+0000","last_unstale":"2023-11-16T02:29:38.881491+0000","last_undegraded":"2023-11-16T02:29:38.881491+0000","last_fullsized":"2023-11-16T02:29:38.881491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:05:26.649663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878825+0000","last_change":"2023-11-16T02:29:37.893720+0000","last_active":"2023-11-16T02:29:38.878825+0000","last_peered":"2023-11-16T02:29:38.878825+0000","last_clean":"2023-11-16T02:29:38.878825+0000","last_became_active":"2023-11-16T02:29:37.893429+0000","last_became_peered":"2023-11-16T02:29:37.893429+0000","last_unstale":"2023-11-16T02:29:38.878825+0000","last_undegraded":"2023-11-16T02:29:38.878825+0000","last_fullsized":"2023-11-16T02:29:38.878825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T02:48:20.525493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892100+0000","last_change":"2023-11-16T02:29:37.935318+0000","last_active":"2023-11-16T02:29:39.892100+0000","last_peered":"2023-11-16T02:29:39.892100+0000","last_clean":"2023-11-16T02:29:39.892100+0000","last_became_active":"2023-11-16T02:29:37.934951+0000","last_became_peered":"2023-11-16T02:29:37.934951+0000","last_unstale":"2023-11-16T02:29:39.892100+0000","last_undegraded":"2023-11-16T02:29:39.892100+0000","last_fullsized":"2023-11-16T02:29:39.892100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:16:58.785873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891486+0000","last_change":"2023-11-16T02:29:37.894800+0000","last_active":"2023-11-16T02:29:39.891486+0000","last_peered":"2023-11-16T02:29:39.891486+0000","last_clean":"2023-11-16T02:29:39.891486+0000","last_became_active":"2023-11-16T02:29:37.894404+0000","last_became_peered":"2023-11-16T02:29:37.894404+0000","last_unstale":"2023-11-16T02:29:39.891486+0000","last_undegraded":"2023-11-16T02:29:39.891486+0000","last_fullsized":"2023-11-16T02:29:39.891486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:37:34.233429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880139+0000","last_change":"2023-11-16T02:29:37.920827+0000","last_active":"2023-11-16T02:29:38.880139+0000","last_peered":"2023-11-16T02:29:38.880139+0000","last_clean":"2023-11-16T02:29:38.880139+0000","last_became_active":"2023-11-16T02:29:37.911702+0000","last_became_peered":"2023-11-16T02:29:37.911702+0000","last_unstale":"2023-11-16T02:29:38.880139+0000","last_undegraded":"2023-11-16T02:29:38.880139+0000","last_fullsized":"2023-11-16T02:29:38.880139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:46:36.525784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930582+0000","last_change":"2023-11-16T02:29:37.912688+0000","last_active":"2023-11-16T02:29:38.930582+0000","last_peered":"2023-11-16T02:29:38.930582+0000","last_clean":"2023-11-16T02:29:38.930582+0000","last_became_active":"2023-11-16T02:29:37.912482+0000","last_became_peered":"2023-11-16T02:29:37.912482+0000","last_unstale":"2023-11-16T02:29:38.930582+0000","last_undegraded":"2023-11-16T02:29:38.930582+0000","last_fullsized":"2023-11-16T02:29:38.930582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:36:55.256000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880120+0000","last_change":"2023-11-16T02:29:37.897293+0000","last_active":"2023-11-16T02:29:38.880120+0000","last_peered":"2023-11-16T02:29:38.880120+0000","last_clean":"2023-11-16T02:29:38.880120+0000","last_became_active":"2023-11-16T02:29:37.895087+0000","last_became_peered":"2023-11-16T02:29:37.895087+0000","last_unstale":"2023-11-16T02:29:38.880120+0000","last_undegraded":"2023-11-16T02:29:38.880120+0000","last_fullsized":"2023-11-16T02:29:38.880120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T02:48:20.525493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892526+0000","last_change":"2023-11-16T02:29:37.886782+0000","last_active":"2023-11-16T02:29:39.892526+0000","last_peered":"2023-11-16T02:29:39.892526+0000","last_clean":"2023-11-16T02:29:39.892526+0000","last_became_active":"2023-11-16T02:29:37.885874+0000","last_became_peered":"2023-11-16T02:29:37.885874+0000","last_unstale":"2023-11-16T02:29:39.892526+0000","last_undegraded":"2023-11-16T02:29:39.892526+0000","last_fullsized":"2023-11-16T02:29:39.892526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:21:32.772781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891317+0000","last_change":"2023-11-16T02:29:37.538231+0000","last_active":"2023-11-16T02:29:39.891317+0000","last_peered":"2023-11-16T02:29:39.891317+0000","last_clean":"2023-11-16T02:29:39.891317+0000","last_became_active":"2023-11-16T02:29:37.537831+0000","last_became_peered":"2023-11-16T02:29:37.537831+0000","last_unstale":"2023-11-16T02:29:39.891317+0000","last_undegraded":"2023-11-16T02:29:39.891317+0000","last_fullsized":"2023-11-16T02:29:39.891317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:07:57.498670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891555+0000","last_change":"2023-11-16T02:29:37.928329+0000","last_active":"2023-11-16T02:29:39.891555+0000","last_peered":"2023-11-16T02:29:39.891555+0000","last_clean":"2023-11-16T02:29:39.891555+0000","last_became_active":"2023-11-16T02:29:37.927587+0000","last_became_peered":"2023-11-16T02:29:37.927587+0000","last_unstale":"2023-11-16T02:29:39.891555+0000","last_undegraded":"2023-11-16T02:29:39.891555+0000","last_fullsized":"2023-11-16T02:29:39.891555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:25:48.005968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880624+0000","last_change":"2023-11-16T02:29:37.540421+0000","last_active":"2023-11-16T02:29:38.880624+0000","last_peered":"2023-11-16T02:29:38.880624+0000","last_clean":"2023-11-16T02:29:38.880624+0000","last_became_active":"2023-11-16T02:29:37.539777+0000","last_became_peered":"2023-11-16T02:29:37.539777+0000","last_unstale":"2023-11-16T02:29:38.880624+0000","last_undegraded":"2023-11-16T02:29:38.880624+0000","last_fullsized":"2023-11-16T02:29:38.880624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:07:57.498670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891713+0000","last_change":"2023-11-16T02:29:37.524313+0000","last_active":"2023-11-16T02:29:39.891713+0000","last_peered":"2023-11-16T02:29:39.891713+0000","last_clean":"2023-11-16T02:29:39.891713+0000","last_became_active":"2023-11-16T02:29:37.523846+0000","last_became_peered":"2023-11-16T02:29:37.523846+0000","last_unstale":"2023-11-16T02:29:39.891713+0000","last_undegraded":"2023-11-16T02:29:39.891713+0000","last_fullsized":"2023-11-16T02:29:39.891713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:10:34.206728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892088+0000","last_change":"2023-11-16T02:29:37.885752+0000","last_active":"2023-11-16T02:29:39.892088+0000","last_peered":"2023-11-16T02:29:39.892088+0000","last_clean":"2023-11-16T02:29:39.892088+0000","last_became_active":"2023-11-16T02:29:37.885481+0000","last_became_peered":"2023-11-16T02:29:37.885481+0000","last_unstale":"2023-11-16T02:29:39.892088+0000","last_undegraded":"2023-11-16T02:29:39.892088+0000","last_fullsized":"2023-11-16T02:29:39.892088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:05:12.707357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879852+0000","last_change":"2023-11-16T02:29:37.528549+0000","last_active":"2023-11-16T02:29:38.879852+0000","last_peered":"2023-11-16T02:29:38.879852+0000","last_clean":"2023-11-16T02:29:38.879852+0000","last_became_active":"2023-11-16T02:29:37.527762+0000","last_became_peered":"2023-11-16T02:29:37.527762+0000","last_unstale":"2023-11-16T02:29:38.879852+0000","last_undegraded":"2023-11-16T02:29:38.879852+0000","last_fullsized":"2023-11-16T02:29:38.879852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:45:11.372719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878450+0000","last_change":"2023-11-16T02:29:37.892686+0000","last_active":"2023-11-16T02:29:38.878450+0000","last_peered":"2023-11-16T02:29:38.878450+0000","last_clean":"2023-11-16T02:29:38.878450+0000","last_became_active":"2023-11-16T02:29:37.892384+0000","last_became_peered":"2023-11-16T02:29:37.892384+0000","last_unstale":"2023-11-16T02:29:38.878450+0000","last_undegraded":"2023-11-16T02:29:38.878450+0000","last_fullsized":"2023-11-16T02:29:38.878450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:37:34.233429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880554+0000","last_change":"2023-11-16T02:29:37.545696+0000","last_active":"2023-11-16T02:29:38.880554+0000","last_peered":"2023-11-16T02:29:38.880554+0000","last_clean":"2023-11-16T02:29:38.880554+0000","last_became_active":"2023-11-16T02:29:37.545073+0000","last_became_peered":"2023-11-16T02:29:37.545073+0000","last_unstale":"2023-11-16T02:29:38.880554+0000","last_undegraded":"2023-11-16T02:29:38.880554+0000","last_fullsized":"2023-11-16T02:29:38.880554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:04:23.421210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881635+0000","last_change":"2023-11-16T02:29:37.929853+0000","last_active":"2023-11-16T02:29:38.881635+0000","last_peered":"2023-11-16T02:29:38.881635+0000","last_clean":"2023-11-16T02:29:38.881635+0000","last_became_active":"2023-11-16T02:29:37.929199+0000","last_became_peered":"2023-11-16T02:29:37.929199+0000","last_unstale":"2023-11-16T02:29:38.881635+0000","last_undegraded":"2023-11-16T02:29:38.881635+0000","last_fullsized":"2023-11-16T02:29:38.881635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:30:42.074843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881944+0000","last_change":"2023-11-16T02:29:37.537469+0000","last_active":"2023-11-16T02:29:38.881944+0000","last_peered":"2023-11-16T02:29:38.881944+0000","last_clean":"2023-11-16T02:29:38.881944+0000","last_became_active":"2023-11-16T02:29:37.536939+0000","last_became_peered":"2023-11-16T02:29:37.536939+0000","last_unstale":"2023-11-16T02:29:38.881944+0000","last_undegraded":"2023-11-16T02:29:38.881944+0000","last_fullsized":"2023-11-16T02:29:38.881944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:42:27.512040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891189+0000","last_change":"2023-11-16T02:29:37.928255+0000","last_active":"2023-11-16T02:29:39.891189+0000","last_peered":"2023-11-16T02:29:39.891189+0000","last_clean":"2023-11-16T02:29:39.891189+0000","last_became_active":"2023-11-16T02:29:37.927823+0000","last_became_peered":"2023-11-16T02:29:37.927823+0000","last_unstale":"2023-11-16T02:29:39.891189+0000","last_undegraded":"2023-11-16T02:29:39.891189+0000","last_fullsized":"2023-11-16T02:29:39.891189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:16:58.785873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878823+0000","last_change":"2023-11-16T02:29:37.538934+0000","last_active":"2023-11-16T02:29:38.878823+0000","last_peered":"2023-11-16T02:29:38.878823+0000","last_clean":"2023-11-16T02:29:38.878823+0000","last_became_active":"2023-11-16T02:29:37.538493+0000","last_became_peered":"2023-11-16T02:29:37.538493+0000","last_unstale":"2023-11-16T02:29:38.878823+0000","last_undegraded":"2023-11-16T02:29:38.878823+0000","last_fullsized":"2023-11-16T02:29:38.878823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:38:57.277934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893023+0000","last_change":"2023-11-16T02:29:37.919752+0000","last_active":"2023-11-16T02:29:39.893023+0000","last_peered":"2023-11-16T02:29:39.893023+0000","last_clean":"2023-11-16T02:29:39.893023+0000","last_became_active":"2023-11-16T02:29:37.919021+0000","last_became_peered":"2023-11-16T02:29:37.919021+0000","last_unstale":"2023-11-16T02:29:39.893023+0000","last_undegraded":"2023-11-16T02:29:39.893023+0000","last_fullsized":"2023-11-16T02:29:39.893023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:38:58.288279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881202+0000","last_change":"2023-11-16T02:29:37.512625+0000","last_active":"2023-11-16T02:29:38.881202+0000","last_peered":"2023-11-16T02:29:38.881202+0000","last_clean":"2023-11-16T02:29:38.881202+0000","last_became_active":"2023-11-16T02:29:37.511862+0000","last_became_peered":"2023-11-16T02:29:37.511862+0000","last_unstale":"2023-11-16T02:29:38.881202+0000","last_undegraded":"2023-11-16T02:29:38.881202+0000","last_fullsized":"2023-11-16T02:29:38.881202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:45:11.372719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893382+0000","last_change":"2023-11-16T02:29:37.907846+0000","last_active":"2023-11-16T02:29:39.893382+0000","last_peered":"2023-11-16T02:29:39.893382+0000","last_clean":"2023-11-16T02:29:39.893382+0000","last_became_active":"2023-11-16T02:29:37.906680+0000","last_became_peered":"2023-11-16T02:29:37.906680+0000","last_unstale":"2023-11-16T02:29:39.893382+0000","last_undegraded":"2023-11-16T02:29:39.893382+0000","last_fullsized":"2023-11-16T02:29:39.893382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:46:36.525784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891620+0000","last_change":"2023-11-16T02:29:37.516156+0000","last_active":"2023-11-16T02:29:39.891620+0000","last_peered":"2023-11-16T02:29:39.891620+0000","last_clean":"2023-11-16T02:29:39.891620+0000","last_became_active":"2023-11-16T02:29:37.508947+0000","last_became_peered":"2023-11-16T02:29:37.508947+0000","last_unstale":"2023-11-16T02:29:39.891620+0000","last_undegraded":"2023-11-16T02:29:39.891620+0000","last_fullsized":"2023-11-16T02:29:39.891620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:28:03.017758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892055+0000","last_change":"2023-11-16T02:29:37.917898+0000","last_active":"2023-11-16T02:29:39.892055+0000","last_peered":"2023-11-16T02:29:39.892055+0000","last_clean":"2023-11-16T02:29:39.892055+0000","last_became_active":"2023-11-16T02:29:37.917588+0000","last_became_peered":"2023-11-16T02:29:37.917588+0000","last_unstale":"2023-11-16T02:29:39.892055+0000","last_undegraded":"2023-11-16T02:29:39.892055+0000","last_fullsized":"2023-11-16T02:29:39.892055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:43:20.665096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880128+0000","last_change":"2023-11-16T02:29:37.535755+0000","last_active":"2023-11-16T02:29:38.880128+0000","last_peered":"2023-11-16T02:29:38.880128+0000","last_clean":"2023-11-16T02:29:38.880128+0000","last_became_active":"2023-11-16T02:29:37.535030+0000","last_became_peered":"2023-11-16T02:29:37.535030+0000","last_unstale":"2023-11-16T02:29:38.880128+0000","last_undegraded":"2023-11-16T02:29:38.880128+0000","last_fullsized":"2023-11-16T02:29:38.880128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:10:34.206728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893470+0000","last_change":"2023-11-16T02:29:37.943232+0000","last_active":"2023-11-16T02:29:39.893470+0000","last_peered":"2023-11-16T02:29:39.893470+0000","last_clean":"2023-11-16T02:29:39.893470+0000","last_became_active":"2023-11-16T02:29:37.942561+0000","last_became_peered":"2023-11-16T02:29:37.942561+0000","last_unstale":"2023-11-16T02:29:39.893470+0000","last_undegraded":"2023-11-16T02:29:39.893470+0000","last_fullsized":"2023-11-16T02:29:39.893470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:06:38.108558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880346+0000","last_change":"2023-11-16T02:29:37.540351+0000","last_active":"2023-11-16T02:29:38.880346+0000","last_peered":"2023-11-16T02:29:38.880346+0000","last_clean":"2023-11-16T02:29:38.880346+0000","last_became_active":"2023-11-16T02:29:37.539672+0000","last_became_peered":"2023-11-16T02:29:37.539672+0000","last_unstale":"2023-11-16T02:29:38.880346+0000","last_undegraded":"2023-11-16T02:29:38.880346+0000","last_fullsized":"2023-11-16T02:29:38.880346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:57:02.655084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880380+0000","last_change":"2023-11-16T02:29:37.898389+0000","last_active":"2023-11-16T02:29:38.880380+0000","last_peered":"2023-11-16T02:29:38.880380+0000","last_clean":"2023-11-16T02:29:38.880380+0000","last_became_active":"2023-11-16T02:29:37.896101+0000","last_became_peered":"2023-11-16T02:29:37.896101+0000","last_unstale":"2023-11-16T02:29:38.880380+0000","last_undegraded":"2023-11-16T02:29:38.880380+0000","last_fullsized":"2023-11-16T02:29:38.880380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:27:01.501132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930434+0000","last_change":"2023-11-16T02:29:37.507129+0000","last_active":"2023-11-16T02:29:38.930434+0000","last_peered":"2023-11-16T02:29:38.930434+0000","last_clean":"2023-11-16T02:29:38.930434+0000","last_became_active":"2023-11-16T02:29:37.506617+0000","last_became_peered":"2023-11-16T02:29:37.506617+0000","last_unstale":"2023-11-16T02:29:38.930434+0000","last_undegraded":"2023-11-16T02:29:38.930434+0000","last_fullsized":"2023-11-16T02:29:38.930434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T09:52:00.933962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892753+0000","last_change":"2023-11-16T02:29:37.936934+0000","last_active":"2023-11-16T02:29:39.892753+0000","last_peered":"2023-11-16T02:29:39.892753+0000","last_clean":"2023-11-16T02:29:39.892753+0000","last_became_active":"2023-11-16T02:29:37.936330+0000","last_became_peered":"2023-11-16T02:29:37.936330+0000","last_unstale":"2023-11-16T02:29:39.892753+0000","last_undegraded":"2023-11-16T02:29:39.892753+0000","last_fullsized":"2023-11-16T02:29:39.892753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:10:43.990221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893035+0000","last_change":"2023-11-16T02:29:37.522370+0000","last_active":"2023-11-16T02:29:39.893035+0000","last_peered":"2023-11-16T02:29:39.893035+0000","last_clean":"2023-11-16T02:29:39.893035+0000","last_became_active":"2023-11-16T02:29:37.521575+0000","last_became_peered":"2023-11-16T02:29:37.521575+0000","last_unstale":"2023-11-16T02:29:39.893035+0000","last_undegraded":"2023-11-16T02:29:39.893035+0000","last_fullsized":"2023-11-16T02:29:39.893035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:59:52.538150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.894051+0000","last_change":"2023-11-16T02:29:37.936845+0000","last_active":"2023-11-16T02:29:39.894051+0000","last_peered":"2023-11-16T02:29:39.894051+0000","last_clean":"2023-11-16T02:29:39.894051+0000","last_became_active":"2023-11-16T02:29:37.936190+0000","last_became_peered":"2023-11-16T02:29:37.936190+0000","last_unstale":"2023-11-16T02:29:39.894051+0000","last_undegraded":"2023-11-16T02:29:39.894051+0000","last_fullsized":"2023-11-16T02:29:39.894051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:02:14.259774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930772+0000","last_change":"2023-11-16T02:29:37.513345+0000","last_active":"2023-11-16T02:29:38.930772+0000","last_peered":"2023-11-16T02:29:38.930772+0000","last_clean":"2023-11-16T02:29:38.930772+0000","last_became_active":"2023-11-16T02:29:37.512642+0000","last_became_peered":"2023-11-16T02:29:37.512642+0000","last_unstale":"2023-11-16T02:29:38.930772+0000","last_undegraded":"2023-11-16T02:29:38.930772+0000","last_fullsized":"2023-11-16T02:29:38.930772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:03:19.516009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893760+0000","last_change":"2023-11-16T02:29:37.938095+0000","last_active":"2023-11-16T02:29:39.893760+0000","last_peered":"2023-11-16T02:29:39.893760+0000","last_clean":"2023-11-16T02:29:39.893760+0000","last_became_active":"2023-11-16T02:29:37.937531+0000","last_became_peered":"2023-11-16T02:29:37.937531+0000","last_unstale":"2023-11-16T02:29:39.893760+0000","last_undegraded":"2023-11-16T02:29:39.893760+0000","last_fullsized":"2023-11-16T02:29:39.893760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:53:52.129290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878918+0000","last_change":"2023-11-16T02:29:37.519277+0000","last_active":"2023-11-16T02:29:38.878918+0000","last_peered":"2023-11-16T02:29:38.878918+0000","last_clean":"2023-11-16T02:29:38.878918+0000","last_became_active":"2023-11-16T02:29:37.518833+0000","last_became_peered":"2023-11-16T02:29:37.518833+0000","last_unstale":"2023-11-16T02:29:38.878918+0000","last_undegraded":"2023-11-16T02:29:38.878918+0000","last_fullsized":"2023-11-16T02:29:38.878918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:04:23.421210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881516+0000","last_change":"2023-11-16T02:29:37.916444+0000","last_active":"2023-11-16T02:29:38.881516+0000","last_peered":"2023-11-16T02:29:38.881516+0000","last_clean":"2023-11-16T02:29:38.881516+0000","last_became_active":"2023-11-16T02:29:37.915697+0000","last_became_peered":"2023-11-16T02:29:37.915697+0000","last_unstale":"2023-11-16T02:29:38.881516+0000","last_undegraded":"2023-11-16T02:29:38.881516+0000","last_fullsized":"2023-11-16T02:29:38.881516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:02:14.259774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930777+0000","last_change":"2023-11-16T02:29:37.544475+0000","last_active":"2023-11-16T02:29:38.930777+0000","last_peered":"2023-11-16T02:29:38.930777+0000","last_clean":"2023-11-16T02:29:38.930777+0000","last_became_active":"2023-11-16T02:29:37.544180+0000","last_became_peered":"2023-11-16T02:29:37.544180+0000","last_unstale":"2023-11-16T02:29:38.930777+0000","last_undegraded":"2023-11-16T02:29:38.930777+0000","last_fullsized":"2023-11-16T02:29:38.930777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:24:09.474240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893476+0000","last_change":"2023-11-16T02:29:37.934969+0000","last_active":"2023-11-16T02:29:39.893476+0000","last_peered":"2023-11-16T02:29:39.893476+0000","last_clean":"2023-11-16T02:29:39.893476+0000","last_became_active":"2023-11-16T02:29:37.934382+0000","last_became_peered":"2023-11-16T02:29:37.934382+0000","last_unstale":"2023-11-16T02:29:39.893476+0000","last_undegraded":"2023-11-16T02:29:39.893476+0000","last_fullsized":"2023-11-16T02:29:39.893476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:57:50.326734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":164,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-16T02:29:37.908728+0000","last_change":"2023-11-16T02:29:27.538359+0000","last_active":"2023-11-16T02:29:37.908728+0000","last_peered":"2023-11-16T02:29:37.908728+0000","last_clean":"2023-11-16T02:29:37.908728+0000","last_became_active":"2023-11-16T02:29:27.536606+0000","last_became_peered":"2023-11-16T02:29:27.536606+0000","last_unstale":"2023-11-16T02:29:37.908728+0000","last_undegraded":"2023-11-16T02:29:37.908728+0000","last_fullsized":"2023-11-16T02:29:37.908728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:26.491990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:26.491990+0000","last_clean_scrub_stamp":"2023-11-16T02:29:26.491990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:29:40.434297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879779+0000","last_change":"2023-11-16T02:29:37.529226+0000","last_active":"2023-11-16T02:29:38.879779+0000","last_peered":"2023-11-16T02:29:38.879779+0000","last_clean":"2023-11-16T02:29:38.879779+0000","last_became_active":"2023-11-16T02:29:37.528419+0000","last_became_peered":"2023-11-16T02:29:37.528419+0000","last_unstale":"2023-11-16T02:29:38.879779+0000","last_undegraded":"2023-11-16T02:29:38.879779+0000","last_fullsized":"2023-11-16T02:29:38.879779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:57:02.655084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892100+0000","last_change":"2023-11-16T02:29:37.928597+0000","last_active":"2023-11-16T02:29:39.892100+0000","last_peered":"2023-11-16T02:29:39.892100+0000","last_clean":"2023-11-16T02:29:39.892100+0000","last_became_active":"2023-11-16T02:29:37.928277+0000","last_became_peered":"2023-11-16T02:29:37.928277+0000","last_unstale":"2023-11-16T02:29:39.892100+0000","last_undegraded":"2023-11-16T02:29:39.892100+0000","last_fullsized":"2023-11-16T02:29:39.892100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:46:36.525784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892334+0000","last_change":"2023-11-16T02:29:37.540168+0000","last_active":"2023-11-16T02:29:39.892334+0000","last_peered":"2023-11-16T02:29:39.892334+0000","last_clean":"2023-11-16T02:29:39.892334+0000","last_became_active":"2023-11-16T02:29:37.539604+0000","last_became_peered":"2023-11-16T02:29:37.539604+0000","last_unstale":"2023-11-16T02:29:39.892334+0000","last_undegraded":"2023-11-16T02:29:39.892334+0000","last_fullsized":"2023-11-16T02:29:39.892334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:45:11.372719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.890863+0000","last_change":"2023-11-16T02:29:37.928646+0000","last_active":"2023-11-16T02:29:39.890863+0000","last_peered":"2023-11-16T02:29:39.890863+0000","last_clean":"2023-11-16T02:29:39.890863+0000","last_became_active":"2023-11-16T02:29:37.927520+0000","last_became_peered":"2023-11-16T02:29:37.927520+0000","last_unstale":"2023-11-16T02:29:39.890863+0000","last_undegraded":"2023-11-16T02:29:39.890863+0000","last_fullsized":"2023-11-16T02:29:39.890863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:05:12.707357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930813+0000","last_change":"2023-11-16T02:29:37.508498+0000","last_active":"2023-11-16T02:29:38.930813+0000","last_peered":"2023-11-16T02:29:38.930813+0000","last_clean":"2023-11-16T02:29:38.930813+0000","last_became_active":"2023-11-16T02:29:37.508091+0000","last_became_peered":"2023-11-16T02:29:37.508091+0000","last_unstale":"2023-11-16T02:29:38.930813+0000","last_undegraded":"2023-11-16T02:29:38.930813+0000","last_fullsized":"2023-11-16T02:29:38.930813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:31:57.230585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878450+0000","last_change":"2023-11-16T02:29:37.889506+0000","last_active":"2023-11-16T02:29:38.878450+0000","last_peered":"2023-11-16T02:29:38.878450+0000","last_clean":"2023-11-16T02:29:38.878450+0000","last_became_active":"2023-11-16T02:29:37.884833+0000","last_became_peered":"2023-11-16T02:29:37.884833+0000","last_unstale":"2023-11-16T02:29:38.878450+0000","last_undegraded":"2023-11-16T02:29:38.878450+0000","last_fullsized":"2023-11-16T02:29:38.878450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:05:26.649663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880343+0000","last_change":"2023-11-16T02:29:37.535414+0000","last_active":"2023-11-16T02:29:38.880343+0000","last_peered":"2023-11-16T02:29:38.880343+0000","last_clean":"2023-11-16T02:29:38.880343+0000","last_became_active":"2023-11-16T02:29:37.530060+0000","last_became_peered":"2023-11-16T02:29:37.530060+0000","last_unstale":"2023-11-16T02:29:38.880343+0000","last_undegraded":"2023-11-16T02:29:38.880343+0000","last_fullsized":"2023-11-16T02:29:38.880343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:07:57.498670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.894166+0000","last_change":"2023-11-16T02:29:37.900850+0000","last_active":"2023-11-16T02:29:39.894166+0000","last_peered":"2023-11-16T02:29:39.894166+0000","last_clean":"2023-11-16T02:29:39.894166+0000","last_became_active":"2023-11-16T02:29:37.896204+0000","last_became_peered":"2023-11-16T02:29:37.896204+0000","last_unstale":"2023-11-16T02:29:39.894166+0000","last_undegraded":"2023-11-16T02:29:39.894166+0000","last_fullsized":"2023-11-16T02:29:39.894166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:04:24.431554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878831+0000","last_change":"2023-11-16T02:29:37.515012+0000","last_active":"2023-11-16T02:29:38.878831+0000","last_peered":"2023-11-16T02:29:38.878831+0000","last_clean":"2023-11-16T02:29:38.878831+0000","last_became_active":"2023-11-16T02:29:37.514528+0000","last_became_peered":"2023-11-16T02:29:37.514528+0000","last_unstale":"2023-11-16T02:29:38.878831+0000","last_undegraded":"2023-11-16T02:29:38.878831+0000","last_fullsized":"2023-11-16T02:29:38.878831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:07:57.498670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881961+0000","last_change":"2023-11-16T02:29:37.925316+0000","last_active":"2023-11-16T02:29:38.881961+0000","last_peered":"2023-11-16T02:29:38.881961+0000","last_clean":"2023-11-16T02:29:38.881961+0000","last_became_active":"2023-11-16T02:29:37.924267+0000","last_became_peered":"2023-11-16T02:29:37.924267+0000","last_unstale":"2023-11-16T02:29:38.881961+0000","last_undegraded":"2023-11-16T02:29:38.881961+0000","last_fullsized":"2023-11-16T02:29:38.881961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:06:38.108558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893826+0000","last_change":"2023-11-16T02:29:37.544869+0000","last_active":"2023-11-16T02:29:39.893826+0000","last_peered":"2023-11-16T02:29:39.893826+0000","last_clean":"2023-11-16T02:29:39.893826+0000","last_became_active":"2023-11-16T02:29:37.544275+0000","last_became_peered":"2023-11-16T02:29:37.544275+0000","last_unstale":"2023-11-16T02:29:39.893826+0000","last_undegraded":"2023-11-16T02:29:39.893826+0000","last_fullsized":"2023-11-16T02:29:39.893826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:38:57.277934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878700+0000","last_change":"2023-11-16T02:29:37.884651+0000","last_active":"2023-11-16T02:29:38.878700+0000","last_peered":"2023-11-16T02:29:38.878700+0000","last_clean":"2023-11-16T02:29:38.878700+0000","last_became_active":"2023-11-16T02:29:37.884251+0000","last_became_peered":"2023-11-16T02:29:37.884251+0000","last_unstale":"2023-11-16T02:29:38.878700+0000","last_undegraded":"2023-11-16T02:29:38.878700+0000","last_fullsized":"2023-11-16T02:29:38.878700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:09:55.065210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879054+0000","last_change":"2023-11-16T02:29:37.518697+0000","last_active":"2023-11-16T02:29:38.879054+0000","last_peered":"2023-11-16T02:29:38.879054+0000","last_clean":"2023-11-16T02:29:38.879054+0000","last_became_active":"2023-11-16T02:29:37.518275+0000","last_became_peered":"2023-11-16T02:29:37.518275+0000","last_unstale":"2023-11-16T02:29:38.879054+0000","last_undegraded":"2023-11-16T02:29:38.879054+0000","last_fullsized":"2023-11-16T02:29:38.879054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:45:11.372719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892472+0000","last_change":"2023-11-16T02:29:37.928232+0000","last_active":"2023-11-16T02:29:39.892472+0000","last_peered":"2023-11-16T02:29:39.892472+0000","last_clean":"2023-11-16T02:29:39.892472+0000","last_became_active":"2023-11-16T02:29:37.927841+0000","last_became_peered":"2023-11-16T02:29:37.927841+0000","last_unstale":"2023-11-16T02:29:39.892472+0000","last_undegraded":"2023-11-16T02:29:39.892472+0000","last_fullsized":"2023-11-16T02:29:39.892472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:06:38.108558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880867+0000","last_change":"2023-11-16T02:29:37.533118+0000","last_active":"2023-11-16T02:29:38.880867+0000","last_peered":"2023-11-16T02:29:38.880867+0000","last_clean":"2023-11-16T02:29:38.880867+0000","last_became_active":"2023-11-16T02:29:37.532348+0000","last_became_peered":"2023-11-16T02:29:37.532348+0000","last_unstale":"2023-11-16T02:29:38.880867+0000","last_undegraded":"2023-11-16T02:29:38.880867+0000","last_fullsized":"2023-11-16T02:29:38.880867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:42:27.512040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891116+0000","last_change":"2023-11-16T02:29:37.892758+0000","last_active":"2023-11-16T02:29:39.891116+0000","last_peered":"2023-11-16T02:29:39.891116+0000","last_clean":"2023-11-16T02:29:39.891116+0000","last_became_active":"2023-11-16T02:29:37.892403+0000","last_became_peered":"2023-11-16T02:29:37.892403+0000","last_unstale":"2023-11-16T02:29:39.891116+0000","last_undegraded":"2023-11-16T02:29:39.891116+0000","last_fullsized":"2023-11-16T02:29:39.891116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T02:37:34.677034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892115+0000","last_change":"2023-11-16T02:29:37.539865+0000","last_active":"2023-11-16T02:29:39.892115+0000","last_peered":"2023-11-16T02:29:39.892115+0000","last_clean":"2023-11-16T02:29:39.892115+0000","last_became_active":"2023-11-16T02:29:37.538829+0000","last_became_peered":"2023-11-16T02:29:37.538829+0000","last_unstale":"2023-11-16T02:29:39.892115+0000","last_undegraded":"2023-11-16T02:29:39.892115+0000","last_fullsized":"2023-11-16T02:29:39.892115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:09:37.990889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892445+0000","last_change":"2023-11-16T02:29:37.924136+0000","last_active":"2023-11-16T02:29:39.892445+0000","last_peered":"2023-11-16T02:29:39.892445+0000","last_clean":"2023-11-16T02:29:39.892445+0000","last_became_active":"2023-11-16T02:29:37.922911+0000","last_became_peered":"2023-11-16T02:29:37.922911+0000","last_unstale":"2023-11-16T02:29:39.892445+0000","last_undegraded":"2023-11-16T02:29:39.892445+0000","last_fullsized":"2023-11-16T02:29:39.892445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:45:12.383063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878567+0000","last_change":"2023-11-16T02:29:37.530829+0000","last_active":"2023-11-16T02:29:38.878567+0000","last_peered":"2023-11-16T02:29:38.878567+0000","last_clean":"2023-11-16T02:29:38.878567+0000","last_became_active":"2023-11-16T02:29:37.530464+0000","last_became_peered":"2023-11-16T02:29:37.530464+0000","last_unstale":"2023-11-16T02:29:38.878567+0000","last_undegraded":"2023-11-16T02:29:38.878567+0000","last_fullsized":"2023-11-16T02:29:38.878567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:42:27.512040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892249+0000","last_change":"2023-11-16T02:29:37.886780+0000","last_active":"2023-11-16T02:29:39.892249+0000","last_peered":"2023-11-16T02:29:39.892249+0000","last_clean":"2023-11-16T02:29:39.892249+0000","last_became_active":"2023-11-16T02:29:37.885971+0000","last_became_peered":"2023-11-16T02:29:37.885971+0000","last_unstale":"2023-11-16T02:29:39.892249+0000","last_undegraded":"2023-11-16T02:29:39.892249+0000","last_fullsized":"2023-11-16T02:29:39.892249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:09:55.065210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878991+0000","last_change":"2023-11-16T02:29:37.518075+0000","last_active":"2023-11-16T02:29:38.878991+0000","last_peered":"2023-11-16T02:29:38.878991+0000","last_clean":"2023-11-16T02:29:38.878991+0000","last_became_active":"2023-11-16T02:29:37.517639+0000","last_became_peered":"2023-11-16T02:29:37.517639+0000","last_unstale":"2023-11-16T02:29:38.878991+0000","last_undegraded":"2023-11-16T02:29:38.878991+0000","last_fullsized":"2023-11-16T02:29:38.878991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:57:02.655084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891316+0000","last_change":"2023-11-16T02:29:37.895705+0000","last_active":"2023-11-16T02:29:39.891316+0000","last_peered":"2023-11-16T02:29:39.891316+0000","last_clean":"2023-11-16T02:29:39.891316+0000","last_became_active":"2023-11-16T02:29:37.895416+0000","last_became_peered":"2023-11-16T02:29:37.895416+0000","last_unstale":"2023-11-16T02:29:39.891316+0000","last_undegraded":"2023-11-16T02:29:39.891316+0000","last_fullsized":"2023-11-16T02:29:39.891316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:43:20.665096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893707+0000","last_change":"2023-11-16T02:29:37.544189+0000","last_active":"2023-11-16T02:29:39.893707+0000","last_peered":"2023-11-16T02:29:39.893707+0000","last_clean":"2023-11-16T02:29:39.893707+0000","last_became_active":"2023-11-16T02:29:37.543571+0000","last_became_peered":"2023-11-16T02:29:37.543571+0000","last_unstale":"2023-11-16T02:29:39.893707+0000","last_undegraded":"2023-11-16T02:29:39.893707+0000","last_fullsized":"2023-11-16T02:29:39.893707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:07:57.498670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880376+0000","last_change":"2023-11-16T02:29:37.928251+0000","last_active":"2023-11-16T02:29:38.880376+0000","last_peered":"2023-11-16T02:29:38.880376+0000","last_clean":"2023-11-16T02:29:38.880376+0000","last_became_active":"2023-11-16T02:29:37.927716+0000","last_became_peered":"2023-11-16T02:29:37.927716+0000","last_unstale":"2023-11-16T02:29:38.880376+0000","last_undegraded":"2023-11-16T02:29:38.880376+0000","last_fullsized":"2023-11-16T02:29:38.880376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:25:48.005968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881803+0000","last_change":"2023-11-16T02:29:37.939219+0000","last_active":"2023-11-16T02:29:38.881803+0000","last_peered":"2023-11-16T02:29:38.881803+0000","last_clean":"2023-11-16T02:29:38.881803+0000","last_became_active":"2023-11-16T02:29:37.938582+0000","last_became_peered":"2023-11-16T02:29:37.938582+0000","last_unstale":"2023-11-16T02:29:38.881803+0000","last_undegraded":"2023-11-16T02:29:38.881803+0000","last_fullsized":"2023-11-16T02:29:38.881803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:43:20.665096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893385+0000","last_change":"2023-11-16T02:29:37.549085+0000","last_active":"2023-11-16T02:29:39.893385+0000","last_peered":"2023-11-16T02:29:39.893385+0000","last_clean":"2023-11-16T02:29:39.893385+0000","last_became_active":"2023-11-16T02:29:37.548532+0000","last_became_peered":"2023-11-16T02:29:37.548532+0000","last_unstale":"2023-11-16T02:29:39.893385+0000","last_undegraded":"2023-11-16T02:29:39.893385+0000","last_fullsized":"2023-11-16T02:29:39.893385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:21:31.762437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881938+0000","last_change":"2023-11-16T02:29:37.936750+0000","last_active":"2023-11-16T02:29:38.881938+0000","last_peered":"2023-11-16T02:29:38.881938+0000","last_clean":"2023-11-16T02:29:38.881938+0000","last_became_active":"2023-11-16T02:29:37.936169+0000","last_became_peered":"2023-11-16T02:29:37.936169+0000","last_unstale":"2023-11-16T02:29:38.881938+0000","last_undegraded":"2023-11-16T02:29:38.881938+0000","last_fullsized":"2023-11-16T02:29:38.881938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:10:43.990221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893640+0000","last_change":"2023-11-16T02:29:37.543752+0000","last_active":"2023-11-16T02:29:39.893640+0000","last_peered":"2023-11-16T02:29:39.893640+0000","last_clean":"2023-11-16T02:29:39.893640+0000","last_became_active":"2023-11-16T02:29:37.543157+0000","last_became_peered":"2023-11-16T02:29:37.543157+0000","last_unstale":"2023-11-16T02:29:39.893640+0000","last_undegraded":"2023-11-16T02:29:39.893640+0000","last_fullsized":"2023-11-16T02:29:39.893640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:04:23.421210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891041+0000","last_change":"2023-11-16T02:29:37.928390+0000","last_active":"2023-11-16T02:29:39.891041+0000","last_peered":"2023-11-16T02:29:39.891041+0000","last_clean":"2023-11-16T02:29:39.891041+0000","last_became_active":"2023-11-16T02:29:37.928152+0000","last_became_peered":"2023-11-16T02:29:37.928152+0000","last_unstale":"2023-11-16T02:29:39.891041+0000","last_undegraded":"2023-11-16T02:29:39.891041+0000","last_fullsized":"2023-11-16T02:29:39.891041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:10:43.990221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891480+0000","last_change":"2023-11-16T02:29:37.516960+0000","last_active":"2023-11-16T02:29:39.891480+0000","last_peered":"2023-11-16T02:29:39.891480+0000","last_clean":"2023-11-16T02:29:39.891480+0000","last_became_active":"2023-11-16T02:29:37.516030+0000","last_became_peered":"2023-11-16T02:29:37.516030+0000","last_unstale":"2023-11-16T02:29:39.891480+0000","last_undegraded":"2023-11-16T02:29:39.891480+0000","last_fullsized":"2023-11-16T02:29:39.891480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:44:21.321181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891358+0000","last_change":"2023-11-16T02:29:37.909668+0000","last_active":"2023-11-16T02:29:39.891358+0000","last_peered":"2023-11-16T02:29:39.891358+0000","last_clean":"2023-11-16T02:29:39.891358+0000","last_became_active":"2023-11-16T02:29:37.909339+0000","last_became_peered":"2023-11-16T02:29:37.909339+0000","last_unstale":"2023-11-16T02:29:39.891358+0000","last_undegraded":"2023-11-16T02:29:39.891358+0000","last_fullsized":"2023-11-16T02:29:39.891358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:25:48.005968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891428+0000","last_change":"2023-11-16T02:29:37.537280+0000","last_active":"2023-11-16T02:29:39.891428+0000","last_peered":"2023-11-16T02:29:39.891428+0000","last_clean":"2023-11-16T02:29:39.891428+0000","last_became_active":"2023-11-16T02:29:37.536813+0000","last_became_peered":"2023-11-16T02:29:37.536813+0000","last_unstale":"2023-11-16T02:29:39.891428+0000","last_undegraded":"2023-11-16T02:29:39.891428+0000","last_fullsized":"2023-11-16T02:29:39.891428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:44:21.321181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":660890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31276,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340564,"statfs":{"total":96636764160,"available":96604737536,"internally_reserved":0,"allocated":233472,"data_stored":77804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]}]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31268,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340572,"statfs":{"total":96636764160,"available":96604745728,"internally_reserved":0,"allocated":225280,"data_stored":76330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]}]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31264,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340576,"statfs":{"total":96636764160,"available":96604749824,"internally_reserved":0,"allocated":221184,"data_stored":70066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]}]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31264,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340576,"statfs":{"total":96636764160,"available":96604749824,"internally_reserved":0,"allocated":221184,"data_stored":71504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31272,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340568,"statfs":{"total":96636764160,"available":96604741632,"internally_reserved":0,"allocated":229376,"data_stored":76400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":815104,"data_stored":660946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31264,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340576,"statfs":{"total":96636764160,"available":96604749824,"internally_reserved":0,"allocated":221184,"data_stored":76240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-16T02:29:46.381 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-16T02:29:46.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.513+0000 7f3c7d66b640 1 Processor -- start 2023-11-16T02:29:46.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.513+0000 7f3c7d66b640 1 -- start start 2023-11-16T02:29:46.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.513+0000 7f3c7d66b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3c780b89d0 0x7f3c78141180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:46.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.513+0000 7f3c7d66b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3c781416c0 0x7f3c780bad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:46.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.513+0000 7f3c7d66b640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c780b9ec0 con 0x7f3c780b85f0 2023-11-16T02:29:46.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.513+0000 7f3c7d66b640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c7814b4f0 con 0x7f3c780b89d0 2023-11-16T02:29:46.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.513+0000 7f3c7d66b640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c780b7ee0 con 0x7f3c781416c0 2023-11-16T02:29:46.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.513+0000 7f3c767fc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3c780b89d0 0x7f3c78141180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:46.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.513+0000 7f3c76ffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f3c780b85f0 0x7f3c780b77d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:39704/0 (socket says 172.21.15.28:39704) 2023-11-16T02:29:46.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.513+0000 7f3c767fc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3c780b89d0 0x7f3c78141180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40920/0 (socket says 172.21.15.28:40920) 2023-11-16T02:29:46.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.513+0000 7f3c76ffd640 1 -- 172.21.15.28:0/1717521737 learned_addr learned my addr 172.21.15.28:0/1717521737 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:46.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.513+0000 7f3c777fe640 1 --2- 172.21.15.28:0/1717521737 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3c781416c0 0x7f3c780bad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:46.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.513+0000 7f3c767fc640 1 -- 172.21.15.28:0/1717521737 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3c781416c0 msgr2=0x7f3c780bad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:46.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.513+0000 7f3c767fc640 1 --2- 172.21.15.28:0/1717521737 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3c781416c0 0x7f3c780bad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:46.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.513+0000 7f3c767fc640 1 -- 172.21.15.28:0/1717521737 >> v1:172.21.15.28:6789/0 conn(0x7f3c780b85f0 legacy=0x7f3c780b77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:46.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.513+0000 7f3c767fc640 1 -- 172.21.15.28:0/1717521737 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c780b8e20 con 0x7f3c780b89d0 2023-11-16T02:29:46.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.513+0000 7f3c75ffb640 1 -- 172.21.15.28:0/1717521737 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 971850669 0 0) 0x7f3c780b9ec0 con 0x7f3c780b85f0 2023-11-16T02:29:46.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.517+0000 7f3c767fc640 1 --2- 172.21.15.28:0/1717521737 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c780b89d0 0x7f3c78141180 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c0097f0 tx=0x7f3c6c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49cd19654970d66 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:46.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.517+0000 7f3c75ffb640 1 -- 172.21.15.28:0/1717521737 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c0ab600 con 0x7f3c780b89d0 2023-11-16T02:29:46.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.517+0000 7f3c75ffb640 1 -- 172.21.15.28:0/1717521737 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6c0a7050 con 0x7f3c780b89d0 2023-11-16T02:29:46.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.517+0000 7f3c75ffb640 1 -- 172.21.15.28:0/1717521737 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c0ab980 con 0x7f3c780b89d0 2023-11-16T02:29:46.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.517+0000 7f3c7d66b640 1 -- 172.21.15.28:0/1717521737 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c780b89d0 msgr2=0x7f3c78141180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:46.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.517+0000 7f3c7d66b640 1 --2- 172.21.15.28:0/1717521737 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c780b89d0 0x7f3c78141180 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c0097f0 tx=0x7f3c6c01c3f0 comp rx=0 tx=0).stop 2023-11-16T02:29:46.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.517+0000 7f3c7d66b640 1 -- 172.21.15.28:0/1717521737 shutdown_connections 2023-11-16T02:29:46.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.517+0000 7f3c7d66b640 1 --2- 172.21.15.28:0/1717521737 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c780b89d0 0x7f3c78141180 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:46.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.517+0000 7f3c7d66b640 1 --2- 172.21.15.28:0/1717521737 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3c781416c0 0x7f3c780bad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:46.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.517+0000 7f3c7d66b640 1 -- 172.21.15.28:0/1717521737 >> 172.21.15.28:0/1717521737 conn(0x7f3c780c0390 msgr2=0x7f3c780c07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:46.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.517+0000 7f3c7d66b640 1 -- 172.21.15.28:0/1717521737 shutdown_connections 2023-11-16T02:29:46.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.517+0000 7f3c7d66b640 1 -- 172.21.15.28:0/1717521737 wait complete. 2023-11-16T02:29:46.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.517+0000 7f3c7d66b640 1 Processor -- start 2023-11-16T02:29:46.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.517+0000 7f3c7d66b640 1 -- start start 2023-11-16T02:29:46.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c7d66b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c780b85f0 0x7f3c78144020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:46.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c7d66b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c780b89d0 0x7f3c78141ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:46.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c7d66b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3c781416c0 0x7f3c781466b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:46.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c7d66b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c78146070 con 0x7f3c780b89d0 2023-11-16T02:29:46.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c7d66b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c781452f0 con 0x7f3c780b85f0 2023-11-16T02:29:46.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c7d66b640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c78145590 con 0x7f3c781416c0 2023-11-16T02:29:46.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c767fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c780b89d0 0x7f3c78141ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:46.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c767fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c780b89d0 0x7f3c78141ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40932/0 (socket says 172.21.15.28:40932) 2023-11-16T02:29:46.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c767fc640 1 -- 172.21.15.28:0/420997327 learned_addr learned my addr 172.21.15.28:0/420997327 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:46.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c777fe640 1 --2- 172.21.15.28:0/420997327 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3c781416c0 0x7f3c781466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:46.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c767fc640 1 -- 172.21.15.28:0/420997327 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3c781416c0 msgr2=0x7f3c781466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:46.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c767fc640 1 --2- 172.21.15.28:0/420997327 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3c781416c0 0x7f3c781466b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:46.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c76ffd640 1 --2- 172.21.15.28:0/420997327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c780b85f0 0x7f3c78144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:46.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c767fc640 1 -- 172.21.15.28:0/420997327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c780b85f0 msgr2=0x7f3c78144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:46.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c767fc640 1 --2- 172.21.15.28:0/420997327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c780b85f0 0x7f3c78144020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:46.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c767fc640 1 -- 172.21.15.28:0/420997327 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c009420 con 0x7f3c780b89d0 2023-11-16T02:29:46.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c767fc640 1 --2- 172.21.15.28:0/420997327 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c780b89d0 0x7f3c78141ad0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c01a020 tx=0x7f3c6c019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:46.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c5f7fe640 1 -- 172.21.15.28:0/420997327 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c0b4840 con 0x7f3c780b89d0 2023-11-16T02:29:46.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c5f7fe640 1 -- 172.21.15.28:0/420997327 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6c0b49c0 con 0x7f3c780b89d0 2023-11-16T02:29:46.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c7d66b640 1 -- 172.21.15.28:0/420997327 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c78145870 con 0x7f3c780b89d0 2023-11-16T02:29:46.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c5f7fe640 1 -- 172.21.15.28:0/420997327 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c0b4d70 con 0x7f3c780b89d0 2023-11-16T02:29:46.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c7d66b640 1 -- 172.21.15.28:0/420997327 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c780bfbb0 con 0x7f3c780b89d0 2023-11-16T02:29:46.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c7d66b640 1 -- 172.21.15.28:0/420997327 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c7804e8a0 con 0x7f3c780b89d0 2023-11-16T02:29:46.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c5f7fe640 1 -- 172.21.15.28:0/420997327 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3c6c0b2040 con 0x7f3c780b89d0 2023-11-16T02:29:46.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c5f7fe640 1 --2- 172.21.15.28:0/420997327 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3c64065a60 0x7f3c64067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:46.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c76ffd640 1 --2- 172.21.15.28:0/420997327 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3c64065a60 0x7f3c64067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:46.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c5f7fe640 1 -- 172.21.15.28:0/420997327 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c6c11d520 con 0x7f3c780b89d0 2023-11-16T02:29:46.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.521+0000 7f3c76ffd640 1 --2- 172.21.15.28:0/420997327 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3c64065a60 0x7f3c64067f20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3c68000f70 tx=0x7f3c68009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:46.530 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.525+0000 7f3c5f7fe640 1 -- 172.21.15.28:0/420997327 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f3c6c0eaed0 con 0x7f3c780b89d0 2023-11-16T02:29:46.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.681+0000 7f3c7d66b640 1 -- 172.21.15.28:0/420997327 --> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3c7814b110 con 0x7f3c64065a60 2023-11-16T02:29:46.699 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.697+0000 7f3c5f7fe640 1 -- 172.21.15.28:0/420997327 <== mgr.4104 v2:172.21.15.28:6832/38651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264415 (secure 0 0 0) 0x7f3c68001c80 con 0x7f3c64065a60 2023-11-16T02:29:46.701 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:46.704 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-11-16T02:29:46.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.701+0000 7f3c7d66b640 1 -- 172.21.15.28:0/420997327 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3c64065a60 msgr2=0x7f3c64067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:46.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.701+0000 7f3c7d66b640 1 --2- 172.21.15.28:0/420997327 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3c64065a60 0x7f3c64067f20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3c68000f70 tx=0x7f3c68009040 comp rx=0 tx=0).stop 2023-11-16T02:29:46.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.701+0000 7f3c7d66b640 1 -- 172.21.15.28:0/420997327 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c780b89d0 msgr2=0x7f3c78141ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:46.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.701+0000 7f3c7d66b640 1 --2- 172.21.15.28:0/420997327 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c780b89d0 0x7f3c78141ad0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c01a020 tx=0x7f3c6c019190 comp rx=0 tx=0).stop 2023-11-16T02:29:46.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.701+0000 7f3c7d66b640 1 -- 172.21.15.28:0/420997327 shutdown_connections 2023-11-16T02:29:46.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.701+0000 7f3c7d66b640 1 --2- 172.21.15.28:0/420997327 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3c64065a60 0x7f3c64067f20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:46.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.701+0000 7f3c7d66b640 1 --2- 172.21.15.28:0/420997327 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3c781416c0 0x7f3c781466b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:46.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.701+0000 7f3c7d66b640 1 --2- 172.21.15.28:0/420997327 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3c780b89d0 0x7f3c78141ad0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:46.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.701+0000 7f3c7d66b640 1 --2- 172.21.15.28:0/420997327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c780b85f0 0x7f3c78144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:46.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.701+0000 7f3c7d66b640 1 -- 172.21.15.28:0/420997327 >> 172.21.15.28:0/420997327 conn(0x7f3c780c0390 msgr2=0x7f3c780c0770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:46.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.701+0000 7f3c7d66b640 1 -- 172.21.15.28:0/420997327 shutdown_connections 2023-11-16T02:29:46.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.701+0000 7f3c7d66b640 1 -- 172.21.15.28:0/420997327 wait complete. 2023-11-16T02:29:46.722 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-11-16T02:29:46.418138+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":251336,"kb_used_data":2952,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754723384,"statfs":{"total":773094113280,"available":772836745216,"internally_reserved":0,"allocated":3022848,"data_stored":1795380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.545760"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893446+0000","last_change":"2023-11-16T02:29:37.934110+0000","last_active":"2023-11-16T02:29:39.893446+0000","last_peered":"2023-11-16T02:29:39.893446+0000","last_clean":"2023-11-16T02:29:39.893446+0000","last_became_active":"2023-11-16T02:29:37.933578+0000","last_became_peered":"2023-11-16T02:29:37.933578+0000","last_unstale":"2023-11-16T02:29:39.893446+0000","last_undegraded":"2023-11-16T02:29:39.893446+0000","last_fullsized":"2023-11-16T02:29:39.893446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:40:54.967365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879002+0000","last_change":"2023-11-16T02:29:37.889075+0000","last_active":"2023-11-16T02:29:38.879002+0000","last_peered":"2023-11-16T02:29:38.879002+0000","last_clean":"2023-11-16T02:29:38.879002+0000","last_became_active":"2023-11-16T02:29:37.888736+0000","last_became_peered":"2023-11-16T02:29:37.888736+0000","last_unstale":"2023-11-16T02:29:38.879002+0000","last_undegraded":"2023-11-16T02:29:38.879002+0000","last_fullsized":"2023-11-16T02:29:38.879002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:25:48.005968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892513+0000","last_change":"2023-11-16T02:29:37.888531+0000","last_active":"2023-11-16T02:29:39.892513+0000","last_peered":"2023-11-16T02:29:39.892513+0000","last_clean":"2023-11-16T02:29:39.892513+0000","last_became_active":"2023-11-16T02:29:37.888011+0000","last_became_peered":"2023-11-16T02:29:37.888011+0000","last_unstale":"2023-11-16T02:29:39.892513+0000","last_undegraded":"2023-11-16T02:29:39.892513+0000","last_fullsized":"2023-11-16T02:29:39.892513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:27:01.501132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879881+0000","last_change":"2023-11-16T02:29:37.933231+0000","last_active":"2023-11-16T02:29:38.879881+0000","last_peered":"2023-11-16T02:29:38.879881+0000","last_clean":"2023-11-16T02:29:38.879881+0000","last_became_active":"2023-11-16T02:29:37.932560+0000","last_became_peered":"2023-11-16T02:29:37.932560+0000","last_unstale":"2023-11-16T02:29:38.879881+0000","last_undegraded":"2023-11-16T02:29:38.879881+0000","last_fullsized":"2023-11-16T02:29:38.879881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:40:54.967365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893326+0000","last_change":"2023-11-16T02:29:37.924836+0000","last_active":"2023-11-16T02:29:39.893326+0000","last_peered":"2023-11-16T02:29:39.893326+0000","last_clean":"2023-11-16T02:29:39.893326+0000","last_became_active":"2023-11-16T02:29:37.923955+0000","last_became_peered":"2023-11-16T02:29:37.923955+0000","last_unstale":"2023-11-16T02:29:39.893326+0000","last_undegraded":"2023-11-16T02:29:39.893326+0000","last_fullsized":"2023-11-16T02:29:39.893326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:16:52.591980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879892+0000","last_change":"2023-11-16T02:29:37.927564+0000","last_active":"2023-11-16T02:29:38.879892+0000","last_peered":"2023-11-16T02:29:38.879892+0000","last_clean":"2023-11-16T02:29:38.879892+0000","last_became_active":"2023-11-16T02:29:37.925508+0000","last_became_peered":"2023-11-16T02:29:37.925508+0000","last_unstale":"2023-11-16T02:29:38.879892+0000","last_undegraded":"2023-11-16T02:29:38.879892+0000","last_fullsized":"2023-11-16T02:29:38.879892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:53:52.129290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892495+0000","last_change":"2023-11-16T02:29:37.908302+0000","last_active":"2023-11-16T02:29:39.892495+0000","last_peered":"2023-11-16T02:29:39.892495+0000","last_clean":"2023-11-16T02:29:39.892495+0000","last_became_active":"2023-11-16T02:29:37.907469+0000","last_became_peered":"2023-11-16T02:29:37.907469+0000","last_unstale":"2023-11-16T02:29:39.892495+0000","last_undegraded":"2023-11-16T02:29:39.892495+0000","last_fullsized":"2023-11-16T02:29:39.892495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:30:42.074843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891934+0000","last_change":"2023-11-16T02:29:37.936720+0000","last_active":"2023-11-16T02:29:39.891934+0000","last_peered":"2023-11-16T02:29:39.891934+0000","last_clean":"2023-11-16T02:29:39.891934+0000","last_became_active":"2023-11-16T02:29:37.936424+0000","last_became_peered":"2023-11-16T02:29:37.936424+0000","last_unstale":"2023-11-16T02:29:39.891934+0000","last_undegraded":"2023-11-16T02:29:39.891934+0000","last_fullsized":"2023-11-16T02:29:39.891934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:53:52.129290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893619+0000","last_change":"2023-11-16T02:29:37.941366+0000","last_active":"2023-11-16T02:29:39.893619+0000","last_peered":"2023-11-16T02:29:39.893619+0000","last_clean":"2023-11-16T02:29:39.893619+0000","last_became_active":"2023-11-16T02:29:37.940672+0000","last_became_peered":"2023-11-16T02:29:37.940672+0000","last_unstale":"2023-11-16T02:29:39.893619+0000","last_undegraded":"2023-11-16T02:29:39.893619+0000","last_fullsized":"2023-11-16T02:29:39.893619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:45:26.924071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881259+0000","last_change":"2023-11-16T02:29:37.925689+0000","last_active":"2023-11-16T02:29:38.881259+0000","last_peered":"2023-11-16T02:29:38.881259+0000","last_clean":"2023-11-16T02:29:38.881259+0000","last_became_active":"2023-11-16T02:29:37.925132+0000","last_became_peered":"2023-11-16T02:29:37.925132+0000","last_unstale":"2023-11-16T02:29:38.881259+0000","last_undegraded":"2023-11-16T02:29:38.881259+0000","last_fullsized":"2023-11-16T02:29:38.881259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:16:58.785873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880724+0000","last_change":"2023-11-16T02:29:37.927099+0000","last_active":"2023-11-16T02:29:38.880724+0000","last_peered":"2023-11-16T02:29:38.880724+0000","last_clean":"2023-11-16T02:29:38.880724+0000","last_became_active":"2023-11-16T02:29:37.926533+0000","last_became_peered":"2023-11-16T02:29:37.926533+0000","last_unstale":"2023-11-16T02:29:38.880724+0000","last_undegraded":"2023-11-16T02:29:38.880724+0000","last_fullsized":"2023-11-16T02:29:38.880724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:43:20.665096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893022+0000","last_change":"2023-11-16T02:29:37.902388+0000","last_active":"2023-11-16T02:29:39.893022+0000","last_peered":"2023-11-16T02:29:39.893022+0000","last_clean":"2023-11-16T02:29:39.893022+0000","last_became_active":"2023-11-16T02:29:37.901626+0000","last_became_peered":"2023-11-16T02:29:37.901626+0000","last_unstale":"2023-11-16T02:29:39.893022+0000","last_undegraded":"2023-11-16T02:29:39.893022+0000","last_fullsized":"2023-11-16T02:29:39.893022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:09:39.001233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891187+0000","last_change":"2023-11-16T02:29:37.907449+0000","last_active":"2023-11-16T02:29:39.891187+0000","last_peered":"2023-11-16T02:29:39.891187+0000","last_clean":"2023-11-16T02:29:39.891187+0000","last_became_active":"2023-11-16T02:29:37.907166+0000","last_became_peered":"2023-11-16T02:29:37.907166+0000","last_unstale":"2023-11-16T02:29:39.891187+0000","last_undegraded":"2023-11-16T02:29:39.891187+0000","last_fullsized":"2023-11-16T02:29:39.891187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:37:34.233429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891915+0000","last_change":"2023-11-16T02:29:37.892022+0000","last_active":"2023-11-16T02:29:39.891915+0000","last_peered":"2023-11-16T02:29:39.891915+0000","last_clean":"2023-11-16T02:29:39.891915+0000","last_became_active":"2023-11-16T02:29:37.891566+0000","last_became_peered":"2023-11-16T02:29:37.891566+0000","last_unstale":"2023-11-16T02:29:39.891915+0000","last_undegraded":"2023-11-16T02:29:39.891915+0000","last_fullsized":"2023-11-16T02:29:39.891915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:06:12.705211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878687+0000","last_change":"2023-11-16T02:29:37.924750+0000","last_active":"2023-11-16T02:29:38.878687+0000","last_peered":"2023-11-16T02:29:38.878687+0000","last_clean":"2023-11-16T02:29:38.878687+0000","last_became_active":"2023-11-16T02:29:37.924471+0000","last_became_peered":"2023-11-16T02:29:37.924471+0000","last_unstale":"2023-11-16T02:29:38.878687+0000","last_undegraded":"2023-11-16T02:29:38.878687+0000","last_fullsized":"2023-11-16T02:29:38.878687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:43:20.665096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879402+0000","last_change":"2023-11-16T02:29:37.912953+0000","last_active":"2023-11-16T02:29:38.879402+0000","last_peered":"2023-11-16T02:29:38.879402+0000","last_clean":"2023-11-16T02:29:38.879402+0000","last_became_active":"2023-11-16T02:29:37.912132+0000","last_became_peered":"2023-11-16T02:29:37.912132+0000","last_unstale":"2023-11-16T02:29:38.879402+0000","last_undegraded":"2023-11-16T02:29:38.879402+0000","last_fullsized":"2023-11-16T02:29:38.879402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:52:41.161159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.882380+0000","last_change":"2023-11-16T02:29:37.933833+0000","last_active":"2023-11-16T02:29:38.882380+0000","last_peered":"2023-11-16T02:29:38.882380+0000","last_clean":"2023-11-16T02:29:38.882380+0000","last_became_active":"2023-11-16T02:29:37.933117+0000","last_became_peered":"2023-11-16T02:29:37.933117+0000","last_unstale":"2023-11-16T02:29:38.882380+0000","last_undegraded":"2023-11-16T02:29:38.882380+0000","last_fullsized":"2023-11-16T02:29:38.882380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:16:52.591980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930738+0000","last_change":"2023-11-16T02:29:37.890129+0000","last_active":"2023-11-16T02:29:38.930738+0000","last_peered":"2023-11-16T02:29:38.930738+0000","last_clean":"2023-11-16T02:29:38.930738+0000","last_became_active":"2023-11-16T02:29:37.889784+0000","last_became_peered":"2023-11-16T02:29:37.889784+0000","last_unstale":"2023-11-16T02:29:38.930738+0000","last_undegraded":"2023-11-16T02:29:38.930738+0000","last_fullsized":"2023-11-16T02:29:38.930738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:57:07.831898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893749+0000","last_change":"2023-11-16T02:29:37.916610+0000","last_active":"2023-11-16T02:29:39.893749+0000","last_peered":"2023-11-16T02:29:39.893749+0000","last_clean":"2023-11-16T02:29:39.893749+0000","last_became_active":"2023-11-16T02:29:37.915744+0000","last_became_peered":"2023-11-16T02:29:37.915744+0000","last_unstale":"2023-11-16T02:29:39.893749+0000","last_undegraded":"2023-11-16T02:29:39.893749+0000","last_fullsized":"2023-11-16T02:29:39.893749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:39:21.513129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880946+0000","last_change":"2023-11-16T02:29:37.928237+0000","last_active":"2023-11-16T02:29:38.880946+0000","last_peered":"2023-11-16T02:29:38.880946+0000","last_clean":"2023-11-16T02:29:38.880946+0000","last_became_active":"2023-11-16T02:29:37.927434+0000","last_became_peered":"2023-11-16T02:29:37.927434+0000","last_unstale":"2023-11-16T02:29:38.880946+0000","last_undegraded":"2023-11-16T02:29:38.880946+0000","last_fullsized":"2023-11-16T02:29:38.880946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:37:34.233429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891411+0000","last_change":"2023-11-16T02:29:37.919211+0000","last_active":"2023-11-16T02:29:39.891411+0000","last_peered":"2023-11-16T02:29:39.891411+0000","last_clean":"2023-11-16T02:29:39.891411+0000","last_became_active":"2023-11-16T02:29:37.918942+0000","last_became_peered":"2023-11-16T02:29:37.918942+0000","last_unstale":"2023-11-16T02:29:39.891411+0000","last_undegraded":"2023-11-16T02:29:39.891411+0000","last_fullsized":"2023-11-16T02:29:39.891411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:02:14.259774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879910+0000","last_change":"2023-11-16T02:29:37.926517+0000","last_active":"2023-11-16T02:29:38.879910+0000","last_peered":"2023-11-16T02:29:38.879910+0000","last_clean":"2023-11-16T02:29:38.879910+0000","last_became_active":"2023-11-16T02:29:37.924700+0000","last_became_peered":"2023-11-16T02:29:37.924700+0000","last_unstale":"2023-11-16T02:29:38.879910+0000","last_undegraded":"2023-11-16T02:29:38.879910+0000","last_fullsized":"2023-11-16T02:29:38.879910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:39:21.513129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891489+0000","last_change":"2023-11-16T02:29:37.936251+0000","last_active":"2023-11-16T02:29:39.891489+0000","last_peered":"2023-11-16T02:29:39.891489+0000","last_clean":"2023-11-16T02:29:39.891489+0000","last_became_active":"2023-11-16T02:29:37.935980+0000","last_became_peered":"2023-11-16T02:29:37.935980+0000","last_unstale":"2023-11-16T02:29:39.891489+0000","last_undegraded":"2023-11-16T02:29:39.891489+0000","last_fullsized":"2023-11-16T02:29:39.891489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:02:14.259774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879581+0000","last_change":"2023-11-16T02:29:37.929521+0000","last_active":"2023-11-16T02:29:38.879581+0000","last_peered":"2023-11-16T02:29:38.879581+0000","last_clean":"2023-11-16T02:29:38.879581+0000","last_became_active":"2023-11-16T02:29:37.924137+0000","last_became_peered":"2023-11-16T02:29:37.924137+0000","last_unstale":"2023-11-16T02:29:38.879581+0000","last_undegraded":"2023-11-16T02:29:38.879581+0000","last_fullsized":"2023-11-16T02:29:38.879581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:05:26.649663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892396+0000","last_change":"2023-11-16T02:29:37.935340+0000","last_active":"2023-11-16T02:29:39.892396+0000","last_peered":"2023-11-16T02:29:39.892396+0000","last_clean":"2023-11-16T02:29:39.892396+0000","last_became_active":"2023-11-16T02:29:37.934955+0000","last_became_peered":"2023-11-16T02:29:37.934955+0000","last_unstale":"2023-11-16T02:29:39.892396+0000","last_undegraded":"2023-11-16T02:29:39.892396+0000","last_fullsized":"2023-11-16T02:29:39.892396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:10:43.990221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881491+0000","last_change":"2023-11-16T02:29:37.929426+0000","last_active":"2023-11-16T02:29:38.881491+0000","last_peered":"2023-11-16T02:29:38.881491+0000","last_clean":"2023-11-16T02:29:38.881491+0000","last_became_active":"2023-11-16T02:29:37.928780+0000","last_became_peered":"2023-11-16T02:29:37.928780+0000","last_unstale":"2023-11-16T02:29:38.881491+0000","last_undegraded":"2023-11-16T02:29:38.881491+0000","last_fullsized":"2023-11-16T02:29:38.881491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:05:26.649663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878825+0000","last_change":"2023-11-16T02:29:37.893720+0000","last_active":"2023-11-16T02:29:38.878825+0000","last_peered":"2023-11-16T02:29:38.878825+0000","last_clean":"2023-11-16T02:29:38.878825+0000","last_became_active":"2023-11-16T02:29:37.893429+0000","last_became_peered":"2023-11-16T02:29:37.893429+0000","last_unstale":"2023-11-16T02:29:38.878825+0000","last_undegraded":"2023-11-16T02:29:38.878825+0000","last_fullsized":"2023-11-16T02:29:38.878825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T02:48:20.525493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892100+0000","last_change":"2023-11-16T02:29:37.935318+0000","last_active":"2023-11-16T02:29:39.892100+0000","last_peered":"2023-11-16T02:29:39.892100+0000","last_clean":"2023-11-16T02:29:39.892100+0000","last_became_active":"2023-11-16T02:29:37.934951+0000","last_became_peered":"2023-11-16T02:29:37.934951+0000","last_unstale":"2023-11-16T02:29:39.892100+0000","last_undegraded":"2023-11-16T02:29:39.892100+0000","last_fullsized":"2023-11-16T02:29:39.892100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:16:58.785873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891486+0000","last_change":"2023-11-16T02:29:37.894800+0000","last_active":"2023-11-16T02:29:39.891486+0000","last_peered":"2023-11-16T02:29:39.891486+0000","last_clean":"2023-11-16T02:29:39.891486+0000","last_became_active":"2023-11-16T02:29:37.894404+0000","last_became_peered":"2023-11-16T02:29:37.894404+0000","last_unstale":"2023-11-16T02:29:39.891486+0000","last_undegraded":"2023-11-16T02:29:39.891486+0000","last_fullsized":"2023-11-16T02:29:39.891486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:37:34.233429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880139+0000","last_change":"2023-11-16T02:29:37.920827+0000","last_active":"2023-11-16T02:29:38.880139+0000","last_peered":"2023-11-16T02:29:38.880139+0000","last_clean":"2023-11-16T02:29:38.880139+0000","last_became_active":"2023-11-16T02:29:37.911702+0000","last_became_peered":"2023-11-16T02:29:37.911702+0000","last_unstale":"2023-11-16T02:29:38.880139+0000","last_undegraded":"2023-11-16T02:29:38.880139+0000","last_fullsized":"2023-11-16T02:29:38.880139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:46:36.525784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930582+0000","last_change":"2023-11-16T02:29:37.912688+0000","last_active":"2023-11-16T02:29:38.930582+0000","last_peered":"2023-11-16T02:29:38.930582+0000","last_clean":"2023-11-16T02:29:38.930582+0000","last_became_active":"2023-11-16T02:29:37.912482+0000","last_became_peered":"2023-11-16T02:29:37.912482+0000","last_unstale":"2023-11-16T02:29:38.930582+0000","last_undegraded":"2023-11-16T02:29:38.930582+0000","last_fullsized":"2023-11-16T02:29:38.930582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:36:55.256000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880120+0000","last_change":"2023-11-16T02:29:37.897293+0000","last_active":"2023-11-16T02:29:38.880120+0000","last_peered":"2023-11-16T02:29:38.880120+0000","last_clean":"2023-11-16T02:29:38.880120+0000","last_became_active":"2023-11-16T02:29:37.895087+0000","last_became_peered":"2023-11-16T02:29:37.895087+0000","last_unstale":"2023-11-16T02:29:38.880120+0000","last_undegraded":"2023-11-16T02:29:38.880120+0000","last_fullsized":"2023-11-16T02:29:38.880120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T02:48:20.525493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892526+0000","last_change":"2023-11-16T02:29:37.886782+0000","last_active":"2023-11-16T02:29:39.892526+0000","last_peered":"2023-11-16T02:29:39.892526+0000","last_clean":"2023-11-16T02:29:39.892526+0000","last_became_active":"2023-11-16T02:29:37.885874+0000","last_became_peered":"2023-11-16T02:29:37.885874+0000","last_unstale":"2023-11-16T02:29:39.892526+0000","last_undegraded":"2023-11-16T02:29:39.892526+0000","last_fullsized":"2023-11-16T02:29:39.892526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:21:32.772781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891317+0000","last_change":"2023-11-16T02:29:37.538231+0000","last_active":"2023-11-16T02:29:39.891317+0000","last_peered":"2023-11-16T02:29:39.891317+0000","last_clean":"2023-11-16T02:29:39.891317+0000","last_became_active":"2023-11-16T02:29:37.537831+0000","last_became_peered":"2023-11-16T02:29:37.537831+0000","last_unstale":"2023-11-16T02:29:39.891317+0000","last_undegraded":"2023-11-16T02:29:39.891317+0000","last_fullsized":"2023-11-16T02:29:39.891317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:07:57.498670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891555+0000","last_change":"2023-11-16T02:29:37.928329+0000","last_active":"2023-11-16T02:29:39.891555+0000","last_peered":"2023-11-16T02:29:39.891555+0000","last_clean":"2023-11-16T02:29:39.891555+0000","last_became_active":"2023-11-16T02:29:37.927587+0000","last_became_peered":"2023-11-16T02:29:37.927587+0000","last_unstale":"2023-11-16T02:29:39.891555+0000","last_undegraded":"2023-11-16T02:29:39.891555+0000","last_fullsized":"2023-11-16T02:29:39.891555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:25:48.005968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880624+0000","last_change":"2023-11-16T02:29:37.540421+0000","last_active":"2023-11-16T02:29:38.880624+0000","last_peered":"2023-11-16T02:29:38.880624+0000","last_clean":"2023-11-16T02:29:38.880624+0000","last_became_active":"2023-11-16T02:29:37.539777+0000","last_became_peered":"2023-11-16T02:29:37.539777+0000","last_unstale":"2023-11-16T02:29:38.880624+0000","last_undegraded":"2023-11-16T02:29:38.880624+0000","last_fullsized":"2023-11-16T02:29:38.880624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:07:57.498670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891713+0000","last_change":"2023-11-16T02:29:37.524313+0000","last_active":"2023-11-16T02:29:39.891713+0000","last_peered":"2023-11-16T02:29:39.891713+0000","last_clean":"2023-11-16T02:29:39.891713+0000","last_became_active":"2023-11-16T02:29:37.523846+0000","last_became_peered":"2023-11-16T02:29:37.523846+0000","last_unstale":"2023-11-16T02:29:39.891713+0000","last_undegraded":"2023-11-16T02:29:39.891713+0000","last_fullsized":"2023-11-16T02:29:39.891713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:10:34.206728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892088+0000","last_change":"2023-11-16T02:29:37.885752+0000","last_active":"2023-11-16T02:29:39.892088+0000","last_peered":"2023-11-16T02:29:39.892088+0000","last_clean":"2023-11-16T02:29:39.892088+0000","last_became_active":"2023-11-16T02:29:37.885481+0000","last_became_peered":"2023-11-16T02:29:37.885481+0000","last_unstale":"2023-11-16T02:29:39.892088+0000","last_undegraded":"2023-11-16T02:29:39.892088+0000","last_fullsized":"2023-11-16T02:29:39.892088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:05:12.707357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879852+0000","last_change":"2023-11-16T02:29:37.528549+0000","last_active":"2023-11-16T02:29:38.879852+0000","last_peered":"2023-11-16T02:29:38.879852+0000","last_clean":"2023-11-16T02:29:38.879852+0000","last_became_active":"2023-11-16T02:29:37.527762+0000","last_became_peered":"2023-11-16T02:29:37.527762+0000","last_unstale":"2023-11-16T02:29:38.879852+0000","last_undegraded":"2023-11-16T02:29:38.879852+0000","last_fullsized":"2023-11-16T02:29:38.879852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:45:11.372719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878450+0000","last_change":"2023-11-16T02:29:37.892686+0000","last_active":"2023-11-16T02:29:38.878450+0000","last_peered":"2023-11-16T02:29:38.878450+0000","last_clean":"2023-11-16T02:29:38.878450+0000","last_became_active":"2023-11-16T02:29:37.892384+0000","last_became_peered":"2023-11-16T02:29:37.892384+0000","last_unstale":"2023-11-16T02:29:38.878450+0000","last_undegraded":"2023-11-16T02:29:38.878450+0000","last_fullsized":"2023-11-16T02:29:38.878450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:37:34.233429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880554+0000","last_change":"2023-11-16T02:29:37.545696+0000","last_active":"2023-11-16T02:29:38.880554+0000","last_peered":"2023-11-16T02:29:38.880554+0000","last_clean":"2023-11-16T02:29:38.880554+0000","last_became_active":"2023-11-16T02:29:37.545073+0000","last_became_peered":"2023-11-16T02:29:37.545073+0000","last_unstale":"2023-11-16T02:29:38.880554+0000","last_undegraded":"2023-11-16T02:29:38.880554+0000","last_fullsized":"2023-11-16T02:29:38.880554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:04:23.421210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881635+0000","last_change":"2023-11-16T02:29:37.929853+0000","last_active":"2023-11-16T02:29:38.881635+0000","last_peered":"2023-11-16T02:29:38.881635+0000","last_clean":"2023-11-16T02:29:38.881635+0000","last_became_active":"2023-11-16T02:29:37.929199+0000","last_became_peered":"2023-11-16T02:29:37.929199+0000","last_unstale":"2023-11-16T02:29:38.881635+0000","last_undegraded":"2023-11-16T02:29:38.881635+0000","last_fullsized":"2023-11-16T02:29:38.881635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:30:42.074843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881944+0000","last_change":"2023-11-16T02:29:37.537469+0000","last_active":"2023-11-16T02:29:38.881944+0000","last_peered":"2023-11-16T02:29:38.881944+0000","last_clean":"2023-11-16T02:29:38.881944+0000","last_became_active":"2023-11-16T02:29:37.536939+0000","last_became_peered":"2023-11-16T02:29:37.536939+0000","last_unstale":"2023-11-16T02:29:38.881944+0000","last_undegraded":"2023-11-16T02:29:38.881944+0000","last_fullsized":"2023-11-16T02:29:38.881944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:42:27.512040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891189+0000","last_change":"2023-11-16T02:29:37.928255+0000","last_active":"2023-11-16T02:29:39.891189+0000","last_peered":"2023-11-16T02:29:39.891189+0000","last_clean":"2023-11-16T02:29:39.891189+0000","last_became_active":"2023-11-16T02:29:37.927823+0000","last_became_peered":"2023-11-16T02:29:37.927823+0000","last_unstale":"2023-11-16T02:29:39.891189+0000","last_undegraded":"2023-11-16T02:29:39.891189+0000","last_fullsized":"2023-11-16T02:29:39.891189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:16:58.785873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878823+0000","last_change":"2023-11-16T02:29:37.538934+0000","last_active":"2023-11-16T02:29:38.878823+0000","last_peered":"2023-11-16T02:29:38.878823+0000","last_clean":"2023-11-16T02:29:38.878823+0000","last_became_active":"2023-11-16T02:29:37.538493+0000","last_became_peered":"2023-11-16T02:29:37.538493+0000","last_unstale":"2023-11-16T02:29:38.878823+0000","last_undegraded":"2023-11-16T02:29:38.878823+0000","last_fullsized":"2023-11-16T02:29:38.878823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:38:57.277934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893023+0000","last_change":"2023-11-16T02:29:37.919752+0000","last_active":"2023-11-16T02:29:39.893023+0000","last_peered":"2023-11-16T02:29:39.893023+0000","last_clean":"2023-11-16T02:29:39.893023+0000","last_became_active":"2023-11-16T02:29:37.919021+0000","last_became_peered":"2023-11-16T02:29:37.919021+0000","last_unstale":"2023-11-16T02:29:39.893023+0000","last_undegraded":"2023-11-16T02:29:39.893023+0000","last_fullsized":"2023-11-16T02:29:39.893023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:38:58.288279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881202+0000","last_change":"2023-11-16T02:29:37.512625+0000","last_active":"2023-11-16T02:29:38.881202+0000","last_peered":"2023-11-16T02:29:38.881202+0000","last_clean":"2023-11-16T02:29:38.881202+0000","last_became_active":"2023-11-16T02:29:37.511862+0000","last_became_peered":"2023-11-16T02:29:37.511862+0000","last_unstale":"2023-11-16T02:29:38.881202+0000","last_undegraded":"2023-11-16T02:29:38.881202+0000","last_fullsized":"2023-11-16T02:29:38.881202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:45:11.372719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893382+0000","last_change":"2023-11-16T02:29:37.907846+0000","last_active":"2023-11-16T02:29:39.893382+0000","last_peered":"2023-11-16T02:29:39.893382+0000","last_clean":"2023-11-16T02:29:39.893382+0000","last_became_active":"2023-11-16T02:29:37.906680+0000","last_became_peered":"2023-11-16T02:29:37.906680+0000","last_unstale":"2023-11-16T02:29:39.893382+0000","last_undegraded":"2023-11-16T02:29:39.893382+0000","last_fullsized":"2023-11-16T02:29:39.893382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:46:36.525784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891620+0000","last_change":"2023-11-16T02:29:37.516156+0000","last_active":"2023-11-16T02:29:39.891620+0000","last_peered":"2023-11-16T02:29:39.891620+0000","last_clean":"2023-11-16T02:29:39.891620+0000","last_became_active":"2023-11-16T02:29:37.508947+0000","last_became_peered":"2023-11-16T02:29:37.508947+0000","last_unstale":"2023-11-16T02:29:39.891620+0000","last_undegraded":"2023-11-16T02:29:39.891620+0000","last_fullsized":"2023-11-16T02:29:39.891620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:28:03.017758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892055+0000","last_change":"2023-11-16T02:29:37.917898+0000","last_active":"2023-11-16T02:29:39.892055+0000","last_peered":"2023-11-16T02:29:39.892055+0000","last_clean":"2023-11-16T02:29:39.892055+0000","last_became_active":"2023-11-16T02:29:37.917588+0000","last_became_peered":"2023-11-16T02:29:37.917588+0000","last_unstale":"2023-11-16T02:29:39.892055+0000","last_undegraded":"2023-11-16T02:29:39.892055+0000","last_fullsized":"2023-11-16T02:29:39.892055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:43:20.665096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880128+0000","last_change":"2023-11-16T02:29:37.535755+0000","last_active":"2023-11-16T02:29:38.880128+0000","last_peered":"2023-11-16T02:29:38.880128+0000","last_clean":"2023-11-16T02:29:38.880128+0000","last_became_active":"2023-11-16T02:29:37.535030+0000","last_became_peered":"2023-11-16T02:29:37.535030+0000","last_unstale":"2023-11-16T02:29:38.880128+0000","last_undegraded":"2023-11-16T02:29:38.880128+0000","last_fullsized":"2023-11-16T02:29:38.880128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:10:34.206728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893470+0000","last_change":"2023-11-16T02:29:37.943232+0000","last_active":"2023-11-16T02:29:39.893470+0000","last_peered":"2023-11-16T02:29:39.893470+0000","last_clean":"2023-11-16T02:29:39.893470+0000","last_became_active":"2023-11-16T02:29:37.942561+0000","last_became_peered":"2023-11-16T02:29:37.942561+0000","last_unstale":"2023-11-16T02:29:39.893470+0000","last_undegraded":"2023-11-16T02:29:39.893470+0000","last_fullsized":"2023-11-16T02:29:39.893470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:06:38.108558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880346+0000","last_change":"2023-11-16T02:29:37.540351+0000","last_active":"2023-11-16T02:29:38.880346+0000","last_peered":"2023-11-16T02:29:38.880346+0000","last_clean":"2023-11-16T02:29:38.880346+0000","last_became_active":"2023-11-16T02:29:37.539672+0000","last_became_peered":"2023-11-16T02:29:37.539672+0000","last_unstale":"2023-11-16T02:29:38.880346+0000","last_undegraded":"2023-11-16T02:29:38.880346+0000","last_fullsized":"2023-11-16T02:29:38.880346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:57:02.655084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880380+0000","last_change":"2023-11-16T02:29:37.898389+0000","last_active":"2023-11-16T02:29:38.880380+0000","last_peered":"2023-11-16T02:29:38.880380+0000","last_clean":"2023-11-16T02:29:38.880380+0000","last_became_active":"2023-11-16T02:29:37.896101+0000","last_became_peered":"2023-11-16T02:29:37.896101+0000","last_unstale":"2023-11-16T02:29:38.880380+0000","last_undegraded":"2023-11-16T02:29:38.880380+0000","last_fullsized":"2023-11-16T02:29:38.880380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:27:01.501132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930434+0000","last_change":"2023-11-16T02:29:37.507129+0000","last_active":"2023-11-16T02:29:38.930434+0000","last_peered":"2023-11-16T02:29:38.930434+0000","last_clean":"2023-11-16T02:29:38.930434+0000","last_became_active":"2023-11-16T02:29:37.506617+0000","last_became_peered":"2023-11-16T02:29:37.506617+0000","last_unstale":"2023-11-16T02:29:38.930434+0000","last_undegraded":"2023-11-16T02:29:38.930434+0000","last_fullsized":"2023-11-16T02:29:38.930434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T09:52:00.933962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892753+0000","last_change":"2023-11-16T02:29:37.936934+0000","last_active":"2023-11-16T02:29:39.892753+0000","last_peered":"2023-11-16T02:29:39.892753+0000","last_clean":"2023-11-16T02:29:39.892753+0000","last_became_active":"2023-11-16T02:29:37.936330+0000","last_became_peered":"2023-11-16T02:29:37.936330+0000","last_unstale":"2023-11-16T02:29:39.892753+0000","last_undegraded":"2023-11-16T02:29:39.892753+0000","last_fullsized":"2023-11-16T02:29:39.892753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:10:43.990221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893035+0000","last_change":"2023-11-16T02:29:37.522370+0000","last_active":"2023-11-16T02:29:39.893035+0000","last_peered":"2023-11-16T02:29:39.893035+0000","last_clean":"2023-11-16T02:29:39.893035+0000","last_became_active":"2023-11-16T02:29:37.521575+0000","last_became_peered":"2023-11-16T02:29:37.521575+0000","last_unstale":"2023-11-16T02:29:39.893035+0000","last_undegraded":"2023-11-16T02:29:39.893035+0000","last_fullsized":"2023-11-16T02:29:39.893035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:59:52.538150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.894051+0000","last_change":"2023-11-16T02:29:37.936845+0000","last_active":"2023-11-16T02:29:39.894051+0000","last_peered":"2023-11-16T02:29:39.894051+0000","last_clean":"2023-11-16T02:29:39.894051+0000","last_became_active":"2023-11-16T02:29:37.936190+0000","last_became_peered":"2023-11-16T02:29:37.936190+0000","last_unstale":"2023-11-16T02:29:39.894051+0000","last_undegraded":"2023-11-16T02:29:39.894051+0000","last_fullsized":"2023-11-16T02:29:39.894051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:02:14.259774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930772+0000","last_change":"2023-11-16T02:29:37.513345+0000","last_active":"2023-11-16T02:29:38.930772+0000","last_peered":"2023-11-16T02:29:38.930772+0000","last_clean":"2023-11-16T02:29:38.930772+0000","last_became_active":"2023-11-16T02:29:37.512642+0000","last_became_peered":"2023-11-16T02:29:37.512642+0000","last_unstale":"2023-11-16T02:29:38.930772+0000","last_undegraded":"2023-11-16T02:29:38.930772+0000","last_fullsized":"2023-11-16T02:29:38.930772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:03:19.516009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893760+0000","last_change":"2023-11-16T02:29:37.938095+0000","last_active":"2023-11-16T02:29:39.893760+0000","last_peered":"2023-11-16T02:29:39.893760+0000","last_clean":"2023-11-16T02:29:39.893760+0000","last_became_active":"2023-11-16T02:29:37.937531+0000","last_became_peered":"2023-11-16T02:29:37.937531+0000","last_unstale":"2023-11-16T02:29:39.893760+0000","last_undegraded":"2023-11-16T02:29:39.893760+0000","last_fullsized":"2023-11-16T02:29:39.893760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:53:52.129290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878918+0000","last_change":"2023-11-16T02:29:37.519277+0000","last_active":"2023-11-16T02:29:38.878918+0000","last_peered":"2023-11-16T02:29:38.878918+0000","last_clean":"2023-11-16T02:29:38.878918+0000","last_became_active":"2023-11-16T02:29:37.518833+0000","last_became_peered":"2023-11-16T02:29:37.518833+0000","last_unstale":"2023-11-16T02:29:38.878918+0000","last_undegraded":"2023-11-16T02:29:38.878918+0000","last_fullsized":"2023-11-16T02:29:38.878918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:04:23.421210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881516+0000","last_change":"2023-11-16T02:29:37.916444+0000","last_active":"2023-11-16T02:29:38.881516+0000","last_peered":"2023-11-16T02:29:38.881516+0000","last_clean":"2023-11-16T02:29:38.881516+0000","last_became_active":"2023-11-16T02:29:37.915697+0000","last_became_peered":"2023-11-16T02:29:37.915697+0000","last_unstale":"2023-11-16T02:29:38.881516+0000","last_undegraded":"2023-11-16T02:29:38.881516+0000","last_fullsized":"2023-11-16T02:29:38.881516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:02:14.259774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930777+0000","last_change":"2023-11-16T02:29:37.544475+0000","last_active":"2023-11-16T02:29:38.930777+0000","last_peered":"2023-11-16T02:29:38.930777+0000","last_clean":"2023-11-16T02:29:38.930777+0000","last_became_active":"2023-11-16T02:29:37.544180+0000","last_became_peered":"2023-11-16T02:29:37.544180+0000","last_unstale":"2023-11-16T02:29:38.930777+0000","last_undegraded":"2023-11-16T02:29:38.930777+0000","last_fullsized":"2023-11-16T02:29:38.930777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:24:09.474240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893476+0000","last_change":"2023-11-16T02:29:37.934969+0000","last_active":"2023-11-16T02:29:39.893476+0000","last_peered":"2023-11-16T02:29:39.893476+0000","last_clean":"2023-11-16T02:29:39.893476+0000","last_became_active":"2023-11-16T02:29:37.934382+0000","last_became_peered":"2023-11-16T02:29:37.934382+0000","last_unstale":"2023-11-16T02:29:39.893476+0000","last_undegraded":"2023-11-16T02:29:39.893476+0000","last_fullsized":"2023-11-16T02:29:39.893476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:57:50.326734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":164,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-16T02:29:37.908728+0000","last_change":"2023-11-16T02:29:27.538359+0000","last_active":"2023-11-16T02:29:37.908728+0000","last_peered":"2023-11-16T02:29:37.908728+0000","last_clean":"2023-11-16T02:29:37.908728+0000","last_became_active":"2023-11-16T02:29:27.536606+0000","last_became_peered":"2023-11-16T02:29:27.536606+0000","last_unstale":"2023-11-16T02:29:37.908728+0000","last_undegraded":"2023-11-16T02:29:37.908728+0000","last_fullsized":"2023-11-16T02:29:37.908728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:26.491990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:26.491990+0000","last_clean_scrub_stamp":"2023-11-16T02:29:26.491990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:29:40.434297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879779+0000","last_change":"2023-11-16T02:29:37.529226+0000","last_active":"2023-11-16T02:29:38.879779+0000","last_peered":"2023-11-16T02:29:38.879779+0000","last_clean":"2023-11-16T02:29:38.879779+0000","last_became_active":"2023-11-16T02:29:37.528419+0000","last_became_peered":"2023-11-16T02:29:37.528419+0000","last_unstale":"2023-11-16T02:29:38.879779+0000","last_undegraded":"2023-11-16T02:29:38.879779+0000","last_fullsized":"2023-11-16T02:29:38.879779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:57:02.655084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892100+0000","last_change":"2023-11-16T02:29:37.928597+0000","last_active":"2023-11-16T02:29:39.892100+0000","last_peered":"2023-11-16T02:29:39.892100+0000","last_clean":"2023-11-16T02:29:39.892100+0000","last_became_active":"2023-11-16T02:29:37.928277+0000","last_became_peered":"2023-11-16T02:29:37.928277+0000","last_unstale":"2023-11-16T02:29:39.892100+0000","last_undegraded":"2023-11-16T02:29:39.892100+0000","last_fullsized":"2023-11-16T02:29:39.892100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:46:36.525784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892334+0000","last_change":"2023-11-16T02:29:37.540168+0000","last_active":"2023-11-16T02:29:39.892334+0000","last_peered":"2023-11-16T02:29:39.892334+0000","last_clean":"2023-11-16T02:29:39.892334+0000","last_became_active":"2023-11-16T02:29:37.539604+0000","last_became_peered":"2023-11-16T02:29:37.539604+0000","last_unstale":"2023-11-16T02:29:39.892334+0000","last_undegraded":"2023-11-16T02:29:39.892334+0000","last_fullsized":"2023-11-16T02:29:39.892334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:45:11.372719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.890863+0000","last_change":"2023-11-16T02:29:37.928646+0000","last_active":"2023-11-16T02:29:39.890863+0000","last_peered":"2023-11-16T02:29:39.890863+0000","last_clean":"2023-11-16T02:29:39.890863+0000","last_became_active":"2023-11-16T02:29:37.927520+0000","last_became_peered":"2023-11-16T02:29:37.927520+0000","last_unstale":"2023-11-16T02:29:39.890863+0000","last_undegraded":"2023-11-16T02:29:39.890863+0000","last_fullsized":"2023-11-16T02:29:39.890863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:05:12.707357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930813+0000","last_change":"2023-11-16T02:29:37.508498+0000","last_active":"2023-11-16T02:29:38.930813+0000","last_peered":"2023-11-16T02:29:38.930813+0000","last_clean":"2023-11-16T02:29:38.930813+0000","last_became_active":"2023-11-16T02:29:37.508091+0000","last_became_peered":"2023-11-16T02:29:37.508091+0000","last_unstale":"2023-11-16T02:29:38.930813+0000","last_undegraded":"2023-11-16T02:29:38.930813+0000","last_fullsized":"2023-11-16T02:29:38.930813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:31:57.230585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878450+0000","last_change":"2023-11-16T02:29:37.889506+0000","last_active":"2023-11-16T02:29:38.878450+0000","last_peered":"2023-11-16T02:29:38.878450+0000","last_clean":"2023-11-16T02:29:38.878450+0000","last_became_active":"2023-11-16T02:29:37.884833+0000","last_became_peered":"2023-11-16T02:29:37.884833+0000","last_unstale":"2023-11-16T02:29:38.878450+0000","last_undegraded":"2023-11-16T02:29:38.878450+0000","last_fullsized":"2023-11-16T02:29:38.878450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:05:26.649663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880343+0000","last_change":"2023-11-16T02:29:37.535414+0000","last_active":"2023-11-16T02:29:38.880343+0000","last_peered":"2023-11-16T02:29:38.880343+0000","last_clean":"2023-11-16T02:29:38.880343+0000","last_became_active":"2023-11-16T02:29:37.530060+0000","last_became_peered":"2023-11-16T02:29:37.530060+0000","last_unstale":"2023-11-16T02:29:38.880343+0000","last_undegraded":"2023-11-16T02:29:38.880343+0000","last_fullsized":"2023-11-16T02:29:38.880343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:07:57.498670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.894166+0000","last_change":"2023-11-16T02:29:37.900850+0000","last_active":"2023-11-16T02:29:39.894166+0000","last_peered":"2023-11-16T02:29:39.894166+0000","last_clean":"2023-11-16T02:29:39.894166+0000","last_became_active":"2023-11-16T02:29:37.896204+0000","last_became_peered":"2023-11-16T02:29:37.896204+0000","last_unstale":"2023-11-16T02:29:39.894166+0000","last_undegraded":"2023-11-16T02:29:39.894166+0000","last_fullsized":"2023-11-16T02:29:39.894166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:04:24.431554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878831+0000","last_change":"2023-11-16T02:29:37.515012+0000","last_active":"2023-11-16T02:29:38.878831+0000","last_peered":"2023-11-16T02:29:38.878831+0000","last_clean":"2023-11-16T02:29:38.878831+0000","last_became_active":"2023-11-16T02:29:37.514528+0000","last_became_peered":"2023-11-16T02:29:37.514528+0000","last_unstale":"2023-11-16T02:29:38.878831+0000","last_undegraded":"2023-11-16T02:29:38.878831+0000","last_fullsized":"2023-11-16T02:29:38.878831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:07:57.498670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881961+0000","last_change":"2023-11-16T02:29:37.925316+0000","last_active":"2023-11-16T02:29:38.881961+0000","last_peered":"2023-11-16T02:29:38.881961+0000","last_clean":"2023-11-16T02:29:38.881961+0000","last_became_active":"2023-11-16T02:29:37.924267+0000","last_became_peered":"2023-11-16T02:29:37.924267+0000","last_unstale":"2023-11-16T02:29:38.881961+0000","last_undegraded":"2023-11-16T02:29:38.881961+0000","last_fullsized":"2023-11-16T02:29:38.881961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:06:38.108558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893826+0000","last_change":"2023-11-16T02:29:37.544869+0000","last_active":"2023-11-16T02:29:39.893826+0000","last_peered":"2023-11-16T02:29:39.893826+0000","last_clean":"2023-11-16T02:29:39.893826+0000","last_became_active":"2023-11-16T02:29:37.544275+0000","last_became_peered":"2023-11-16T02:29:37.544275+0000","last_unstale":"2023-11-16T02:29:39.893826+0000","last_undegraded":"2023-11-16T02:29:39.893826+0000","last_fullsized":"2023-11-16T02:29:39.893826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:38:57.277934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878700+0000","last_change":"2023-11-16T02:29:37.884651+0000","last_active":"2023-11-16T02:29:38.878700+0000","last_peered":"2023-11-16T02:29:38.878700+0000","last_clean":"2023-11-16T02:29:38.878700+0000","last_became_active":"2023-11-16T02:29:37.884251+0000","last_became_peered":"2023-11-16T02:29:37.884251+0000","last_unstale":"2023-11-16T02:29:38.878700+0000","last_undegraded":"2023-11-16T02:29:38.878700+0000","last_fullsized":"2023-11-16T02:29:38.878700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:09:55.065210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:40.440759+0000","last_change":"2023-11-16T02:29:37.518697+0000","last_active":"2023-11-16T02:29:40.440759+0000","last_peered":"2023-11-16T02:29:40.440759+0000","last_clean":"2023-11-16T02:29:40.440759+0000","last_became_active":"2023-11-16T02:29:37.518275+0000","last_became_peered":"2023-11-16T02:29:37.518275+0000","last_unstale":"2023-11-16T02:29:40.440759+0000","last_undegraded":"2023-11-16T02:29:40.440759+0000","last_fullsized":"2023-11-16T02:29:40.440759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:45:11.372719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892472+0000","last_change":"2023-11-16T02:29:37.928232+0000","last_active":"2023-11-16T02:29:39.892472+0000","last_peered":"2023-11-16T02:29:39.892472+0000","last_clean":"2023-11-16T02:29:39.892472+0000","last_became_active":"2023-11-16T02:29:37.927841+0000","last_became_peered":"2023-11-16T02:29:37.927841+0000","last_unstale":"2023-11-16T02:29:39.892472+0000","last_undegraded":"2023-11-16T02:29:39.892472+0000","last_fullsized":"2023-11-16T02:29:39.892472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:06:38.108558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880867+0000","last_change":"2023-11-16T02:29:37.533118+0000","last_active":"2023-11-16T02:29:38.880867+0000","last_peered":"2023-11-16T02:29:38.880867+0000","last_clean":"2023-11-16T02:29:38.880867+0000","last_became_active":"2023-11-16T02:29:37.532348+0000","last_became_peered":"2023-11-16T02:29:37.532348+0000","last_unstale":"2023-11-16T02:29:38.880867+0000","last_undegraded":"2023-11-16T02:29:38.880867+0000","last_fullsized":"2023-11-16T02:29:38.880867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:42:27.512040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891116+0000","last_change":"2023-11-16T02:29:37.892758+0000","last_active":"2023-11-16T02:29:39.891116+0000","last_peered":"2023-11-16T02:29:39.891116+0000","last_clean":"2023-11-16T02:29:39.891116+0000","last_became_active":"2023-11-16T02:29:37.892403+0000","last_became_peered":"2023-11-16T02:29:37.892403+0000","last_unstale":"2023-11-16T02:29:39.891116+0000","last_undegraded":"2023-11-16T02:29:39.891116+0000","last_fullsized":"2023-11-16T02:29:39.891116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T02:37:34.677034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892115+0000","last_change":"2023-11-16T02:29:37.539865+0000","last_active":"2023-11-16T02:29:39.892115+0000","last_peered":"2023-11-16T02:29:39.892115+0000","last_clean":"2023-11-16T02:29:39.892115+0000","last_became_active":"2023-11-16T02:29:37.538829+0000","last_became_peered":"2023-11-16T02:29:37.538829+0000","last_unstale":"2023-11-16T02:29:39.892115+0000","last_undegraded":"2023-11-16T02:29:39.892115+0000","last_fullsized":"2023-11-16T02:29:39.892115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:09:37.990889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892445+0000","last_change":"2023-11-16T02:29:37.924136+0000","last_active":"2023-11-16T02:29:39.892445+0000","last_peered":"2023-11-16T02:29:39.892445+0000","last_clean":"2023-11-16T02:29:39.892445+0000","last_became_active":"2023-11-16T02:29:37.922911+0000","last_became_peered":"2023-11-16T02:29:37.922911+0000","last_unstale":"2023-11-16T02:29:39.892445+0000","last_undegraded":"2023-11-16T02:29:39.892445+0000","last_fullsized":"2023-11-16T02:29:39.892445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:45:12.383063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878567+0000","last_change":"2023-11-16T02:29:37.530829+0000","last_active":"2023-11-16T02:29:38.878567+0000","last_peered":"2023-11-16T02:29:38.878567+0000","last_clean":"2023-11-16T02:29:38.878567+0000","last_became_active":"2023-11-16T02:29:37.530464+0000","last_became_peered":"2023-11-16T02:29:37.530464+0000","last_unstale":"2023-11-16T02:29:38.878567+0000","last_undegraded":"2023-11-16T02:29:38.878567+0000","last_fullsized":"2023-11-16T02:29:38.878567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:42:27.512040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892249+0000","last_change":"2023-11-16T02:29:37.886780+0000","last_active":"2023-11-16T02:29:39.892249+0000","last_peered":"2023-11-16T02:29:39.892249+0000","last_clean":"2023-11-16T02:29:39.892249+0000","last_became_active":"2023-11-16T02:29:37.885971+0000","last_became_peered":"2023-11-16T02:29:37.885971+0000","last_unstale":"2023-11-16T02:29:39.892249+0000","last_undegraded":"2023-11-16T02:29:39.892249+0000","last_fullsized":"2023-11-16T02:29:39.892249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:09:55.065210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878991+0000","last_change":"2023-11-16T02:29:37.518075+0000","last_active":"2023-11-16T02:29:38.878991+0000","last_peered":"2023-11-16T02:29:38.878991+0000","last_clean":"2023-11-16T02:29:38.878991+0000","last_became_active":"2023-11-16T02:29:37.517639+0000","last_became_peered":"2023-11-16T02:29:37.517639+0000","last_unstale":"2023-11-16T02:29:38.878991+0000","last_undegraded":"2023-11-16T02:29:38.878991+0000","last_fullsized":"2023-11-16T02:29:38.878991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:57:02.655084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891316+0000","last_change":"2023-11-16T02:29:37.895705+0000","last_active":"2023-11-16T02:29:39.891316+0000","last_peered":"2023-11-16T02:29:39.891316+0000","last_clean":"2023-11-16T02:29:39.891316+0000","last_became_active":"2023-11-16T02:29:37.895416+0000","last_became_peered":"2023-11-16T02:29:37.895416+0000","last_unstale":"2023-11-16T02:29:39.891316+0000","last_undegraded":"2023-11-16T02:29:39.891316+0000","last_fullsized":"2023-11-16T02:29:39.891316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:43:20.665096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893707+0000","last_change":"2023-11-16T02:29:37.544189+0000","last_active":"2023-11-16T02:29:39.893707+0000","last_peered":"2023-11-16T02:29:39.893707+0000","last_clean":"2023-11-16T02:29:39.893707+0000","last_became_active":"2023-11-16T02:29:37.543571+0000","last_became_peered":"2023-11-16T02:29:37.543571+0000","last_unstale":"2023-11-16T02:29:39.893707+0000","last_undegraded":"2023-11-16T02:29:39.893707+0000","last_fullsized":"2023-11-16T02:29:39.893707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:07:57.498670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880376+0000","last_change":"2023-11-16T02:29:37.928251+0000","last_active":"2023-11-16T02:29:38.880376+0000","last_peered":"2023-11-16T02:29:38.880376+0000","last_clean":"2023-11-16T02:29:38.880376+0000","last_became_active":"2023-11-16T02:29:37.927716+0000","last_became_peered":"2023-11-16T02:29:37.927716+0000","last_unstale":"2023-11-16T02:29:38.880376+0000","last_undegraded":"2023-11-16T02:29:38.880376+0000","last_fullsized":"2023-11-16T02:29:38.880376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:25:48.005968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881803+0000","last_change":"2023-11-16T02:29:37.939219+0000","last_active":"2023-11-16T02:29:38.881803+0000","last_peered":"2023-11-16T02:29:38.881803+0000","last_clean":"2023-11-16T02:29:38.881803+0000","last_became_active":"2023-11-16T02:29:37.938582+0000","last_became_peered":"2023-11-16T02:29:37.938582+0000","last_unstale":"2023-11-16T02:29:38.881803+0000","last_undegraded":"2023-11-16T02:29:38.881803+0000","last_fullsized":"2023-11-16T02:29:38.881803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:43:20.665096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893385+0000","last_change":"2023-11-16T02:29:37.549085+0000","last_active":"2023-11-16T02:29:39.893385+0000","last_peered":"2023-11-16T02:29:39.893385+0000","last_clean":"2023-11-16T02:29:39.893385+0000","last_became_active":"2023-11-16T02:29:37.548532+0000","last_became_peered":"2023-11-16T02:29:37.548532+0000","last_unstale":"2023-11-16T02:29:39.893385+0000","last_undegraded":"2023-11-16T02:29:39.893385+0000","last_fullsized":"2023-11-16T02:29:39.893385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:21:31.762437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881938+0000","last_change":"2023-11-16T02:29:37.936750+0000","last_active":"2023-11-16T02:29:38.881938+0000","last_peered":"2023-11-16T02:29:38.881938+0000","last_clean":"2023-11-16T02:29:38.881938+0000","last_became_active":"2023-11-16T02:29:37.936169+0000","last_became_peered":"2023-11-16T02:29:37.936169+0000","last_unstale":"2023-11-16T02:29:38.881938+0000","last_undegraded":"2023-11-16T02:29:38.881938+0000","last_fullsized":"2023-11-16T02:29:38.881938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:10:43.990221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893640+0000","last_change":"2023-11-16T02:29:37.543752+0000","last_active":"2023-11-16T02:29:39.893640+0000","last_peered":"2023-11-16T02:29:39.893640+0000","last_clean":"2023-11-16T02:29:39.893640+0000","last_became_active":"2023-11-16T02:29:37.543157+0000","last_became_peered":"2023-11-16T02:29:37.543157+0000","last_unstale":"2023-11-16T02:29:39.893640+0000","last_undegraded":"2023-11-16T02:29:39.893640+0000","last_fullsized":"2023-11-16T02:29:39.893640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:04:23.421210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891041+0000","last_change":"2023-11-16T02:29:37.928390+0000","last_active":"2023-11-16T02:29:39.891041+0000","last_peered":"2023-11-16T02:29:39.891041+0000","last_clean":"2023-11-16T02:29:39.891041+0000","last_became_active":"2023-11-16T02:29:37.928152+0000","last_became_peered":"2023-11-16T02:29:37.928152+0000","last_unstale":"2023-11-16T02:29:39.891041+0000","last_undegraded":"2023-11-16T02:29:39.891041+0000","last_fullsized":"2023-11-16T02:29:39.891041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:10:43.990221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891480+0000","last_change":"2023-11-16T02:29:37.516960+0000","last_active":"2023-11-16T02:29:39.891480+0000","last_peered":"2023-11-16T02:29:39.891480+0000","last_clean":"2023-11-16T02:29:39.891480+0000","last_became_active":"2023-11-16T02:29:37.516030+0000","last_became_peered":"2023-11-16T02:29:37.516030+0000","last_unstale":"2023-11-16T02:29:39.891480+0000","last_undegraded":"2023-11-16T02:29:39.891480+0000","last_fullsized":"2023-11-16T02:29:39.891480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:44:21.321181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891358+0000","last_change":"2023-11-16T02:29:37.909668+0000","last_active":"2023-11-16T02:29:39.891358+0000","last_peered":"2023-11-16T02:29:39.891358+0000","last_clean":"2023-11-16T02:29:39.891358+0000","last_became_active":"2023-11-16T02:29:37.909339+0000","last_became_peered":"2023-11-16T02:29:37.909339+0000","last_unstale":"2023-11-16T02:29:39.891358+0000","last_undegraded":"2023-11-16T02:29:39.891358+0000","last_fullsized":"2023-11-16T02:29:39.891358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:25:48.005968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891428+0000","last_change":"2023-11-16T02:29:37.537280+0000","last_active":"2023-11-16T02:29:39.891428+0000","last_peered":"2023-11-16T02:29:39.891428+0000","last_clean":"2023-11-16T02:29:39.891428+0000","last_became_active":"2023-11-16T02:29:37.536813+0000","last_became_peered":"2023-11-16T02:29:37.536813+0000","last_unstale":"2023-11-16T02:29:39.891428+0000","last_undegraded":"2023-11-16T02:29:39.891428+0000","last_fullsized":"2023-11-16T02:29:39.891428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:44:21.321181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":819200,"data_stored":667190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]}]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31276,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340564,"statfs":{"total":96636764160,"available":96604737536,"internally_reserved":0,"allocated":233472,"data_stored":77804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.929}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.502}]}]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31268,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340572,"statfs":{"total":96636764160,"available":96604745728,"internally_reserved":0,"allocated":225280,"data_stored":76330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31276,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340564,"statfs":{"total":96636764160,"available":96604737536,"internally_reserved":0,"allocated":233472,"data_stored":76366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1759999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31276,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340564,"statfs":{"total":96636764160,"available":96604737536,"internally_reserved":0,"allocated":233472,"data_stored":77804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31272,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340568,"statfs":{"total":96636764160,"available":96604741632,"internally_reserved":0,"allocated":229376,"data_stored":76400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":827392,"data_stored":667246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31264,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340576,"statfs":{"total":96636764160,"available":96604749824,"internally_reserved":0,"allocated":221184,"data_stored":76240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-16T02:29:46.730 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-16T02:29:46.730 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-16T02:29:46.730 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-16T02:29:46.730 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-16T02:29:46.731 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-16T02:29:46.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.885+0000 7fa792536640 1 Processor -- start 2023-11-16T02:29:46.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.885+0000 7fa792536640 1 -- start start 2023-11-16T02:29:46.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa792536640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa78c147910 0x7fa78c147da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:46.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa792536640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa78c06d790 con 0x7fa78c0b8c90 2023-11-16T02:29:46.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa792536640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa78c06cbf0 con 0x7fa78c0b2180 2023-11-16T02:29:46.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa792536640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa78c148840 con 0x7fa78c147910 2023-11-16T02:29:46.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa78bfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fa78c0b8c90 0x7fa78c06d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:39712/0 (socket says 172.21.15.28:39712) 2023-11-16T02:29:46.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa78bfff640 1 -- 172.21.15.28:0/1046939645 learned_addr learned my addr 172.21.15.28:0/1046939645 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:46.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa790ad3640 1 --2- 172.21.15.28:0/1046939645 >> v2:172.21.15.70:3300/0 conn(0x7fa78c147910 0x7fa78c147da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:46.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa78affd640 1 -- 172.21.15.28:0/1046939645 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629233667 0 0) 0x7fa77c0014a0 con 0x7fa78c0b8c90 2023-11-16T02:29:46.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa78affd640 1 -- 172.21.15.28:0/1046939645 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa774003530 con 0x7fa78c0b8c90 2023-11-16T02:29:46.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa78affd640 1 -- 172.21.15.28:0/1046939645 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 115140270 0 0) 0x7fa774003530 con 0x7fa78c0b8c90 2023-11-16T02:29:46.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa78affd640 1 -- 172.21.15.28:0/1046939645 >> v2:172.21.15.70:3300/0 conn(0x7fa78c147910 msgr2=0x7fa78c147da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:46.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa78affd640 1 --2- 172.21.15.28:0/1046939645 >> v2:172.21.15.70:3300/0 conn(0x7fa78c147910 0x7fa78c147da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:46.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa78affd640 1 -- 172.21.15.28:0/1046939645 >> v1:172.21.15.70:6789/0 conn(0x7fa78c0b2180 legacy=0x7fa78c1418d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:46.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa78affd640 1 -- 172.21.15.28:0/1046939645 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78c1482e0 con 0x7fa78c0b8c90 2023-11-16T02:29:46.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa78affd640 1 -- 172.21.15.28:0/1046939645 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7fa77c001b90 con 0x7fa78c0b8c90 2023-11-16T02:29:46.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa78affd640 1 -- 172.21.15.28:0/1046939645 >> v1:172.21.15.28:6789/0 conn(0x7fa78c0b8c90 legacy=0x7fa78c06d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:46.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa78affd640 1 --2- 172.21.15.28:0/1046939645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa774003980 0x7fa774003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:46.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa78affd640 1 --2- 172.21.15.28:0/1046939645 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa7740047d0 0x7fa774004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:46.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa78affd640 1 --2- 172.21.15.28:0/1046939645 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa774005190 0x7fa77400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:46.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa78affd640 1 -- 172.21.15.28:0/1046939645 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c148840 con 0x7fa7740047d0 2023-11-16T02:29:46.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa78affd640 1 -- 172.21.15.28:0/1046939645 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77400c030 con 0x7fa774003980 2023-11-16T02:29:46.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa78affd640 1 -- 172.21.15.28:0/1046939645 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77400c1f0 con 0x7fa774005190 2023-11-16T02:29:46.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa78b7fe640 1 --2- 172.21.15.28:0/1046939645 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa7740047d0 0x7fa774004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:46.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa790ad3640 1 --2- 172.21.15.28:0/1046939645 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa774005190 0x7fa77400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:46.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa78bfff640 1 --2- 172.21.15.28:0/1046939645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa774003980 0x7fa774003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:46.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa78b7fe640 1 -- 172.21.15.28:0/1046939645 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa774005190 msgr2=0x7fa77400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:46.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa78b7fe640 1 --2- 172.21.15.28:0/1046939645 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa774005190 0x7fa77400b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:46.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa78b7fe640 1 -- 172.21.15.28:0/1046939645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa774003980 msgr2=0x7fa774003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:46.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa78b7fe640 1 --2- 172.21.15.28:0/1046939645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa774003980 0x7fa774003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:46.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa790ad3640 1 -- 172.21.15.28:0/1046939645 reap_dead start 2023-11-16T02:29:46.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa78b7fe640 1 -- 172.21.15.28:0/1046939645 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa774003530 con 0x7fa7740047d0 2023-11-16T02:29:46.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.889+0000 7fa78bfff640 1 --2- 172.21.15.28:0/1046939645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa774003980 0x7fa774003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:46.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa78b7fe640 1 --2- 172.21.15.28:0/1046939645 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa7740047d0 0x7fa774004c50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa780001780 tx=0x7fa78001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ca2b0ac87a3002 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:46.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa78affd640 1 -- 172.21.15.28:0/1046939645 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7800052d0 con 0x7fa7740047d0 2023-11-16T02:29:46.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa78affd640 1 -- 172.21.15.28:0/1046939645 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7800a7050 con 0x7fa7740047d0 2023-11-16T02:29:46.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa78affd640 1 -- 172.21.15.28:0/1046939645 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa780003600 con 0x7fa7740047d0 2023-11-16T02:29:46.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa792536640 1 -- 172.21.15.28:0/1046939645 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa7740047d0 msgr2=0x7fa774004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:46.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa792536640 1 --2- 172.21.15.28:0/1046939645 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa7740047d0 0x7fa774004c50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa780001780 tx=0x7fa78001c390 comp rx=0 tx=0).stop 2023-11-16T02:29:46.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa792536640 1 -- 172.21.15.28:0/1046939645 shutdown_connections 2023-11-16T02:29:46.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa792536640 1 --2- 172.21.15.28:0/1046939645 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa7740047d0 0x7fa774004c50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:46.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa792536640 1 -- 172.21.15.28:0/1046939645 >> 172.21.15.28:0/1046939645 conn(0x7fa78c0b9b20 msgr2=0x7fa78c0b9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:46.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa792536640 1 -- 172.21.15.28:0/1046939645 shutdown_connections 2023-11-16T02:29:46.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa792536640 1 -- 172.21.15.28:0/1046939645 wait complete. 2023-11-16T02:29:46.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa792536640 1 Processor -- start 2023-11-16T02:29:46.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa792536640 1 -- start start 2023-11-16T02:29:46.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa792536640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa7740047d0 0x7fa78c0716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:46.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa792536640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa78c13d6f0 0x7fa78c1e04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:46.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa792536640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa78c1e09e0 0x7fa78c13a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:46.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa792536640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c1e4900 con 0x7fa78c13d6f0 2023-11-16T02:29:46.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa792536640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c071be0 con 0x7fa78c1e09e0 2023-11-16T02:29:46.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa792536640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c1e3b40 con 0x7fa7740047d0 2023-11-16T02:29:46.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa78b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa78c13d6f0 0x7fa78c1e04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:46.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa78b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa78c13d6f0 0x7fa78c1e04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40956/0 (socket says 172.21.15.28:40956) 2023-11-16T02:29:46.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa78b7fe640 1 -- 172.21.15.28:0/1051711762 learned_addr learned my addr 172.21.15.28:0/1051711762 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:46.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa790ad3640 1 --2- 172.21.15.28:0/1051711762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa78c1e09e0 0x7fa78c13a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:46.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa78bfff640 1 --2- 172.21.15.28:0/1051711762 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa7740047d0 0x7fa78c0716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:46.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa78b7fe640 1 -- 172.21.15.28:0/1051711762 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa7740047d0 msgr2=0x7fa78c0716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:46.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa78b7fe640 1 --2- 172.21.15.28:0/1051711762 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa7740047d0 0x7fa78c0716a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:46.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa78b7fe640 1 -- 172.21.15.28:0/1051711762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa78c1e09e0 msgr2=0x7fa78c13a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:46.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa78b7fe640 1 --2- 172.21.15.28:0/1051711762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa78c1e09e0 0x7fa78c13a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:46.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa78b7fe640 1 -- 172.21.15.28:0/1051711762 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78c1e3e20 con 0x7fa78c13d6f0 2023-11-16T02:29:46.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa78b7fe640 1 --2- 172.21.15.28:0/1051711762 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa78c13d6f0 0x7fa78c1e04a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa78001aa90 tx=0x7fa774005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:46.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa788ff9640 1 -- 172.21.15.28:0/1051711762 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa780007500 con 0x7fa78c13d6f0 2023-11-16T02:29:46.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa788ff9640 1 -- 172.21.15.28:0/1051711762 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa780007660 con 0x7fa78c13d6f0 2023-11-16T02:29:46.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa792536640 1 -- 172.21.15.28:0/1051711762 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa78c1e4100 con 0x7fa78c13d6f0 2023-11-16T02:29:46.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa788ff9640 1 -- 172.21.15.28:0/1051711762 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa780006a00 con 0x7fa78c13d6f0 2023-11-16T02:29:46.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.893+0000 7fa792536640 1 -- 172.21.15.28:0/1051711762 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa78c1d20b0 con 0x7fa78c13d6f0 2023-11-16T02:29:46.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.897+0000 7fa792536640 1 -- 172.21.15.28:0/1051711762 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa78c1d22a0 con 0x7fa78c13d6f0 2023-11-16T02:29:46.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.897+0000 7fa788ff9640 1 -- 172.21.15.28:0/1051711762 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa780006b60 con 0x7fa78c13d6f0 2023-11-16T02:29:46.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.897+0000 7fa788ff9640 1 --2- 172.21.15.28:0/1051711762 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fa778065a60 0x7fa778067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:46.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.897+0000 7fa788ff9640 1 -- 172.21.15.28:0/1051711762 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa78011d400 con 0x7fa78c13d6f0 2023-11-16T02:29:46.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.897+0000 7fa78bfff640 1 --2- 172.21.15.28:0/1051711762 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fa778065a60 0x7fa778067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:46.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.897+0000 7fa78bfff640 1 --2- 172.21.15.28:0/1051711762 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fa778065a60 0x7fa778067f20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa77c001720 tx=0x7fa77c0012a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:46.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:46.901+0000 7fa788ff9640 1 -- 172.21.15.28:0/1051711762 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fa7800eadd0 con 0x7fa78c13d6f0 2023-11-16T02:29:47.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.089+0000 7fa792536640 1 -- 172.21.15.28:0/1051711762 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa78c066f00 con 0x7fa78c13d6f0 2023-11-16T02:29:47.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.093+0000 7fa788ff9640 1 -- 172.21.15.28:0/1051711762 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163362 (secure 0 0 0) 0x7fa7800ee3f0 con 0x7fa78c13d6f0 2023-11-16T02:29:47.099 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:47.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.097+0000 7fa792536640 1 -- 172.21.15.28:0/1051711762 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fa778065a60 msgr2=0x7fa778067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.097+0000 7fa792536640 1 --2- 172.21.15.28:0/1051711762 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fa778065a60 0x7fa778067f20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa77c001720 tx=0x7fa77c0012a0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.097+0000 7fa792536640 1 -- 172.21.15.28:0/1051711762 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa78c13d6f0 msgr2=0x7fa78c1e04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.097+0000 7fa792536640 1 --2- 172.21.15.28:0/1051711762 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa78c13d6f0 0x7fa78c1e04a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa78001aa90 tx=0x7fa774005800 comp rx=0 tx=0).stop 2023-11-16T02:29:47.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.097+0000 7fa792536640 1 -- 172.21.15.28:0/1051711762 shutdown_connections 2023-11-16T02:29:47.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.097+0000 7fa792536640 1 --2- 172.21.15.28:0/1051711762 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fa778065a60 0x7fa778067f20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.097+0000 7fa792536640 1 --2- 172.21.15.28:0/1051711762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa78c1e09e0 0x7fa78c13a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.097+0000 7fa792536640 1 --2- 172.21.15.28:0/1051711762 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa78c13d6f0 0x7fa78c1e04a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.097+0000 7fa792536640 1 --2- 172.21.15.28:0/1051711762 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa7740047d0 0x7fa78c0716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.097+0000 7fa792536640 1 -- 172.21.15.28:0/1051711762 >> 172.21.15.28:0/1051711762 conn(0x7fa78c0b9b20 msgr2=0x7fa78c13e450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:47.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.097+0000 7fa792536640 1 -- 172.21.15.28:0/1051711762 shutdown_connections 2023-11-16T02:29:47.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.097+0000 7fa792536640 1 -- 172.21.15.28:0/1051711762 wait complete. 2023-11-16T02:29:47.117 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":38651},{"type":"v1","addr":"172.21.15.28:6833","nonce":38651}]},"active_addr":"172.21.15.28:6833/38651","active_change":"2023-11-16T02:29:18.398890+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4117,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.28:0","nonce":454546293}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.28:0","nonce":3365339294}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.28:0","nonce":4090268709}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.28:0","nonce":1361966492}]}]} 2023-11-16T02:29:47.121 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-16T02:29:47.121 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-16T02:29:47.121 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-16T02:29:47.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.237+0000 7ff4c832d640 1 Processor -- start 2023-11-16T02:29:47.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.237+0000 7ff4c832d640 1 -- start start 2023-11-16T02:29:47.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.237+0000 7ff4c832d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff4c00b8240 0x7ff4c00bc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.237+0000 7ff4c832d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4c00b3b60 0x7ff4c01532a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.237+0000 7ff4c832d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c00b52b0 con 0x7ff4c0148960 2023-11-16T02:29:47.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.237+0000 7ff4c832d640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c00b6220 con 0x7ff4c00b8240 2023-11-16T02:29:47.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.237+0000 7ff4c832d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c00b4040 con 0x7ff4c00b3b60 2023-11-16T02:29:47.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.241+0000 7ff4c58c8640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7ff4c0148960 0x7ff4c00b3450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.28:37976/0 (socket says 172.21.15.28:37976) 2023-11-16T02:29:47.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.241+0000 7ff4c58c8640 1 -- 172.21.15.28:0/1927141839 learned_addr learned my addr 172.21.15.28:0/1927141839 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:47.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.241+0000 7ff4c68ca640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4c00b3b60 0x7ff4c01532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.241+0000 7ff4c60c9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff4c00b8240 0x7ff4c00bc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.241+0000 7ff4c60c9640 1 -- 172.21.15.28:0/1927141839 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4c00b3b60 msgr2=0x7ff4c01532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:47.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.241+0000 7ff4c60c9640 1 --2- 172.21.15.28:0/1927141839 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4c00b3b60 0x7ff4c01532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.241+0000 7ff4c60c9640 1 -- 172.21.15.28:0/1927141839 >> v1:172.21.15.70:6789/0 conn(0x7ff4c0148960 legacy=0x7ff4c00b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.241+0000 7ff4c60c9640 1 -- 172.21.15.28:0/1927141839 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c00b5a20 con 0x7ff4c00b8240 2023-11-16T02:29:47.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.241+0000 7ff4c68ca640 1 --2- 172.21.15.28:0/1927141839 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4c00b3b60 0x7ff4c01532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-16T02:29:47.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.241+0000 7ff4c60c9640 1 --2- 172.21.15.28:0/1927141839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c00b8240 0x7ff4c00bc6a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc0097c0 tx=0x7ff4bc01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55bcce17e60b397b server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.241+0000 7ff4c50c7640 1 -- 172.21.15.28:0/1927141839 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc0ad660 con 0x7ff4c00b8240 2023-11-16T02:29:47.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.241+0000 7ff4c50c7640 1 -- 172.21.15.28:0/1927141839 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4bc0ad7c0 con 0x7ff4c00b8240 2023-11-16T02:29:47.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.241+0000 7ff4c50c7640 1 -- 172.21.15.28:0/1927141839 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc0adb50 con 0x7ff4c00b8240 2023-11-16T02:29:47.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c832d640 1 -- 172.21.15.28:0/1927141839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c00b8240 msgr2=0x7ff4c00bc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c832d640 1 --2- 172.21.15.28:0/1927141839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c00b8240 0x7ff4c00bc6a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc0097c0 tx=0x7ff4bc01c450 comp rx=0 tx=0).stop 2023-11-16T02:29:47.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c832d640 1 -- 172.21.15.28:0/1927141839 shutdown_connections 2023-11-16T02:29:47.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c832d640 1 --2- 172.21.15.28:0/1927141839 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4c00b3b60 0x7ff4c01532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c832d640 1 --2- 172.21.15.28:0/1927141839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c00b8240 0x7ff4c00bc6a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c832d640 1 -- 172.21.15.28:0/1927141839 >> 172.21.15.28:0/1927141839 conn(0x7ff4c00b9050 msgr2=0x7ff4c00bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:47.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c832d640 1 -- 172.21.15.28:0/1927141839 shutdown_connections 2023-11-16T02:29:47.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c832d640 1 -- 172.21.15.28:0/1927141839 wait complete. 2023-11-16T02:29:47.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c832d640 1 Processor -- start 2023-11-16T02:29:47.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c832d640 1 -- start start 2023-11-16T02:29:47.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c832d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4c00b3b60 0x7ff4c0141970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c832d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4c00b8240 0x7ff4c013d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c832d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c0148960 0x7ff4c01e6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c832d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c013dee0 con 0x7ff4c00b3b60 2023-11-16T02:29:47.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c832d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c01e6c40 con 0x7ff4c0148960 2023-11-16T02:29:47.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c832d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c0070080 con 0x7ff4c00b8240 2023-11-16T02:29:47.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c60c9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4c00b3b60 0x7ff4c0141970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c60c9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4c00b3b60 0x7ff4c0141970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40966/0 (socket says 172.21.15.28:40966) 2023-11-16T02:29:47.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c60c9640 1 -- 172.21.15.28:0/3424483381 learned_addr learned my addr 172.21.15.28:0/3424483381 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:47.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c68ca640 1 --2- 172.21.15.28:0/3424483381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c0148960 0x7ff4c01e6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c58c8640 1 --2- 172.21.15.28:0/3424483381 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4c00b8240 0x7ff4c013d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c60c9640 1 -- 172.21.15.28:0/3424483381 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4c00b8240 msgr2=0x7ff4c013d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c60c9640 1 --2- 172.21.15.28:0/3424483381 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4c00b8240 0x7ff4c013d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c60c9640 1 -- 172.21.15.28:0/3424483381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c0148960 msgr2=0x7ff4c01e6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c60c9640 1 --2- 172.21.15.28:0/3424483381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c0148960 0x7ff4c01e6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c60c9640 1 -- 172.21.15.28:0/3424483381 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b8009a70 con 0x7ff4c00b3b60 2023-11-16T02:29:47.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c68ca640 1 --2- 172.21.15.28:0/3424483381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c0148960 0x7ff4c01e6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:29:47.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c60c9640 1 --2- 172.21.15.28:0/3424483381 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4c00b3b60 0x7ff4c0141970 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc01a080 tx=0x7ff4bc0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4b6ffd640 1 -- 172.21.15.28:0/3424483381 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc0bc070 con 0x7ff4c00b3b60 2023-11-16T02:29:47.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4b6ffd640 1 -- 172.21.15.28:0/3424483381 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4bc0b6400 con 0x7ff4c00b3b60 2023-11-16T02:29:47.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c832d640 1 -- 172.21.15.28:0/3424483381 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4bc009420 con 0x7ff4c00b3b60 2023-11-16T02:29:47.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4b6ffd640 1 -- 172.21.15.28:0/3424483381 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc0b67d0 con 0x7ff4c00b3b60 2023-11-16T02:29:47.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.245+0000 7ff4c832d640 1 -- 172.21.15.28:0/3424483381 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c0070320 con 0x7ff4c00b3b60 2023-11-16T02:29:47.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.249+0000 7ff4c832d640 1 -- 172.21.15.28:0/3424483381 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c004e8a0 con 0x7ff4c00b3b60 2023-11-16T02:29:47.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.249+0000 7ff4b6ffd640 1 -- 172.21.15.28:0/3424483381 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff4bc0b4040 con 0x7ff4c00b3b60 2023-11-16T02:29:47.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.249+0000 7ff4b6ffd640 1 --2- 172.21.15.28:0/3424483381 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff4a4065a60 0x7ff4a4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.249+0000 7ff4b6ffd640 1 -- 172.21.15.28:0/3424483381 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4bc11cbc0 con 0x7ff4c00b3b60 2023-11-16T02:29:47.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.249+0000 7ff4c58c8640 1 --2- 172.21.15.28:0/3424483381 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff4a4065a60 0x7ff4a4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.249+0000 7ff4c58c8640 1 --2- 172.21.15.28:0/3424483381 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff4a4065a60 0x7ff4a4067f20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff4c00bb120 tx=0x7ff4b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.253+0000 7ff4b6ffd640 1 -- 172.21.15.28:0/3424483381 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7ff4bc0ea570 con 0x7ff4c00b3b60 2023-11-16T02:29:47.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.401+0000 7ff4c832d640 1 -- 172.21.15.28:0/3424483381 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4c00b6420 con 0x7ff4c00b3b60 2023-11-16T02:29:47.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.405+0000 7ff4b6ffd640 1 -- 172.21.15.28:0/3424483381 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15989 (secure 0 0 0) 0x7ff4bc0edb90 con 0x7ff4c00b3b60 2023-11-16T02:29:47.408 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:47.409 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":22,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","created":"2023-11-16T02:29:13.710567+0000","modified":"2023-11-16T02:29:38.871066+0000","last_up_change":"2023-11-16T02:29:24.841087+0000","last_in_change":"2023-11-16T02:29:16.024490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-16T02:29:26.490910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-16T02:29:36.133224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-16T02:29:36.866156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dfa8b58d-3481-4e68-86e8-21873d31d0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":38722},{"type":"v1","addr":"172.21.15.28:6809","nonce":38722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":38722},{"type":"v1","addr":"172.21.15.28:6811","nonce":38722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":38722},{"type":"v1","addr":"172.21.15.28:6815","nonce":38722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":38722},{"type":"v1","addr":"172.21.15.28:6813","nonce":38722}]},"public_addr":"172.21.15.28:6809/38722","cluster_addr":"172.21.15.28:6811/38722","heartbeat_back_addr":"172.21.15.28:6815/38722","heartbeat_front_addr":"172.21.15.28:6813/38722","state":["exists","up"]},{"osd":1,"uuid":"1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":38724},{"type":"v1","addr":"172.21.15.28:6824","nonce":38724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":38724},{"type":"v1","addr":"172.21.15.28:6827","nonce":38724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":38724},{"type":"v1","addr":"172.21.15.28:6831","nonce":38724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":38724},{"type":"v1","addr":"172.21.15.28:6829","nonce":38724}]},"public_addr":"172.21.15.28:6824/38724","cluster_addr":"172.21.15.28:6827/38724","heartbeat_back_addr":"172.21.15.28:6831/38724","heartbeat_front_addr":"172.21.15.28:6829/38724","state":["exists","up"]},{"osd":2,"uuid":"e18f39cd-6a35-4d36-9eed-3877794bf2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":38723},{"type":"v1","addr":"172.21.15.28:6801","nonce":38723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":38723},{"type":"v1","addr":"172.21.15.28:6803","nonce":38723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":38723},{"type":"v1","addr":"172.21.15.28:6807","nonce":38723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":38723},{"type":"v1","addr":"172.21.15.28:6805","nonce":38723}]},"public_addr":"172.21.15.28:6801/38723","cluster_addr":"172.21.15.28:6803/38723","heartbeat_back_addr":"172.21.15.28:6807/38723","heartbeat_front_addr":"172.21.15.28:6805/38723","state":["exists","up"]},{"osd":3,"uuid":"303d0728-409d-47d7-b7a6-6eb273f602fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":38725},{"type":"v1","addr":"172.21.15.28:6817","nonce":38725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":38725},{"type":"v1","addr":"172.21.15.28:6819","nonce":38725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":38725},{"type":"v1","addr":"172.21.15.28:6825","nonce":38725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":38725},{"type":"v1","addr":"172.21.15.28:6821","nonce":38725}]},"public_addr":"172.21.15.28:6817/38725","cluster_addr":"172.21.15.28:6819/38725","heartbeat_back_addr":"172.21.15.28:6825/38725","heartbeat_front_addr":"172.21.15.28:6821/38725","state":["exists","up"]},{"osd":4,"uuid":"df0bf0ac-6efe-4964-ad27-7c1771a70c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":38828},{"type":"v1","addr":"172.21.15.70:6801","nonce":38828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":38828},{"type":"v1","addr":"172.21.15.70:6803","nonce":38828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":38828},{"type":"v1","addr":"172.21.15.70:6807","nonce":38828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":38828},{"type":"v1","addr":"172.21.15.70:6805","nonce":38828}]},"public_addr":"172.21.15.70:6801/38828","cluster_addr":"172.21.15.70:6803/38828","heartbeat_back_addr":"172.21.15.70:6807/38828","heartbeat_front_addr":"172.21.15.70:6805/38828","state":["exists","up"]},{"osd":5,"uuid":"84921219-65cb-4c4e-b9ed-a773db639034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":38830},{"type":"v1","addr":"172.21.15.70:6810","nonce":38830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6813","nonce":38830},{"type":"v1","addr":"172.21.15.70:6814","nonce":38830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":38830},{"type":"v1","addr":"172.21.15.70:6824","nonce":38830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":38830},{"type":"v1","addr":"172.21.15.70:6819","nonce":38830}]},"public_addr":"172.21.15.70:6810/38830","cluster_addr":"172.21.15.70:6814/38830","heartbeat_back_addr":"172.21.15.70:6824/38830","heartbeat_front_addr":"172.21.15.70:6819/38830","state":["exists","up"]},{"osd":6,"uuid":"c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":38829},{"type":"v1","addr":"172.21.15.70:6812","nonce":38829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":38829},{"type":"v1","addr":"172.21.15.70:6820","nonce":38829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":38829},{"type":"v1","addr":"172.21.15.70:6828","nonce":38829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":38829},{"type":"v1","addr":"172.21.15.70:6825","nonce":38829}]},"public_addr":"172.21.15.70:6812/38829","cluster_addr":"172.21.15.70:6820/38829","heartbeat_back_addr":"172.21.15.70:6828/38829","heartbeat_front_addr":"172.21.15.70:6825/38829","state":["exists","up"]},{"osd":7,"uuid":"e2cdd418-12ce-4eea-9b22-efdad83eb76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":38839},{"type":"v1","addr":"172.21.15.70:6815","nonce":38839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":38839},{"type":"v1","addr":"172.21.15.70:6823","nonce":38839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":38839},{"type":"v1","addr":"172.21.15.70:6831","nonce":38839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6827","nonce":38839},{"type":"v1","addr":"172.21.15.70:6829","nonce":38839}]},"public_addr":"172.21.15.70:6815/38839","cluster_addr":"172.21.15.70:6823/38839","heartbeat_back_addr":"172.21.15.70:6831/38839","heartbeat_front_addr":"172.21.15.70:6829/38839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.544240+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.637637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.352115+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.652916+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.624477+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.570247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.706468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.696574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-16T02:29:47.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.405+0000 7ff4c832d640 1 -- 172.21.15.28:0/3424483381 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff4a4065a60 msgr2=0x7ff4a4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.405+0000 7ff4c832d640 1 --2- 172.21.15.28:0/3424483381 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff4a4065a60 0x7ff4a4067f20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff4c00bb120 tx=0x7ff4b0009040 comp rx=0 tx=0).stop 2023-11-16T02:29:47.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.405+0000 7ff4c832d640 1 -- 172.21.15.28:0/3424483381 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4c00b3b60 msgr2=0x7ff4c0141970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.405+0000 7ff4c832d640 1 --2- 172.21.15.28:0/3424483381 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4c00b3b60 0x7ff4c0141970 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc01a080 tx=0x7ff4bc0191f0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.405+0000 7ff4c832d640 1 -- 172.21.15.28:0/3424483381 shutdown_connections 2023-11-16T02:29:47.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.405+0000 7ff4c832d640 1 --2- 172.21.15.28:0/3424483381 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff4a4065a60 0x7ff4a4067f20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.405+0000 7ff4c832d640 1 --2- 172.21.15.28:0/3424483381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c0148960 0x7ff4c01e6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.405+0000 7ff4c832d640 1 --2- 172.21.15.28:0/3424483381 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff4c00b8240 0x7ff4c013d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.405+0000 7ff4c832d640 1 --2- 172.21.15.28:0/3424483381 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff4c00b3b60 0x7ff4c0141970 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.405+0000 7ff4c832d640 1 -- 172.21.15.28:0/3424483381 >> 172.21.15.28:0/3424483381 conn(0x7ff4c00b9050 msgr2=0x7ff4c00715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:47.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.405+0000 7ff4c832d640 1 -- 172.21.15.28:0/3424483381 shutdown_connections 2023-11-16T02:29:47.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.405+0000 7ff4c832d640 1 -- 172.21.15.28:0/3424483381 wait complete. 2023-11-16T02:29:47.426 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-16T02:29:47.426 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-16T02:29:47.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.545+0000 7f096b7d7640 1 Processor -- start 2023-11-16T02:29:47.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.545+0000 7f096b7d7640 1 -- start start 2023-11-16T02:29:47.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.545+0000 7f096b7d7640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0964148960 0x7f0964148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.545+0000 7f096b7d7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f09640b3450 0x7f09640b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.545+0000 7f096b7d7640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09640b52b0 con 0x7f09640b8240 2023-11-16T02:29:47.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.545+0000 7f096b7d7640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09640b3e20 con 0x7f09640b3450 2023-11-16T02:29:47.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.545+0000 7f096b7d7640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09640bcdb0 con 0x7f0964148960 2023-11-16T02:29:47.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.545+0000 7f0969d74640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f09640b3450 0x7f09640b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.545+0000 7f0969d74640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f09640b3450 0x7f09640b38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.28:43598/0 (socket says 172.21.15.28:43598) 2023-11-16T02:29:47.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.545+0000 7f0969573640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f09640b8240 0x7f09640bc6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.28:37988/0 (socket says 172.21.15.28:37988) 2023-11-16T02:29:47.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.545+0000 7f0969d74640 1 -- 172.21.15.28:0/1948431693 learned_addr learned my addr 172.21.15.28:0/1948431693 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:47.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.545+0000 7f0968d72640 1 --2- 172.21.15.28:0/1948431693 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0964148960 0x7f0964148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.545+0000 7f0969d74640 1 -- 172.21.15.28:0/1948431693 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0964148960 msgr2=0x7f0964148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:47.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.545+0000 7f0969d74640 1 --2- 172.21.15.28:0/1948431693 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0964148960 0x7f0964148dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.545+0000 7f0969d74640 1 -- 172.21.15.28:0/1948431693 >> v1:172.21.15.70:6789/0 conn(0x7f09640b8240 legacy=0x7f09640bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.550 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.545+0000 7f0969d74640 1 -- 172.21.15.28:0/1948431693 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09640b6220 con 0x7f09640b3450 2023-11-16T02:29:47.550 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.545+0000 7f0968d72640 1 --2- 172.21.15.28:0/1948431693 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0964148960 0x7f0964148dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-16T02:29:47.556 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.549+0000 7f0969d74640 1 --2- 172.21.15.28:0/1948431693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09640b3450 0x7f09640b38e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f095c009870 tx=0x7f095c01c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c47951fd60098427 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.556 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.549+0000 7f0957fff640 1 -- 172.21.15.28:0/1948431693 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c0aa670 con 0x7f09640b3450 2023-11-16T02:29:47.556 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.549+0000 7f0957fff640 1 -- 172.21.15.28:0/1948431693 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095c0aa7d0 con 0x7f09640b3450 2023-11-16T02:29:47.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.549+0000 7f0957fff640 1 -- 172.21.15.28:0/1948431693 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c0aab60 con 0x7f09640b3450 2023-11-16T02:29:47.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.549+0000 7f096b7d7640 1 -- 172.21.15.28:0/1948431693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09640b3450 msgr2=0x7f09640b38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.549+0000 7f096b7d7640 1 --2- 172.21.15.28:0/1948431693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09640b3450 0x7f09640b38e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f095c009870 tx=0x7f095c01c510 comp rx=0 tx=0).stop 2023-11-16T02:29:47.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.549+0000 7f096b7d7640 1 -- 172.21.15.28:0/1948431693 shutdown_connections 2023-11-16T02:29:47.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.549+0000 7f096b7d7640 1 --2- 172.21.15.28:0/1948431693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09640b3450 0x7f09640b38e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.549+0000 7f096b7d7640 1 --2- 172.21.15.28:0/1948431693 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0964148960 0x7f0964148dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.549+0000 7f096b7d7640 1 -- 172.21.15.28:0/1948431693 >> 172.21.15.28:0/1948431693 conn(0x7f09640b9050 msgr2=0x7f09640bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:47.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.549+0000 7f096b7d7640 1 -- 172.21.15.28:0/1948431693 shutdown_connections 2023-11-16T02:29:47.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.549+0000 7f096b7d7640 1 -- 172.21.15.28:0/1948431693 wait complete. 2023-11-16T02:29:47.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.549+0000 7f096b7d7640 1 Processor -- start 2023-11-16T02:29:47.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.549+0000 7f096b7d7640 1 -- start start 2023-11-16T02:29:47.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.549+0000 7f096b7d7640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f09640b3450 0x7f096413dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.549+0000 7f096b7d7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09640b8240 0x7f09640701f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.549+0000 7f096b7d7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0964148960 0x7f0964144130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.549+0000 7f096b7d7640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0964144670 con 0x7f0964148960 2023-11-16T02:29:47.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.549+0000 7f096b7d7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f096413d750 con 0x7f09640b8240 2023-11-16T02:29:47.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.549+0000 7f096b7d7640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0964145fd0 con 0x7f09640b3450 2023-11-16T02:29:47.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.549+0000 7f0969d74640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0964148960 0x7f0964144130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.549+0000 7f0969d74640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0964148960 0x7f0964144130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40970/0 (socket says 172.21.15.28:40970) 2023-11-16T02:29:47.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.549+0000 7f0969d74640 1 -- 172.21.15.28:0/3405489356 learned_addr learned my addr 172.21.15.28:0/3405489356 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:47.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.549+0000 7f0969573640 1 --2- 172.21.15.28:0/3405489356 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f09640b3450 0x7f096413dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.549+0000 7f0968d72640 1 --2- 172.21.15.28:0/3405489356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09640b8240 0x7f09640701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.553+0000 7f0969d74640 1 -- 172.21.15.28:0/3405489356 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f09640b3450 msgr2=0x7f096413dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.553+0000 7f0969d74640 1 --2- 172.21.15.28:0/3405489356 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f09640b3450 0x7f096413dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.553+0000 7f0969d74640 1 -- 172.21.15.28:0/3405489356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09640b8240 msgr2=0x7f09640701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.553+0000 7f0969d74640 1 --2- 172.21.15.28:0/3405489356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09640b8240 0x7f09640701f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.553+0000 7f0969d74640 1 -- 172.21.15.28:0/3405489356 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0960009a70 con 0x7f0964148960 2023-11-16T02:29:47.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.553+0000 7f0968d72640 1 --2- 172.21.15.28:0/3405489356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09640b8240 0x7f09640701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:29:47.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.553+0000 7f0969d74640 1 --2- 172.21.15.28:0/3405489356 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0964148960 0x7f0964144130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f095c01a140 tx=0x7f095c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.553+0000 7f0955ffb640 1 -- 172.21.15.28:0/3405489356 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c0b3800 con 0x7f0964148960 2023-11-16T02:29:47.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.553+0000 7f0955ffb640 1 -- 172.21.15.28:0/3405489356 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095c0b3960 con 0x7f0964148960 2023-11-16T02:29:47.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.553+0000 7f096b7d7640 1 -- 172.21.15.28:0/3405489356 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f095c0094d0 con 0x7f0964148960 2023-11-16T02:29:47.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.553+0000 7f0955ffb640 1 -- 172.21.15.28:0/3405489356 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c0b3cf0 con 0x7f0964148960 2023-11-16T02:29:47.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.553+0000 7f096b7d7640 1 -- 172.21.15.28:0/3405489356 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0964143470 con 0x7f0964148960 2023-11-16T02:29:47.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.553+0000 7f096b7d7640 1 -- 172.21.15.28:0/3405489356 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09641461f0 con 0x7f0964148960 2023-11-16T02:29:47.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.553+0000 7f0955ffb640 1 -- 172.21.15.28:0/3405489356 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f095c0b2380 con 0x7f0964148960 2023-11-16T02:29:47.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.553+0000 7f0955ffb640 1 --2- 172.21.15.28:0/3405489356 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0948065a60 0x7f0948067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.553+0000 7f0955ffb640 1 -- 172.21.15.28:0/3405489356 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f095c11d600 con 0x7f0964148960 2023-11-16T02:29:47.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.553+0000 7f0969573640 1 --2- 172.21.15.28:0/3405489356 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0948065a60 0x7f0948067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.553+0000 7f0969573640 1 --2- 172.21.15.28:0/3405489356 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0948065a60 0x7f0948067f20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0958000f70 tx=0x7f0958007cd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.557+0000 7f0955ffb640 1 -- 172.21.15.28:0/3405489356 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f095c0eb050 con 0x7f0964148960 2023-11-16T02:29:47.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.713+0000 7f096b7d7640 1 -- 172.21.15.28:0/3405489356 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f096413d8e0 con 0x7f0964148960 2023-11-16T02:29:47.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.717+0000 7f0955ffb640 1 -- 172.21.15.28:0/3405489356 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f095c0ee670 con 0x7f0964148960 2023-11-16T02:29:47.723 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:47.724 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":22,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","created":"2023-11-16T02:29:13.710567+0000","modified":"2023-11-16T02:29:38.871066+0000","last_up_change":"2023-11-16T02:29:24.841087+0000","last_in_change":"2023-11-16T02:29:16.024490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-16T02:29:26.490910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-16T02:29:36.133224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-16T02:29:36.866156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dfa8b58d-3481-4e68-86e8-21873d31d0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":38722},{"type":"v1","addr":"172.21.15.28:6809","nonce":38722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":38722},{"type":"v1","addr":"172.21.15.28:6811","nonce":38722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":38722},{"type":"v1","addr":"172.21.15.28:6815","nonce":38722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":38722},{"type":"v1","addr":"172.21.15.28:6813","nonce":38722}]},"public_addr":"172.21.15.28:6809/38722","cluster_addr":"172.21.15.28:6811/38722","heartbeat_back_addr":"172.21.15.28:6815/38722","heartbeat_front_addr":"172.21.15.28:6813/38722","state":["exists","up"]},{"osd":1,"uuid":"1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":38724},{"type":"v1","addr":"172.21.15.28:6824","nonce":38724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":38724},{"type":"v1","addr":"172.21.15.28:6827","nonce":38724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":38724},{"type":"v1","addr":"172.21.15.28:6831","nonce":38724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":38724},{"type":"v1","addr":"172.21.15.28:6829","nonce":38724}]},"public_addr":"172.21.15.28:6824/38724","cluster_addr":"172.21.15.28:6827/38724","heartbeat_back_addr":"172.21.15.28:6831/38724","heartbeat_front_addr":"172.21.15.28:6829/38724","state":["exists","up"]},{"osd":2,"uuid":"e18f39cd-6a35-4d36-9eed-3877794bf2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":38723},{"type":"v1","addr":"172.21.15.28:6801","nonce":38723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":38723},{"type":"v1","addr":"172.21.15.28:6803","nonce":38723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":38723},{"type":"v1","addr":"172.21.15.28:6807","nonce":38723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":38723},{"type":"v1","addr":"172.21.15.28:6805","nonce":38723}]},"public_addr":"172.21.15.28:6801/38723","cluster_addr":"172.21.15.28:6803/38723","heartbeat_back_addr":"172.21.15.28:6807/38723","heartbeat_front_addr":"172.21.15.28:6805/38723","state":["exists","up"]},{"osd":3,"uuid":"303d0728-409d-47d7-b7a6-6eb273f602fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":38725},{"type":"v1","addr":"172.21.15.28:6817","nonce":38725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":38725},{"type":"v1","addr":"172.21.15.28:6819","nonce":38725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":38725},{"type":"v1","addr":"172.21.15.28:6825","nonce":38725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":38725},{"type":"v1","addr":"172.21.15.28:6821","nonce":38725}]},"public_addr":"172.21.15.28:6817/38725","cluster_addr":"172.21.15.28:6819/38725","heartbeat_back_addr":"172.21.15.28:6825/38725","heartbeat_front_addr":"172.21.15.28:6821/38725","state":["exists","up"]},{"osd":4,"uuid":"df0bf0ac-6efe-4964-ad27-7c1771a70c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":38828},{"type":"v1","addr":"172.21.15.70:6801","nonce":38828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":38828},{"type":"v1","addr":"172.21.15.70:6803","nonce":38828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":38828},{"type":"v1","addr":"172.21.15.70:6807","nonce":38828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":38828},{"type":"v1","addr":"172.21.15.70:6805","nonce":38828}]},"public_addr":"172.21.15.70:6801/38828","cluster_addr":"172.21.15.70:6803/38828","heartbeat_back_addr":"172.21.15.70:6807/38828","heartbeat_front_addr":"172.21.15.70:6805/38828","state":["exists","up"]},{"osd":5,"uuid":"84921219-65cb-4c4e-b9ed-a773db639034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":38830},{"type":"v1","addr":"172.21.15.70:6810","nonce":38830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6813","nonce":38830},{"type":"v1","addr":"172.21.15.70:6814","nonce":38830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":38830},{"type":"v1","addr":"172.21.15.70:6824","nonce":38830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":38830},{"type":"v1","addr":"172.21.15.70:6819","nonce":38830}]},"public_addr":"172.21.15.70:6810/38830","cluster_addr":"172.21.15.70:6814/38830","heartbeat_back_addr":"172.21.15.70:6824/38830","heartbeat_front_addr":"172.21.15.70:6819/38830","state":["exists","up"]},{"osd":6,"uuid":"c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":38829},{"type":"v1","addr":"172.21.15.70:6812","nonce":38829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":38829},{"type":"v1","addr":"172.21.15.70:6820","nonce":38829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":38829},{"type":"v1","addr":"172.21.15.70:6828","nonce":38829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":38829},{"type":"v1","addr":"172.21.15.70:6825","nonce":38829}]},"public_addr":"172.21.15.70:6812/38829","cluster_addr":"172.21.15.70:6820/38829","heartbeat_back_addr":"172.21.15.70:6828/38829","heartbeat_front_addr":"172.21.15.70:6825/38829","state":["exists","up"]},{"osd":7,"uuid":"e2cdd418-12ce-4eea-9b22-efdad83eb76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":38839},{"type":"v1","addr":"172.21.15.70:6815","nonce":38839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":38839},{"type":"v1","addr":"172.21.15.70:6823","nonce":38839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":38839},{"type":"v1","addr":"172.21.15.70:6831","nonce":38839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6827","nonce":38839},{"type":"v1","addr":"172.21.15.70:6829","nonce":38839}]},"public_addr":"172.21.15.70:6815/38839","cluster_addr":"172.21.15.70:6823/38839","heartbeat_back_addr":"172.21.15.70:6831/38839","heartbeat_front_addr":"172.21.15.70:6829/38839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.544240+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.637637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.352115+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.652916+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.624477+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.570247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.706468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.696574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-16T02:29:47.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.717+0000 7f096b7d7640 1 -- 172.21.15.28:0/3405489356 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0948065a60 msgr2=0x7f0948067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.717+0000 7f096b7d7640 1 --2- 172.21.15.28:0/3405489356 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0948065a60 0x7f0948067f20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0958000f70 tx=0x7f0958007cd0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.717+0000 7f096b7d7640 1 -- 172.21.15.28:0/3405489356 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0964148960 msgr2=0x7f0964144130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.717+0000 7f096b7d7640 1 --2- 172.21.15.28:0/3405489356 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0964148960 0x7f0964144130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f095c01a140 tx=0x7f095c01ad50 comp rx=0 tx=0).stop 2023-11-16T02:29:47.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.717+0000 7f096b7d7640 1 -- 172.21.15.28:0/3405489356 shutdown_connections 2023-11-16T02:29:47.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.717+0000 7f096b7d7640 1 --2- 172.21.15.28:0/3405489356 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0948065a60 0x7f0948067f20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.717+0000 7f096b7d7640 1 --2- 172.21.15.28:0/3405489356 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0964148960 0x7f0964144130 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.717+0000 7f096b7d7640 1 --2- 172.21.15.28:0/3405489356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09640b8240 0x7f09640701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.717+0000 7f096b7d7640 1 --2- 172.21.15.28:0/3405489356 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f09640b3450 0x7f096413dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.717+0000 7f096b7d7640 1 -- 172.21.15.28:0/3405489356 >> 172.21.15.28:0/3405489356 conn(0x7f09640b9050 msgr2=0x7f096413ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:47.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.717+0000 7f096b7d7640 1 -- 172.21.15.28:0/3405489356 shutdown_connections 2023-11-16T02:29:47.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.717+0000 7f096b7d7640 1 -- 172.21.15.28:0/3405489356 wait complete. 2023-11-16T02:29:47.740 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-16T02:29:47.740 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-16T02:29:47.740 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-16T02:29:47.741 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-16T02:29:47.741 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-16T02:29:47.741 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-16T02:29:47.742 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-16T02:29:47.742 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-16T02:29:47.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.917+0000 7f2a9dea9640 1 Processor -- start 2023-11-16T02:29:47.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.917+0000 7f2a9dea9640 1 -- start start 2023-11-16T02:29:47.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.917+0000 7f2a9dea9640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2a980717c0 0x7f2a980709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.917+0000 7f2a9dea9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2a98158780 0x7f2a98159100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.917+0000 7f2a9dea9640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a980713a0 con 0x7f2a9806f330 2023-11-16T02:29:47.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.917+0000 7f2a9dea9640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a980b98a0 con 0x7f2a98158780 2023-11-16T02:29:47.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.917+0000 7f2a9dea9640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a98158ce0 con 0x7f2a980717c0 2023-11-16T02:29:47.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.917+0000 7f2a97fff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2a980717c0 0x7f2a980709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.917+0000 7f2a97fff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2a980717c0 0x7f2a980709b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.28:47114/0 (socket says 172.21.15.28:47114) 2023-11-16T02:29:47.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.917+0000 7f2a97fff640 1 -- 172.21.15.28:0/449152559 learned_addr learned my addr 172.21.15.28:0/449152559 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:47.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.917+0000 7f2a9cea7640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f2a9806f330 0x7f2a98158070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.28:38002/0 (socket says 172.21.15.28:38002) 2023-11-16T02:29:47.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.917+0000 7f2a9d6a8640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2a98158780 0x7f2a98159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.917+0000 7f2a97fff640 1 -- 172.21.15.28:0/449152559 >> v2:172.21.15.70:3300/0 conn(0x7f2a98158780 msgr2=0x7f2a98159100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:47.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.917+0000 7f2a97fff640 1 --2- 172.21.15.28:0/449152559 >> v2:172.21.15.70:3300/0 conn(0x7f2a98158780 0x7f2a98159100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.917+0000 7f2a97fff640 1 -- 172.21.15.28:0/449152559 >> v1:172.21.15.70:6789/0 conn(0x7f2a9806f330 legacy=0x7f2a98158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.917+0000 7f2a97fff640 1 -- 172.21.15.28:0/449152559 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a980b95c0 con 0x7f2a980717c0 2023-11-16T02:29:47.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f8286661640 1 Processor -- start 2023-11-16T02:29:47.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f03e28bb640 1 Processor -- start 2023-11-16T02:29:47.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f8286661640 1 -- start start 2023-11-16T02:29:47.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7fd631857640 1 Processor -- start 2023-11-16T02:29:47.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7fd631857640 1 -- start start 2023-11-16T02:29:47.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7fd631857640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd62c0b7f80 0x7fd62c06c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7fd631857640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd62c160040 0x7fd62c162430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7fd631857640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd62c0b1bd0 con 0x7fd62c0b8360 2023-11-16T02:29:47.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7fd631857640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62c0b2470 con 0x7fd62c160040 2023-11-16T02:29:47.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7fd631857640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c0b1e20 con 0x7fd62c0b7f80 2023-11-16T02:29:47.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f6df0bb1640 1 Processor -- start 2023-11-16T02:29:47.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7fd62a7fc640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd62c0b8360 0x7fd62c158190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:39722/0 (socket says 172.21.15.28:39722) 2023-11-16T02:29:47.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7fd62a7fc640 1 -- 172.21.15.28:0/3427839497 learned_addr learned my addr 172.21.15.28:0/3427839497 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:47.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7fd62b7fe640 1 --2- 172.21.15.28:0/3427839497 >> v2:172.21.15.70:3300/0 conn(0x7fd62c160040 0x7fd62c162430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7fd62affd640 1 --2- 172.21.15.28:0/3427839497 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd62c0b7f80 0x7fd62c06c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7fd62b7fe640 1 -- 172.21.15.28:0/3427839497 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd62c0b7f80 msgr2=0x7fd62c06c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:47.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7fd62b7fe640 1 --2- 172.21.15.28:0/3427839497 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd62c0b7f80 0x7fd62c06c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7fd62b7fe640 1 -- 172.21.15.28:0/3427839497 >> v1:172.21.15.28:6789/0 conn(0x7fd62c0b8360 legacy=0x7fd62c158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f03e28bb640 1 -- start start 2023-11-16T02:29:47.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f03e28bb640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f03d40c7230 0x7f03d40d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f03e28bb640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d4035ff0 con 0x7f03d4006d30 2023-11-16T02:29:47.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f03e28bb640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d403ba60 con 0x7f03d4007110 2023-11-16T02:29:47.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f03e28bb640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d403e050 con 0x7f03d40c7230 2023-11-16T02:29:47.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f8286661640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8280140c20 0x7f8280149f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f03dbfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f03d4006d30 0x7f03d403b350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:39732/0 (socket says 172.21.15.28:39732) 2023-11-16T02:29:47.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f03dbfff640 1 -- 172.21.15.28:0/1681983172 learned_addr learned my addr 172.21.15.28:0/1681983172 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:47.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f03e0e58640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f03d40c7230 0x7f03d40d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7fd62b7fe640 1 -- 172.21.15.28:0/3427839497 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62c0b2100 con 0x7fd62c160040 2023-11-16T02:29:47.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f6df0bb1640 1 -- start start 2023-11-16T02:29:47.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7fba74da0640 1 Processor -- start 2023-11-16T02:29:47.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f6df0bb1640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6dec14f8a0 0x7f6dec0b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f6df0bb1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f6dec14ecd0 0x7f6dec06c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f6df0bb1640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6dec0b5930 0x7f6dec0b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f6df0bb1640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dec0b1320 con 0x7f6dec14f8a0 2023-11-16T02:29:47.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f6df0bb1640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dec14fc80 con 0x7f6dec14ecd0 2023-11-16T02:29:47.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f6df0bb1640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec0b16d0 con 0x7f6dec0b5930 2023-11-16T02:29:47.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f4278574640 1 Processor -- start 2023-11-16T02:29:47.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f6dead9d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6dec0b5930 0x7f6dec0b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f6dead9d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6dec0b5930 0x7f6dec0b1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.28:47140/0 (socket says 172.21.15.28:47140) 2023-11-16T02:29:47.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f6dead9d640 1 -- 172.21.15.28:0/2184581353 learned_addr learned my addr 172.21.15.28:0/2184581353 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:47.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f03daffd640 1 -- 172.21.15.28:0/1681983172 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4208648422 0 0) 0x7f03d4035ff0 con 0x7f03d4006d30 2023-11-16T02:29:47.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f03daffd640 1 -- 172.21.15.28:0/1681983172 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03c4003530 con 0x7f03d4006d30 2023-11-16T02:29:47.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f03daffd640 1 -- 172.21.15.28:0/1681983172 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169403953 0 0) 0x7f03d403ba60 con 0x7f03d4007110 2023-11-16T02:29:47.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f03daffd640 1 -- 172.21.15.28:0/1681983172 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03d4035ff0 con 0x7f03d4007110 2023-11-16T02:29:47.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7fba74da0640 1 -- start start 2023-11-16T02:29:47.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f827ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8280140c20 0x7f8280149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f827ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8280140c20 0x7f8280149f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:40980/0 (socket says 172.21.15.28:40980) 2023-11-16T02:29:47.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f827ffff640 1 -- 172.21.15.28:0/24179795 learned_addr learned my addr 172.21.15.28:0/24179795 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:47.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f8286661640 1 --2- 172.21.15.28:0/24179795 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82800b5e50 0x7f8280151310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f6de9d9b640 1 --2- 172.21.15.28:0/2184581353 >> v2:172.21.15.70:3300/0 conn(0x7f6dec14ecd0 0x7f6dec06c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f6dea59c640 1 --2- 172.21.15.28:0/2184581353 >> v2:172.21.15.28:3300/0 conn(0x7f6dec14f8a0 0x7f6dec0b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f2a97fff640 1 --2- 172.21.15.28:0/449152559 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2a980717c0 0x7f2a980709b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2a8800aa90 tx=0x7f2a8801c660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37796e8bacac54ac server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f2a977fe640 1 -- 172.21.15.28:0/449152559 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a880ab650 con 0x7f2a980717c0 2023-11-16T02:29:47.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f2a977fe640 1 -- 172.21.15.28:0/449152559 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a880ab7b0 con 0x7f2a980717c0 2023-11-16T02:29:47.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f2a977fe640 1 -- 172.21.15.28:0/449152559 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a880abb60 con 0x7f2a980717c0 2023-11-16T02:29:47.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f8286661640 1 -- 172.21.15.28:0/24179795 --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82800b1cd0 con 0x7f82800b93b0 2023-11-16T02:29:47.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f8286661640 1 -- 172.21.15.28:0/24179795 --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828006cae0 con 0x7f8280140c20 2023-11-16T02:29:47.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f8286661640 1 -- 172.21.15.28:0/24179795 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82800b1710 con 0x7f82800b5e50 2023-11-16T02:29:47.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f8284bfe640 1 --2- 172.21.15.28:0/24179795 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82800b5e50 0x7f8280151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f03e0e58640 1 -- 172.21.15.28:0/1681983172 >> v1:172.21.15.70:6789/0 conn(0x7f03d4007110 legacy=0x7f03d40c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f03e0e58640 1 -- 172.21.15.28:0/1681983172 >> v1:172.21.15.28:6789/0 conn(0x7f03d4006d30 legacy=0x7f03d403b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f03e0e58640 1 -- 172.21.15.28:0/1681983172 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d403e330 con 0x7f03d40c7230 2023-11-16T02:29:47.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7fba74da0640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fba7014f8a0 0x7fba700b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7fba74da0640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fba7014ecd0 0x7fba7006c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7fba74da0640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fba700b5930 0x7fba700b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7fba74da0640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba700b1320 con 0x7fba7014ecd0 2023-11-16T02:29:47.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7fba74da0640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7014fc80 con 0x7fba7014f8a0 2023-11-16T02:29:47.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7fba74da0640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba700b16d0 con 0x7fba700b5930 2023-11-16T02:29:47.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f2be87be640 1 Processor -- start 2023-11-16T02:29:47.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f6de9d9b640 1 -- 172.21.15.28:0/2184581353 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6dec0b5930 msgr2=0x7f6dec0b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:47.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f6de9d9b640 1 --2- 172.21.15.28:0/2184581353 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6dec0b5930 0x7f6dec0b1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f6de9d9b640 1 -- 172.21.15.28:0/2184581353 >> v2:172.21.15.28:3300/0 conn(0x7f6dec14f8a0 msgr2=0x7f6dec0b0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:47.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f6de9d9b640 1 --2- 172.21.15.28:0/2184581353 >> v2:172.21.15.28:3300/0 conn(0x7f6dec14f8a0 0x7f6dec0b0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f6de9d9b640 1 -- 172.21.15.28:0/2184581353 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dec0b19b0 con 0x7f6dec14ecd0 2023-11-16T02:29:47.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f2a9dea9640 1 -- 172.21.15.28:0/449152559 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2a980717c0 msgr2=0x7f2a980709b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f2a9dea9640 1 --2- 172.21.15.28:0/449152559 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2a980717c0 0x7f2a980709b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2a8800aa90 tx=0x7f2a8801c660 comp rx=0 tx=0).stop 2023-11-16T02:29:47.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.921+0000 7f4278574640 1 -- start start 2023-11-16T02:29:47.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f4278574640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4270140c20 0x7f4270149f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f4278574640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42700b1cd0 con 0x7f427014f300 2023-11-16T02:29:47.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f4278574640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f427006cae0 con 0x7f42700b5e50 2023-11-16T02:29:47.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f4278574640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42700b1710 con 0x7f4270140c20 2023-11-16T02:29:47.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f2a9dea9640 1 -- 172.21.15.28:0/449152559 shutdown_connections 2023-11-16T02:29:47.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f2a9dea9640 1 --2- 172.21.15.28:0/449152559 >> v2:172.21.15.70:3300/0 conn(0x7f2a98158780 0x7f2a98159100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f2a9dea9640 1 --2- 172.21.15.28:0/449152559 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2a980717c0 0x7f2a980709b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f2a9dea9640 1 -- 172.21.15.28:0/449152559 >> 172.21.15.28:0/449152559 conn(0x7f2a980b88e0 msgr2=0x7f2a980b8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:47.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f827ffff640 1 -- 172.21.15.28:0/24179795 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82800b5e50 msgr2=0x7f8280151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:47.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f827ffff640 1 --2- 172.21.15.28:0/24179795 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82800b5e50 0x7f8280151310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f827ffff640 1 -- 172.21.15.28:0/24179795 >> v1:172.21.15.70:6789/0 conn(0x7f82800b93b0 legacy=0x7f828006c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:47.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f827ffff640 1 -- 172.21.15.28:0/24179795 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82800b19f0 con 0x7f8280140c20 2023-11-16T02:29:47.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f4276b11640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f427014f300 0x7f42701516f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:39748/0 (socket says 172.21.15.28:39748) 2023-11-16T02:29:47.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f4276b11640 1 -- 172.21.15.28:0/3910571822 learned_addr learned my addr 172.21.15.28:0/3910571822 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:47.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f4275b0f640 1 --1- 172.21.15.28:0/3910571822 >> v1:172.21.15.70:6789/0 conn(0x7f42700b5e50 0x7f427006c3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.28:38036/0 (socket says 172.21.15.28:38036) 2023-11-16T02:29:47.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f2a9dea9640 1 -- 172.21.15.28:0/449152559 shutdown_connections 2023-11-16T02:29:47.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f2be87be640 1 -- start start 2023-11-16T02:29:47.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f2be87be640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2be00b4830 0x7f2be0142550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f2be87be640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2be00b4f10 0x7f2be0142a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f2be87be640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2be00b5d50 con 0x7f2be00babf0 2023-11-16T02:29:47.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f2be87be640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2be00b6030 con 0x7f2be00b4f10 2023-11-16T02:29:47.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f2be87be640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be00b7760 con 0x7f2be00b4830 2023-11-16T02:29:47.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7fba6e59c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fba7014f8a0 0x7fba700b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7fba6e59c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fba7014f8a0 0x7fba700b0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.28:43654/0 (socket says 172.21.15.28:43654) 2023-11-16T02:29:47.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7fba6e59c640 1 -- 172.21.15.28:0/2038551101 learned_addr learned my addr 172.21.15.28:0/2038551101 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:47.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7fba6dd9b640 1 --2- 172.21.15.28:0/2038551101 >> v2:172.21.15.28:3300/0 conn(0x7fba7014ecd0 0x7fba7006c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7fba6e59c640 1 -- 172.21.15.28:0/2038551101 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fba700b5930 msgr2=0x7fba700b1e40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-16T02:29:47.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7fba6e59c640 1 --2- 172.21.15.28:0/2038551101 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fba700b5930 0x7fba700b1e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7fba6e59c640 1 -- 172.21.15.28:0/2038551101 >> v2:172.21.15.28:3300/0 conn(0x7fba7014ecd0 msgr2=0x7fba7006c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:47.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7fba6e59c640 1 --2- 172.21.15.28:0/2038551101 >> v2:172.21.15.28:3300/0 conn(0x7fba7014ecd0 0x7fba7006c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7fba6e59c640 1 -- 172.21.15.28:0/2038551101 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba700b19b0 con 0x7fba7014f8a0 2023-11-16T02:29:47.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f4276310640 1 --2- 172.21.15.28:0/3910571822 >> v2:172.21.15.70:3300/0 conn(0x7f4270140c20 0x7f4270149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f2be6d5b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2be00b4f10 0x7f2be0142a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f2be6d5b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2be00b4f10 0x7f2be0142a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41000/0 (socket says 172.21.15.28:41000) 2023-11-16T02:29:47.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f2be6d5b640 1 -- 172.21.15.28:0/4063634134 learned_addr learned my addr 172.21.15.28:0/4063634134 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:47.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f2be6d5b640 1 -- 172.21.15.28:0/4063634134 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2be00b4830 msgr2=0x7f2be0142550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:47.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f2be6d5b640 1 --2- 172.21.15.28:0/4063634134 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2be00b4830 0x7f2be0142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f2be6d5b640 1 -- 172.21.15.28:0/4063634134 >> v1:172.21.15.28:6789/0 conn(0x7f2be00babf0 legacy=0x7f2be00b7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:47.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f4276310640 1 -- 172.21.15.28:0/3910571822 >> v1:172.21.15.70:6789/0 conn(0x7f42700b5e50 legacy=0x7f427006c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f4276310640 1 -- 172.21.15.28:0/3910571822 >> v1:172.21.15.28:6789/0 conn(0x7f427014f300 legacy=0x7f42701516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f4276310640 1 -- 172.21.15.28:0/3910571822 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42700b19f0 con 0x7f4270140c20 2023-11-16T02:29:47.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7fd62b7fe640 1 --2- 172.21.15.28:0/3427839497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd62c160040 0x7fd62c162430 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd620009fd0 tx=0x7fd62001d5e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b432fd0e2e57baf server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7fd629ffb640 1 -- 172.21.15.28:0/3427839497 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6200a6710 con 0x7fd62c160040 2023-11-16T02:29:47.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7fd629ffb640 1 -- 172.21.15.28:0/3427839497 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6200a6870 con 0x7fd62c160040 2023-11-16T02:29:47.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7fd629ffb640 1 -- 172.21.15.28:0/3427839497 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6200a6c00 con 0x7fd62c160040 2023-11-16T02:29:47.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f2a9dea9640 1 -- 172.21.15.28:0/449152559 wait complete. 2023-11-16T02:29:47.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f03e0e58640 1 --2- 172.21.15.28:0/1681983172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03d40c7230 0x7f03d40d0610 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f03dc04f360 tx=0x7f03dc098740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec63191e0a836148 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f2a9dea9640 1 Processor -- start 2023-11-16T02:29:47.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f2a9dea9640 1 -- start start 2023-11-16T02:29:47.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f6de9d9b640 1 --2- 172.21.15.28:0/2184581353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6dec14ecd0 0x7f6dec06c3d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6dec14c900 tx=0x7f6ddc01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc3aaa328e106c13 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f2be6d5b640 1 -- 172.21.15.28:0/4063634134 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be00b7a40 con 0x7f2be00b4f10 2023-11-16T02:29:47.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.925+0000 7f03daffd640 1 -- 172.21.15.28:0/1681983172 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc125740 con 0x7f03d40c7230 2023-11-16T02:29:47.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f03daffd640 1 -- 172.21.15.28:0/1681983172 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03dc1258e0 con 0x7f03d40c7230 2023-11-16T02:29:47.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f03daffd640 1 -- 172.21.15.28:0/1681983172 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc125d30 con 0x7f03d40c7230 2023-11-16T02:29:47.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f6de959a640 1 -- 172.21.15.28:0/2184581353 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc0ab5f0 con 0x7f6dec14ecd0 2023-11-16T02:29:47.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f6de959a640 1 -- 172.21.15.28:0/2184581353 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ddc0ab750 con 0x7f6dec14ecd0 2023-11-16T02:29:47.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f6de959a640 1 -- 172.21.15.28:0/2184581353 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc0abae0 con 0x7f6dec14ecd0 2023-11-16T02:29:47.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fd631857640 1 -- 172.21.15.28:0/3427839497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd62c160040 msgr2=0x7fd62c162430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fd631857640 1 --2- 172.21.15.28:0/3427839497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd62c160040 0x7fd62c162430 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd620009fd0 tx=0x7fd62001d5e0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fd631857640 1 -- 172.21.15.28:0/3427839497 shutdown_connections 2023-11-16T02:29:47.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fd631857640 1 --2- 172.21.15.28:0/3427839497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd62c160040 0x7fd62c162430 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fd631857640 1 --2- 172.21.15.28:0/3427839497 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd62c0b7f80 0x7fd62c06c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fd631857640 1 -- 172.21.15.28:0/3427839497 >> 172.21.15.28:0/3427839497 conn(0x7fd62c0b8890 msgr2=0x7fd62c0b8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:47.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fd631857640 1 -- 172.21.15.28:0/3427839497 shutdown_connections 2023-11-16T02:29:47.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f827ffff640 1 --2- 172.21.15.28:0/24179795 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8280140c20 0x7f8280149f80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f827000dc90 tx=0x7f8270023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ecdf131aa08e19 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2a9dea9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a9806f330 0x7f2a9806c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2a9dea9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a980717c0 0x7f2a980b56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2a9dea9640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2a98158780 0x7f2a981f2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2a9dea9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a980b6140 con 0x7f2a980717c0 2023-11-16T02:29:47.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2a9dea9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9806c630 con 0x7f2a9806f330 2023-11-16T02:29:47.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2a9dea9640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a980b42b0 con 0x7f2a98158780 2023-11-16T02:29:47.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f03e28bb640 1 -- 172.21.15.28:0/1681983172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03d40c7230 msgr2=0x7f03d40d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f03e28bb640 1 --2- 172.21.15.28:0/1681983172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03d40c7230 0x7f03d40d0610 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f03dc04f360 tx=0x7f03dc098740 comp rx=0 tx=0).stop 2023-11-16T02:29:47.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2a97fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a980717c0 0x7f2a980b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2a97fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a980717c0 0x7f2a980b56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41010/0 (socket says 172.21.15.28:41010) 2023-11-16T02:29:47.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2a97fff640 1 -- 172.21.15.28:0/1174046558 learned_addr learned my addr 172.21.15.28:0/1174046558 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:47.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2a9d6a8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2a98158780 0x7f2a981f2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fd631857640 1 -- 172.21.15.28:0/3427839497 wait complete. 2023-11-16T02:29:47.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fba6e59c640 1 --2- 172.21.15.28:0/2038551101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba7014f8a0 0x7fba700b0de0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fba700b9900 tx=0x7fba6401c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f9a6ead8948a24 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f827effd640 1 -- 172.21.15.28:0/24179795 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827000d2d0 con 0x7f8280140c20 2023-11-16T02:29:47.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f827effd640 1 -- 172.21.15.28:0/24179795 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82700acbd0 con 0x7f8280140c20 2023-11-16T02:29:47.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f827effd640 1 -- 172.21.15.28:0/24179795 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827000b450 con 0x7f8280140c20 2023-11-16T02:29:47.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f6df0bb1640 1 -- 172.21.15.28:0/2184581353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6dec14ecd0 msgr2=0x7f6dec06c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f6df0bb1640 1 --2- 172.21.15.28:0/2184581353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6dec14ecd0 0x7f6dec06c3d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6dec14c900 tx=0x7f6ddc01c450 comp rx=0 tx=0).stop 2023-11-16T02:29:47.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f6df0bb1640 1 -- 172.21.15.28:0/2184581353 shutdown_connections 2023-11-16T02:29:47.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f6df0bb1640 1 --2- 172.21.15.28:0/2184581353 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6dec0b5930 0x7f6dec0b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f6df0bb1640 1 --2- 172.21.15.28:0/2184581353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6dec14ecd0 0x7f6dec06c3d0 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6dec14c900 tx=0x7f6ddc01c450 comp rx=0 tx=0).stop 2023-11-16T02:29:47.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f6df0bb1640 1 --2- 172.21.15.28:0/2184581353 >> v2:172.21.15.28:3300/0 conn(0x7f6dec14f8a0 0x7f6dec0b0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f6df0bb1640 1 -- 172.21.15.28:0/2184581353 >> 172.21.15.28:0/2184581353 conn(0x7f6dec0b8890 msgr2=0x7f6dec0b8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:47.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2a9cea7640 1 --2- 172.21.15.28:0/1174046558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a9806f330 0x7f2a9806c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f03e28bb640 1 -- 172.21.15.28:0/1681983172 shutdown_connections 2023-11-16T02:29:47.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f03e28bb640 1 --2- 172.21.15.28:0/1681983172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03d40c7230 0x7f03d40d0610 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f03e28bb640 1 -- 172.21.15.28:0/1681983172 >> 172.21.15.28:0/1681983172 conn(0x7f03d4005dc0 msgr2=0x7f03d40061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:47.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2be6d5b640 1 --2- 172.21.15.28:0/4063634134 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2be00b4f10 0x7f2be0142a90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8009e50 tx=0x7f2bd801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5259bc38b942ee8c server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f03e28bb640 1 -- 172.21.15.28:0/1681983172 shutdown_connections 2023-11-16T02:29:47.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f03e28bb640 1 -- 172.21.15.28:0/1681983172 wait complete. 2023-11-16T02:29:47.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f4276310640 1 --2- 172.21.15.28:0/3910571822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4270140c20 0x7f4270149f80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f42600097c0 tx=0x7f426001c250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea3f5858a088957f server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f8286661640 1 -- 172.21.15.28:0/24179795 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8280140c20 msgr2=0x7f8280149f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f8286661640 1 --2- 172.21.15.28:0/24179795 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8280140c20 0x7f8280149f80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f827000dc90 tx=0x7f8270023000 comp rx=0 tx=0).stop 2023-11-16T02:29:47.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fba6d59a640 1 -- 172.21.15.28:0/2038551101 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba640aa610 con 0x7fba7014f8a0 2023-11-16T02:29:47.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f8286661640 1 -- 172.21.15.28:0/24179795 shutdown_connections 2023-11-16T02:29:47.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f8286661640 1 --2- 172.21.15.28:0/24179795 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f82800b5e50 0x7f8280151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f8286661640 1 --2- 172.21.15.28:0/24179795 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8280140c20 0x7f8280149f80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f8286661640 1 -- 172.21.15.28:0/24179795 >> 172.21.15.28:0/24179795 conn(0x7f82800b8890 msgr2=0x7f82800b8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:47.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f6df0bb1640 1 -- 172.21.15.28:0/2184581353 shutdown_connections 2023-11-16T02:29:47.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2a9d6a8640 1 -- 172.21.15.28:0/1174046558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a9806f330 msgr2=0x7f2a9806c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2a9d6a8640 1 --2- 172.21.15.28:0/1174046558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a9806f330 0x7f2a9806c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2a9d6a8640 1 -- 172.21.15.28:0/1174046558 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a980717c0 msgr2=0x7f2a980b56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2a9d6a8640 1 --2- 172.21.15.28:0/1174046558 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a980717c0 0x7f2a980b56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2a9d6a8640 1 -- 172.21.15.28:0/1174046558 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a8800a6f0 con 0x7f2a98158780 2023-11-16T02:29:47.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f8286661640 1 -- 172.21.15.28:0/24179795 shutdown_connections 2023-11-16T02:29:47.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2a9cea7640 1 --2- 172.21.15.28:0/1174046558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a9806f330 0x7f2a9806c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-16T02:29:47.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f427530e640 1 -- 172.21.15.28:0/3910571822 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42600ab600 con 0x7f4270140c20 2023-11-16T02:29:47.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f427530e640 1 -- 172.21.15.28:0/3910571822 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42600a7050 con 0x7f4270140c20 2023-11-16T02:29:47.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f427530e640 1 -- 172.21.15.28:0/3910571822 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42600ab980 con 0x7f4270140c20 2023-11-16T02:29:47.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2be5558640 1 -- 172.21.15.28:0/4063634134 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd80af400 con 0x7f2be00b4f10 2023-11-16T02:29:47.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2be5558640 1 -- 172.21.15.28:0/4063634134 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd80ab050 con 0x7f2be00b4f10 2023-11-16T02:29:47.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2be5558640 1 -- 172.21.15.28:0/4063634134 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd80af780 con 0x7f2be00b4f10 2023-11-16T02:29:47.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fd631857640 1 Processor -- start 2023-11-16T02:29:47.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fd631857640 1 -- start start 2023-11-16T02:29:47.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fba6d59a640 1 -- 172.21.15.28:0/2038551101 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba640a6040 con 0x7fba7014f8a0 2023-11-16T02:29:47.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fba6d59a640 1 -- 172.21.15.28:0/2038551101 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba640aa990 con 0x7fba7014f8a0 2023-11-16T02:29:47.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f8286661640 1 -- 172.21.15.28:0/24179795 wait complete. 2023-11-16T02:29:47.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2a97fff640 1 --2- 172.21.15.28:0/1174046558 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a980717c0 0x7f2a980b56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-16T02:29:47.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2a9d6a8640 1 --2- 172.21.15.28:0/1174046558 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2a98158780 0x7f2a981f2e90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c016e40 tx=0x7f2a8c00b700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fba74da0640 1 -- 172.21.15.28:0/2038551101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba7014f8a0 msgr2=0x7fba700b0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fba74da0640 1 --2- 172.21.15.28:0/2038551101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba7014f8a0 0x7fba700b0de0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fba700b9900 tx=0x7fba6401c4f0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f4278574640 1 -- 172.21.15.28:0/3910571822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4270140c20 msgr2=0x7f4270149f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f4278574640 1 --2- 172.21.15.28:0/3910571822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4270140c20 0x7f4270149f80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f42600097c0 tx=0x7f426001c250 comp rx=0 tx=0).stop 2023-11-16T02:29:47.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f4278574640 1 -- 172.21.15.28:0/3910571822 shutdown_connections 2023-11-16T02:29:47.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f4278574640 1 --2- 172.21.15.28:0/3910571822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4270140c20 0x7f4270149f80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f4278574640 1 -- 172.21.15.28:0/3910571822 >> 172.21.15.28:0/3910571822 conn(0x7f42700b8890 msgr2=0x7f42700b8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:47.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2a957fa640 1 -- 172.21.15.28:0/1174046558 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c01f640 con 0x7f2a98158780 2023-11-16T02:29:47.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2a957fa640 1 -- 172.21.15.28:0/1174046558 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8c01f7a0 con 0x7f2a98158780 2023-11-16T02:29:47.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2a957fa640 1 -- 172.21.15.28:0/1174046558 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c01fb30 con 0x7f2a98158780 2023-11-16T02:29:47.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f03e28bb640 1 Processor -- start 2023-11-16T02:29:47.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2be87be640 1 -- 172.21.15.28:0/4063634134 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2be00b4f10 msgr2=0x7f2be0142a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2be87be640 1 --2- 172.21.15.28:0/4063634134 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2be00b4f10 0x7f2be0142a90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8009e50 tx=0x7f2bd801f1c0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f8286661640 1 Processor -- start 2023-11-16T02:29:47.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fd631857640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd62c0b7f80 0x7fd62c15d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fd631857640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd62c0b8360 0x7fd62c1fb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fd631857640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd62c160040 0x7fd62c1571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fd631857640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c15d570 con 0x7fd62c0b8360 2023-11-16T02:29:47.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fd631857640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c15fd60 con 0x7fd62c0b7f80 2023-11-16T02:29:47.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fd631857640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62c15c160 con 0x7fd62c160040 2023-11-16T02:29:47.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2be87be640 1 -- 172.21.15.28:0/4063634134 shutdown_connections 2023-11-16T02:29:47.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2be87be640 1 --2- 172.21.15.28:0/4063634134 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2be00b4f10 0x7f2be0142a90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2be87be640 1 --2- 172.21.15.28:0/4063634134 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2be00b4830 0x7f2be0142550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2be87be640 1 -- 172.21.15.28:0/4063634134 >> 172.21.15.28:0/4063634134 conn(0x7f2be0069d70 msgr2=0x7f2be006a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:47.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f4278574640 1 -- 172.21.15.28:0/3910571822 shutdown_connections 2023-11-16T02:29:47.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fd62b7fe640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd62c160040 0x7fd62c1571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fd62b7fe640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd62c160040 0x7fd62c1571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.28:47172/0 (socket says 172.21.15.28:47172) 2023-11-16T02:29:47.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fd62b7fe640 1 -- 172.21.15.28:0/589072758 learned_addr learned my addr 172.21.15.28:0/589072758 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:47.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fd62a7fc640 1 --2- 172.21.15.28:0/589072758 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd62c0b8360 0x7fd62c1fb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7fd62affd640 1 --2- 172.21.15.28:0/589072758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd62c0b7f80 0x7fd62c15d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f4278574640 1 -- 172.21.15.28:0/3910571822 wait complete. 2023-11-16T02:29:47.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f8286661640 1 -- start start 2023-11-16T02:29:47.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f8286661640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82800b5e50 0x7f8280149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f8286661640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82800b93b0 0x7f828006fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f8286661640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8280140c20 0x7f828013f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f8286661640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8280149550 con 0x7f82800b5e50 2023-11-16T02:29:47.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f8286661640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8280146cb0 con 0x7f82800b93b0 2023-11-16T02:29:47.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f8286661640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8280141430 con 0x7f8280140c20 2023-11-16T02:29:47.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2a9dea9640 1 -- 172.21.15.28:0/1174046558 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a980b3e20 con 0x7f2a98158780 2023-11-16T02:29:47.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f2a9dea9640 1 -- 172.21.15.28:0/1174046558 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a980b4db0 con 0x7f2a98158780 2023-11-16T02:29:47.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f2a9dea9640 1 -- 172.21.15.28:0/1174046558 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2a98071020 con 0x7f2a98158780 2023-11-16T02:29:47.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7fd62a7fc640 1 -- 172.21.15.28:0/589072758 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd62c160040 msgr2=0x7fd62c1571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7fd62a7fc640 1 --2- 172.21.15.28:0/589072758 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd62c160040 0x7fd62c1571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7fd62a7fc640 1 -- 172.21.15.28:0/589072758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd62c0b7f80 msgr2=0x7fd62c15d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7fd62a7fc640 1 --2- 172.21.15.28:0/589072758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd62c0b7f80 0x7fd62c15d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7fd62a7fc640 1 -- 172.21.15.28:0/589072758 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd620009cb0 con 0x7fd62c0b8360 2023-11-16T02:29:47.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7fd62b7fe640 1 --2- 172.21.15.28:0/589072758 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd62c160040 0x7fd62c1571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-16T02:29:47.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f827f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82800b93b0 0x7f828006fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f827f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82800b93b0 0x7f828006fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.28:43686/0 (socket says 172.21.15.28:43686) 2023-11-16T02:29:47.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f827f7fe640 1 -- 172.21.15.28:0/4227784699 learned_addr learned my addr 172.21.15.28:0/4227784699 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:47.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f2be87be640 1 -- 172.21.15.28:0/4063634134 shutdown_connections 2023-11-16T02:29:47.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7fba74da0640 1 -- 172.21.15.28:0/2038551101 shutdown_connections 2023-11-16T02:29:47.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7fba74da0640 1 --2- 172.21.15.28:0/2038551101 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fba700b5930 0x7fba700b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7fba74da0640 1 --2- 172.21.15.28:0/2038551101 >> v2:172.21.15.28:3300/0 conn(0x7fba7014ecd0 0x7fba7006c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7fba74da0640 1 --2- 172.21.15.28:0/2038551101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba7014f8a0 0x7fba700b0de0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7fba74da0640 1 -- 172.21.15.28:0/2038551101 >> 172.21.15.28:0/2038551101 conn(0x7fba700b8890 msgr2=0x7fba700b8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:47.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.929+0000 7f6df0bb1640 1 -- 172.21.15.28:0/2184581353 wait complete. 2023-11-16T02:29:47.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f6df0bb1640 1 Processor -- start 2023-11-16T02:29:47.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7fd62a7fc640 1 --2- 172.21.15.28:0/589072758 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd62c0b8360 0x7fd62c1fb660 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd62400cae0 tx=0x7fd62400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f4278574640 1 Processor -- start 2023-11-16T02:29:47.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f4278574640 1 -- start start 2023-11-16T02:29:47.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f4278574640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42700b5e50 0x7f4270070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f4278574640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4270140c20 0x7f42701de080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f4278574640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f427014f300 0x7f42701de5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f4278574640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42700705d0 con 0x7f427014f300 2023-11-16T02:29:47.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f4278574640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42701ddbf0 con 0x7f42700b5e50 2023-11-16T02:29:47.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f4278574640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4270141300 con 0x7f4270140c20 2023-11-16T02:29:47.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f4275b0f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4270140c20 0x7f42701de080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f4275b0f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4270140c20 0x7f42701de080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.28:47202/0 (socket says 172.21.15.28:47202) 2023-11-16T02:29:47.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f4275b0f640 1 -- 172.21.15.28:0/381702781 learned_addr learned my addr 172.21.15.28:0/381702781 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:47.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f4276310640 1 --2- 172.21.15.28:0/381702781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42700b5e50 0x7f4270070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f2be87be640 1 -- 172.21.15.28:0/4063634134 wait complete. 2023-11-16T02:29:47.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f2be87be640 1 Processor -- start 2023-11-16T02:29:47.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7fd613fff640 1 -- 172.21.15.28:0/589072758 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62400ac40 con 0x7fd62c0b8360 2023-11-16T02:29:47.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7fd613fff640 1 -- 172.21.15.28:0/589072758 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62400ada0 con 0x7fd62c0b8360 2023-11-16T02:29:47.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7fd613fff640 1 -- 172.21.15.28:0/589072758 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd624012600 con 0x7fd62c0b8360 2023-11-16T02:29:47.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7fd631857640 1 -- 172.21.15.28:0/589072758 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd62c15c920 con 0x7fd62c0b8360 2023-11-16T02:29:47.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7fd631857640 1 -- 172.21.15.28:0/589072758 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd62c0711d0 con 0x7fd62c0b8360 2023-11-16T02:29:47.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7fd631857640 1 -- 172.21.15.28:0/589072758 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd62c0b33e0 con 0x7fd62c0b8360 2023-11-16T02:29:47.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7fba74da0640 1 -- 172.21.15.28:0/2038551101 shutdown_connections 2023-11-16T02:29:47.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7fba74da0640 1 -- 172.21.15.28:0/2038551101 wait complete. 2023-11-16T02:29:47.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f8284bfe640 1 --2- 172.21.15.28:0/4227784699 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8280140c20 0x7f828013f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f827ffff640 1 --2- 172.21.15.28:0/4227784699 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82800b5e50 0x7f8280149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f6df0bb1640 1 -- start start 2023-11-16T02:29:47.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f6df0bb1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6dec0b5930 0x7f6dec133130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f6df0bb1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6dec14f8a0 0x7f6dec149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f6df0bb1640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6dec149b80 0x7f6dec14b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f6df0bb1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec133670 con 0x7f6dec0b5930 2023-11-16T02:29:47.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f6df0bb1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec14a010 con 0x7f6dec14f8a0 2023-11-16T02:29:47.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f6df0bb1640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec14c820 con 0x7f6dec149b80 2023-11-16T02:29:47.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f6dead9d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6dec149b80 0x7f6dec14b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f6dead9d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6dec149b80 0x7f6dec14b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.28:47190/0 (socket says 172.21.15.28:47190) 2023-11-16T02:29:47.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f6dead9d640 1 -- 172.21.15.28:0/1778139346 learned_addr learned my addr 172.21.15.28:0/1778139346 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:47.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f6de9d9b640 1 --2- 172.21.15.28:0/1778139346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6dec14f8a0 0x7f6dec149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f6dea59c640 1 --2- 172.21.15.28:0/1778139346 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6dec0b5930 0x7f6dec133130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f2be87be640 1 -- start start 2023-11-16T02:29:47.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f03e28bb640 1 -- start start 2023-11-16T02:29:47.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f4276b11640 1 --2- 172.21.15.28:0/381702781 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f427014f300 0x7f42701de5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f6dead9d640 1 -- 172.21.15.28:0/1778139346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6dec14f8a0 msgr2=0x7f6dec149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f6dead9d640 1 --2- 172.21.15.28:0/1778139346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6dec14f8a0 0x7f6dec149640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f6dead9d640 1 -- 172.21.15.28:0/1778139346 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6dec0b5930 msgr2=0x7f6dec133130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f6dead9d640 1 --2- 172.21.15.28:0/1778139346 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6dec0b5930 0x7f6dec133130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f6dead9d640 1 -- 172.21.15.28:0/1778139346 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ddc009420 con 0x7f6dec149b80 2023-11-16T02:29:47.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f4276310640 1 -- 172.21.15.28:0/381702781 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4270140c20 msgr2=0x7f42701de080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f4276310640 1 --2- 172.21.15.28:0/381702781 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4270140c20 0x7f42701de080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f4276310640 1 -- 172.21.15.28:0/381702781 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f427014f300 msgr2=0x7f42701de5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f4276310640 1 --2- 172.21.15.28:0/381702781 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f427014f300 0x7f42701de5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f4276310640 1 -- 172.21.15.28:0/381702781 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4260009420 con 0x7f42700b5e50 2023-11-16T02:29:47.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f4276310640 1 --2- 172.21.15.28:0/381702781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42700b5e50 0x7f4270070090 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f42600ab000 tx=0x7f4260018ff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f827f7fe640 1 -- 172.21.15.28:0/4227784699 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8280140c20 msgr2=0x7f828013f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f827f7fe640 1 --2- 172.21.15.28:0/4227784699 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8280140c20 0x7f828013f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f827f7fe640 1 -- 172.21.15.28:0/4227784699 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82800b5e50 msgr2=0x7f8280149010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f827f7fe640 1 --2- 172.21.15.28:0/4227784699 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f82800b5e50 0x7f8280149010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f827f7fe640 1 -- 172.21.15.28:0/4227784699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827000d970 con 0x7f82800b93b0 2023-11-16T02:29:47.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f827f7fe640 1 --2- 172.21.15.28:0/4227784699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82800b93b0 0x7f828006fe50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f827400c410 tx=0x7f827400c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f2a957fa640 1 -- 172.21.15.28:0/1174046558 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2a8c01e3e0 con 0x7f2a98158780 2023-11-16T02:29:47.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f2be87be640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2be00b4830 0x7f2be01e49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f2be87be640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2be00b4f10 0x7f2be00b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f2be87be640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2be00babf0 0x7f2be01e7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f2be87be640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be00b23c0 con 0x7f2be00babf0 2023-11-16T02:29:47.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f2be87be640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be00b2620 con 0x7f2be00b4830 2023-11-16T02:29:47.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f2be87be640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be01e41b0 con 0x7f2be00b4f10 2023-11-16T02:29:47.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f2be6d5b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2be00babf0 0x7f2be01e7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f2be6d5b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2be00babf0 0x7f2be01e7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41050/0 (socket says 172.21.15.28:41050) 2023-11-16T02:29:47.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f2be6d5b640 1 -- 172.21.15.28:0/1652971852 learned_addr learned my addr 172.21.15.28:0/1652971852 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:47.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f2be655a640 1 --2- 172.21.15.28:0/1652971852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2be00b4830 0x7f2be01e49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7fd613fff640 1 -- 172.21.15.28:0/589072758 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd624007070 con 0x7fd62c0b8360 2023-11-16T02:29:47.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f6dea59c640 1 --2- 172.21.15.28:0/1778139346 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6dec0b5930 0x7f6dec133130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-16T02:29:47.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f03e28bb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f03d4006d30 0x7f03d4039c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f03e28bb640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f03d4007110 0x7f03d4034690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f03e28bb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03d40c7230 0x7f03d40354e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f03e28bb640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d4033a30 con 0x7f03d4006d30 2023-11-16T02:29:47.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f03e28bb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d403a190 con 0x7f03d40c7230 2023-11-16T02:29:47.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f03e28bb640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d4034bd0 con 0x7f03d4007110 2023-11-16T02:29:47.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f6dead9d640 1 --2- 172.21.15.28:0/1778139346 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6dec149b80 0x7f6dec14b5c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6de400efc0 tx=0x7f6de400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f827cff9640 1 -- 172.21.15.28:0/4227784699 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8274011790 con 0x7f82800b93b0 2023-11-16T02:29:47.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f827cff9640 1 -- 172.21.15.28:0/4227784699 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82740118f0 con 0x7f82800b93b0 2023-11-16T02:29:47.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f827cff9640 1 -- 172.21.15.28:0/4227784699 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8274011c80 con 0x7f82800b93b0 2023-11-16T02:29:47.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f8286661640 1 -- 172.21.15.28:0/4227784699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8280141710 con 0x7f82800b93b0 2023-11-16T02:29:47.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f2be5d59640 1 --2- 172.21.15.28:0/1652971852 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2be00b4f10 0x7f2be00b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f4266ffd640 1 -- 172.21.15.28:0/381702781 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42600b6b10 con 0x7f42700b5e50 2023-11-16T02:29:47.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f4278574640 1 -- 172.21.15.28:0/381702781 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42701415c0 con 0x7f42700b5e50 2023-11-16T02:29:47.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f4278574640 1 -- 172.21.15.28:0/381702781 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4270071690 con 0x7f42700b5e50 2023-11-16T02:29:47.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f4266ffd640 1 -- 172.21.15.28:0/381702781 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42600b6c70 con 0x7f42700b5e50 2023-11-16T02:29:47.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f4266ffd640 1 -- 172.21.15.28:0/381702781 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42600be660 con 0x7f42700b5e50 2023-11-16T02:29:47.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f2be5d59640 1 -- 172.21.15.28:0/1652971852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2be00b4830 msgr2=0x7f2be01e49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f2be5d59640 1 --2- 172.21.15.28:0/1652971852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2be00b4830 0x7f2be01e49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f2be5d59640 1 -- 172.21.15.28:0/1652971852 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2be00babf0 msgr2=0x7f2be01e7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f2be5d59640 1 --2- 172.21.15.28:0/1652971852 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2be00babf0 0x7f2be01e7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f2be5d59640 1 -- 172.21.15.28:0/1652971852 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd8009b30 con 0x7f2be00b4f10 2023-11-16T02:29:47.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f2be6d5b640 1 --2- 172.21.15.28:0/1652971852 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2be00babf0 0x7f2be01e7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-16T02:29:47.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f03db7fe640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f03d4007110 0x7f03d4034690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f03db7fe640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f03d4007110 0x7f03d4034690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.28:47214/0 (socket says 172.21.15.28:47214) 2023-11-16T02:29:47.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f03db7fe640 1 -- 172.21.15.28:0/2730749136 learned_addr learned my addr 172.21.15.28:0/2730749136 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:47.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f03dbfff640 1 --2- 172.21.15.28:0/2730749136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f03d4006d30 0x7f03d4039c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fd613fff640 1 --2- 172.21.15.28:0/589072758 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fd618065ab0 0x7fd618067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fd613fff640 1 -- 172.21.15.28:0/589072758 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd624083810 con 0x7fd62c0b8360 2023-11-16T02:29:47.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fd613fff640 1 --2- 172.21.15.28:0/589072758 >> [v2:172.21.15.28:6816/38725,v1:172.21.15.28:6817/38725] conn(0x7fd61806dc50 0x7fd618070070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fd613fff640 1 -- 172.21.15.28:0/589072758 --> [v2:172.21.15.28:6816/38725,v1:172.21.15.28:6817/38725] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd618070720 con 0x7fd61806dc50 2023-11-16T02:29:47.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fd62affd640 1 --2- 172.21.15.28:0/589072758 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fd618065ab0 0x7fd618067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fd62b7fe640 1 --2- 172.21.15.28:0/589072758 >> [v2:172.21.15.28:6816/38725,v1:172.21.15.28:6817/38725] conn(0x7fd61806dc50 0x7fd618070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7fba74da0640 1 Processor -- start 2023-11-16T02:29:47.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7fba74da0640 1 -- start start 2023-11-16T02:29:47.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fba74da0640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fba700b5930 0x7fba70147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fba74da0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba7014ecd0 0x7fba70150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fba74da0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba7014f8a0 0x7fba7013c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fba74da0640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba701482c0 con 0x7fba7014ecd0 2023-11-16T02:29:47.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fba74da0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba70071160 con 0x7fba7014f8a0 2023-11-16T02:29:47.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fba74da0640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba70151a90 con 0x7fba700b5930 2023-11-16T02:29:47.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fba6e59c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fba700b5930 0x7fba70147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fba6e59c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fba700b5930 0x7fba70147d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.28:47222/0 (socket says 172.21.15.28:47222) 2023-11-16T02:29:47.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fba6e59c640 1 -- 172.21.15.28:0/2085065064 learned_addr learned my addr 172.21.15.28:0/2085065064 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:47.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fba6dd9b640 1 --2- 172.21.15.28:0/2085065064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba7014ecd0 0x7fba70150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f8286661640 1 -- 172.21.15.28:0/4227784699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82801429b0 con 0x7f82800b93b0 2023-11-16T02:29:47.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f6ddaffd640 1 -- 172.21.15.28:0/1778139346 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de400cd20 con 0x7f6dec149b80 2023-11-16T02:29:47.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f6ddaffd640 1 -- 172.21.15.28:0/1778139346 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de400f040 con 0x7f6dec149b80 2023-11-16T02:29:47.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f6ddaffd640 1 -- 172.21.15.28:0/1778139346 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de4003be0 con 0x7f6dec149b80 2023-11-16T02:29:47.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.933+0000 7f2a957fa640 1 --2- 172.21.15.28:0/1174046558 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2a84065b30 0x7f2a84067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f2a957fa640 1 -- 172.21.15.28:0/1174046558 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a8c00ae40 con 0x7f2a98158780 2023-11-16T02:29:47.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f2a957fa640 1 --2- 172.21.15.28:0/1174046558 >> [v2:172.21.15.70:6811/38839,v1:172.21.15.70:6815/38839] conn(0x7f2a8406dd50 0x7f2a84070170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f2a957fa640 1 -- 172.21.15.28:0/1174046558 --> [v2:172.21.15.70:6811/38839,v1:172.21.15.70:6815/38839] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2a84070820 con 0x7f2a8406dd50 2023-11-16T02:29:47.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f2a9cea7640 1 --2- 172.21.15.28:0/1174046558 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2a84065b30 0x7f2a84067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f2a957fa640 1 -- 172.21.15.28:0/1174046558 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a8c08c870 con 0x7f2a98158780 2023-11-16T02:29:47.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f2a97fff640 1 --2- 172.21.15.28:0/1174046558 >> [v2:172.21.15.70:6811/38839,v1:172.21.15.70:6815/38839] conn(0x7f2a8406dd50 0x7f2a84070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f03dbfff640 1 -- 172.21.15.28:0/2730749136 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f03d4007110 msgr2=0x7f03d4034690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f03dbfff640 1 --2- 172.21.15.28:0/2730749136 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f03d4007110 0x7f03d4034690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f03dbfff640 1 -- 172.21.15.28:0/2730749136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03d40c7230 msgr2=0x7f03d40354e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-16T02:29:47.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f03dbfff640 1 --2- 172.21.15.28:0/2730749136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03d40c7230 0x7f03d40354e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f03dbfff640 1 -- 172.21.15.28:0/2730749136 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc072fb0 con 0x7f03d4006d30 2023-11-16T02:29:47.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f2a9cea7640 1 --2- 172.21.15.28:0/1174046558 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2a84065b30 0x7f2a84067ff0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2a900012f0 tx=0x7f2a90001820 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fd62affd640 1 --2- 172.21.15.28:0/589072758 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fd618065ab0 0x7fd618067f70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd61c009b60 tx=0x7fd61c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fd613fff640 1 -- 172.21.15.28:0/589072758 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd624001bd0 con 0x7fd62c0b8360 2023-11-16T02:29:47.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f2a97fff640 1 --2- 172.21.15.28:0/1174046558 >> [v2:172.21.15.70:6811/38839,v1:172.21.15.70:6815/38839] conn(0x7f2a8406dd50 0x7f2a84070170 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fba6e59c640 1 -- 172.21.15.28:0/2085065064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba7014f8a0 msgr2=0x7fba7013c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fba6e59c640 1 --2- 172.21.15.28:0/2085065064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba7014f8a0 0x7fba7013c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fba6e59c640 1 -- 172.21.15.28:0/2085065064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba7014ecd0 msgr2=0x7fba70150310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:47.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fba6e59c640 1 --2- 172.21.15.28:0/2085065064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba7014ecd0 0x7fba70150310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:47.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fba6e59c640 1 -- 172.21.15.28:0/2085065064 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba640094d0 con 0x7fba700b5930 2023-11-16T02:29:47.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f6df0bb1640 1 -- 172.21.15.28:0/1778139346 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dec14d070 con 0x7f6dec149b80 2023-11-16T02:29:47.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f6df0bb1640 1 -- 172.21.15.28:0/1778139346 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dec134dd0 con 0x7f6dec149b80 2023-11-16T02:29:47.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fba6dd9b640 1 --2- 172.21.15.28:0/2085065064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba7014ecd0 0x7fba70150310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-16T02:29:47.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f2be5d59640 1 --2- 172.21.15.28:0/1652971852 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2be00b4f10 0x7f2be00b1e80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc00b3f0 tx=0x7f2bdc00b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f03dbfff640 1 --2- 172.21.15.28:0/2730749136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f03d4006d30 0x7f03d4039c50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f03cc004b90 tx=0x7f03cc00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f4278574640 1 -- 172.21.15.28:0/381702781 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4258000fd0 con 0x7f42700b5e50 2023-11-16T02:29:47.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fd62b7fe640 1 --2- 172.21.15.28:0/589072758 >> [v2:172.21.15.28:6816/38725,v1:172.21.15.28:6817/38725] conn(0x7fd61806dc50 0x7fd618070070 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fba6e59c640 1 --2- 172.21.15.28:0/2085065064 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fba700b5930 0x7fba70147d80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fba6401aba0 tx=0x7fba6401ad30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f8286661640 1 -- 172.21.15.28:0/4227784699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f82800b22b0 con 0x7f82800b93b0 2023-11-16T02:29:47.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f03d8ff9640 1 -- 172.21.15.28:0/2730749136 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc007960 con 0x7f03d4006d30 2023-11-16T02:29:47.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f03d8ff9640 1 -- 172.21.15.28:0/2730749136 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03cc007ac0 con 0x7f03d4006d30 2023-11-16T02:29:47.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f03d8ff9640 1 -- 172.21.15.28:0/2730749136 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc00f410 con 0x7f03d4006d30 2023-11-16T02:29:47.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f03e28bb640 1 -- 172.21.15.28:0/2730749136 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d4033790 con 0x7f03d4006d30 2023-11-16T02:29:47.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f03e28bb640 1 -- 172.21.15.28:0/2730749136 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d4035a20 con 0x7f03d4006d30 2023-11-16T02:29:47.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f6df0bb1640 1 -- 172.21.15.28:0/1778139346 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6dec0b2380 con 0x7f6dec149b80 2023-11-16T02:29:47.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7fd613fff640 1 -- 172.21.15.28:0/589072758 <== osd.3 v2:172.21.15.28:6816/38725 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd618070720 con 0x7fd61806dc50 2023-11-16T02:29:47.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f03e28bb640 1 -- 172.21.15.28:0/2730749136 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f03d403dd20 con 0x7f03d4006d30 2023-11-16T02:29:47.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f2bd6ffd640 1 -- 172.21.15.28:0/1652971852 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc011830 con 0x7f2be00b4f10 2023-11-16T02:29:47.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f2be87be640 1 -- 172.21.15.28:0/1652971852 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be01e4490 con 0x7f2be00b4f10 2023-11-16T02:29:47.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f2be87be640 1 -- 172.21.15.28:0/1652971852 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be00afcd0 con 0x7f2be00b4f10 2023-11-16T02:29:47.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f827cff9640 1 -- 172.21.15.28:0/4227784699 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f827401c460 con 0x7f82800b93b0 2023-11-16T02:29:47.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f827cff9640 1 --2- 172.21.15.28:0/4227784699 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f826c065b60 0x7f826c068020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f827cff9640 1 -- 172.21.15.28:0/4227784699 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8274082cd0 con 0x7f82800b93b0 2023-11-16T02:29:47.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f827ffff640 1 --2- 172.21.15.28:0/4227784699 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f826c065b60 0x7f826c068020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f827cff9640 1 --2- 172.21.15.28:0/4227784699 >> [v2:172.21.15.70:6808/38830,v1:172.21.15.70:6810/38830] conn(0x7f826c06dd00 0x7f826c070120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.937+0000 7f827cff9640 1 -- 172.21.15.28:0/4227784699 --> [v2:172.21.15.70:6808/38830,v1:172.21.15.70:6810/38830] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f826c0707d0 con 0x7f826c06dd00 2023-11-16T02:29:47.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f2bd6ffd640 1 -- 172.21.15.28:0/1652971852 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bdc011990 con 0x7f2be00b4f10 2023-11-16T02:29:47.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f2bd6ffd640 1 -- 172.21.15.28:0/1652971852 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc011d40 con 0x7f2be00b4f10 2023-11-16T02:29:47.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f2a957fa640 1 -- 172.21.15.28:0/1174046558 <== osd.7 v2:172.21.15.70:6811/38839 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2a84070820 con 0x7f2a8406dd50 2023-11-16T02:29:47.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7fba5effd640 1 -- 172.21.15.28:0/2085065064 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba640bd5f0 con 0x7fba700b5930 2023-11-16T02:29:47.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f827ffff640 1 --2- 172.21.15.28:0/4227784699 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f826c065b60 0x7f826c068020 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f82700b5000 tx=0x7f8270008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:47.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f2be87be640 1 -- 172.21.15.28:0/1652971852 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2bc8000fd0 con 0x7f2be00b4f10 2023-11-16T02:29:47.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7fba74da0640 1 -- 172.21.15.28:0/2085065064 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7014fe30 con 0x7fba700b5930 2023-11-16T02:29:47.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7fba74da0640 1 -- 172.21.15.28:0/2085065064 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba70071690 con 0x7fba700b5930 2023-11-16T02:29:47.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7fba5effd640 1 -- 172.21.15.28:0/2085065064 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba640bd750 con 0x7fba700b5930 2023-11-16T02:29:47.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f4266ffd640 1 -- 172.21.15.28:0/381702781 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f42600b2040 con 0x7f42700b5e50 2023-11-16T02:29:47.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f4266ffd640 1 --2- 172.21.15.28:0/381702781 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4254065a60 0x7f4254067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f4266ffd640 1 -- 172.21.15.28:0/381702781 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4260121660 con 0x7f42700b5e50 2023-11-16T02:29:47.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f4266ffd640 1 --2- 172.21.15.28:0/381702781 >> [v2:172.21.15.28:6808/38722,v1:172.21.15.28:6809/38722] conn(0x7f425406dc80 0x7f42540700a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f4266ffd640 1 -- 172.21.15.28:0/381702781 --> [v2:172.21.15.28:6808/38722,v1:172.21.15.28:6809/38722] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4254070750 con 0x7f425406dc80 2023-11-16T02:29:47.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f4266ffd640 1 -- 172.21.15.28:0/381702781 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4260121a10 con 0x7f42700b5e50 2023-11-16T02:29:47.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f4276b11640 1 --2- 172.21.15.28:0/381702781 >> [v2:172.21.15.28:6808/38722,v1:172.21.15.28:6809/38722] conn(0x7f425406dc80 0x7f42540700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:47.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f6ddaffd640 1 -- 172.21.15.28:0/1778139346 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6de4003d40 con 0x7f6dec149b80 2023-11-16T02:29:47.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f6ddaffd640 1 --2- 172.21.15.28:0/1778139346 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f6dcc065a60 0x7f6dcc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f6ddaffd640 1 -- 172.21.15.28:0/1778139346 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6de40844e0 con 0x7f6dec149b80 2023-11-16T02:29:47.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f6ddaffd640 1 --2- 172.21.15.28:0/1778139346 >> [v2:172.21.15.70:6809/38829,v1:172.21.15.70:6812/38829] conn(0x7f6dcc06dc80 0x7f6dcc0700a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:47.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f6ddaffd640 1 -- 172.21.15.28:0/1778139346 --> [v2:172.21.15.70:6809/38829,v1:172.21.15.70:6812/38829] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6dcc070750 con 0x7f6dcc06dc80 2023-11-16T02:29:47.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f6ddaffd640 1 -- 172.21.15.28:0/1778139346 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6de4084890 con 0x7f6dec149b80 2023-11-16T02:29:48.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f4276b11640 1 --2- 172.21.15.28:0/381702781 >> [v2:172.21.15.28:6808/38722,v1:172.21.15.28:6809/38722] conn(0x7f425406dc80 0x7f42540700a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f8284bfe640 1 --2- 172.21.15.28:0/4227784699 >> [v2:172.21.15.70:6808/38830,v1:172.21.15.70:6810/38830] conn(0x7f826c06dd00 0x7f826c070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f827cff9640 1 -- 172.21.15.28:0/4227784699 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8274050700 con 0x7f82800b93b0 2023-11-16T02:29:48.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f4275b0f640 1 --2- 172.21.15.28:0/381702781 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4254065a60 0x7f4254067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f6de9d9b640 1 --2- 172.21.15.28:0/1778139346 >> [v2:172.21.15.70:6809/38829,v1:172.21.15.70:6812/38829] conn(0x7f6dcc06dc80 0x7f6dcc0700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f2bd6ffd640 1 -- 172.21.15.28:0/1652971852 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2bdc01a400 con 0x7f2be00b4f10 2023-11-16T02:29:48.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f4275b0f640 1 --2- 172.21.15.28:0/381702781 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4254065a60 0x7f4254067f20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f426c007fd0 tx=0x7f426c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f6de9d9b640 1 --2- 172.21.15.28:0/1778139346 >> [v2:172.21.15.70:6809/38829,v1:172.21.15.70:6812/38829] conn(0x7f6dcc06dc80 0x7f6dcc0700a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f2bd6ffd640 1 --2- 172.21.15.28:0/1652971852 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2bc4065b30 0x7f2bc4067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f2bd6ffd640 1 -- 172.21.15.28:0/1652971852 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2bdc083720 con 0x7f2be00b4f10 2023-11-16T02:29:48.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f8284bfe640 1 --2- 172.21.15.28:0/4227784699 >> [v2:172.21.15.70:6808/38830,v1:172.21.15.70:6810/38830] conn(0x7f826c06dd00 0x7f826c070120 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f2bd6ffd640 1 --2- 172.21.15.28:0/1652971852 >> [v2:172.21.15.28:6822/38724,v1:172.21.15.28:6824/38724] conn(0x7f2bc406dd50 0x7f2bc4070170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f4266ffd640 1 -- 172.21.15.28:0/381702781 <== osd.0 v2:172.21.15.28:6808/38722 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4254070750 con 0x7f425406dc80 2023-11-16T02:29:48.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f2bd6ffd640 1 -- 172.21.15.28:0/1652971852 --> [v2:172.21.15.28:6822/38724,v1:172.21.15.28:6824/38724] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2bc4070820 con 0x7f2bc406dd50 2023-11-16T02:29:48.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f2bd6ffd640 1 -- 172.21.15.28:0/1652971852 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2bdc083ad0 con 0x7f2be00b4f10 2023-11-16T02:29:48.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.941+0000 7f2be6d5b640 1 --2- 172.21.15.28:0/1652971852 >> [v2:172.21.15.28:6822/38724,v1:172.21.15.28:6824/38724] conn(0x7f2bc406dd50 0x7f2bc4070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.945+0000 7f2be6d5b640 1 --2- 172.21.15.28:0/1652971852 >> [v2:172.21.15.28:6822/38724,v1:172.21.15.28:6824/38724] conn(0x7f2bc406dd50 0x7f2bc4070170 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.945+0000 7f2be655a640 1 --2- 172.21.15.28:0/1652971852 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2bc4065b30 0x7f2bc4067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.945+0000 7fba5effd640 1 -- 172.21.15.28:0/2085065064 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba640bdae0 con 0x7fba700b5930 2023-11-16T02:29:48.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.945+0000 7fba5effd640 1 -- 172.21.15.28:0/2085065064 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fba640b33f0 con 0x7fba700b5930 2023-11-16T02:29:48.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.945+0000 7fba5effd640 1 --2- 172.21.15.28:0/2085065064 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fba50065bb0 0x7fba50068070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.945+0000 7fba5effd640 1 -- 172.21.15.28:0/2085065064 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba6411dab0 con 0x7fba700b5930 2023-11-16T02:29:48.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.945+0000 7fba6dd9b640 1 --2- 172.21.15.28:0/2085065064 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fba50065bb0 0x7fba50068070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.945+0000 7f6dea59c640 1 --2- 172.21.15.28:0/1778139346 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f6dcc065a60 0x7f6dcc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.945+0000 7f6dea59c640 1 --2- 172.21.15.28:0/1778139346 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f6dcc065a60 0x7f6dcc067f20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6de0009e30 tx=0x7f6de0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.945+0000 7f827cff9640 1 -- 172.21.15.28:0/4227784699 <== osd.5 v2:172.21.15.70:6808/38830 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f826c0707d0 con 0x7f826c06dd00 2023-11-16T02:29:48.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.945+0000 7f2bd6ffd640 1 -- 172.21.15.28:0/1652971852 <== osd.1 v2:172.21.15.28:6822/38724 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2bc4070820 con 0x7f2bc406dd50 2023-11-16T02:29:48.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.945+0000 7f2be655a640 1 --2- 172.21.15.28:0/1652971852 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2bc4065b30 0x7f2bc4067ff0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2bd00098e0 tx=0x7f2bd0009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.945+0000 7fba6dd9b640 1 --2- 172.21.15.28:0/2085065064 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fba50065bb0 0x7fba50068070 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fba700b7810 tx=0x7fba60009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.949+0000 7f03d8ff9640 1 -- 172.21.15.28:0/2730749136 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f03cc018400 con 0x7f03d4006d30 2023-11-16T02:29:48.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.949+0000 7f03d8ff9640 1 --2- 172.21.15.28:0/2730749136 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f03c8065b30 0x7f03c8067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.949+0000 7f03d8ff9640 1 -- 172.21.15.28:0/2730749136 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03cc083980 con 0x7f03d4006d30 2023-11-16T02:29:48.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.949+0000 7f03d8ff9640 1 --2- 172.21.15.28:0/2730749136 >> [v2:172.21.15.28:6800/38723,v1:172.21.15.28:6801/38723] conn(0x7f03c806dd50 0x7f03c8070170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.949+0000 7f03e0e58640 1 --2- 172.21.15.28:0/2730749136 >> [v2:172.21.15.28:6800/38723,v1:172.21.15.28:6801/38723] conn(0x7f03c806dd50 0x7f03c8070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.949+0000 7f03e0e58640 1 --2- 172.21.15.28:0/2730749136 >> [v2:172.21.15.28:6800/38723,v1:172.21.15.28:6801/38723] conn(0x7f03c806dd50 0x7f03c8070170 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.949+0000 7f03d8ff9640 1 -- 172.21.15.28:0/2730749136 --> [v2:172.21.15.28:6800/38723,v1:172.21.15.28:6801/38723] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f03c8070820 con 0x7f03c806dd50 2023-11-16T02:29:48.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.949+0000 7f03d8ff9640 1 -- 172.21.15.28:0/2730749136 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03cc083d30 con 0x7f03d4006d30 2023-11-16T02:29:48.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.949+0000 7f03d8ff9640 1 -- 172.21.15.28:0/2730749136 <== osd.2 v2:172.21.15.28:6800/38723 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f03c8070820 con 0x7f03c806dd50 2023-11-16T02:29:48.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.953+0000 7fba74da0640 1 -- 172.21.15.28:0/2085065064 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fba54000fd0 con 0x7fba700b5930 2023-11-16T02:29:48.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.953+0000 7f03db7fe640 1 --2- 172.21.15.28:0/2730749136 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f03c8065b30 0x7f03c8067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.953+0000 7f6ddaffd640 1 -- 172.21.15.28:0/1778139346 <== osd.6 v2:172.21.15.70:6809/38829 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6dcc070750 con 0x7f6dcc06dc80 2023-11-16T02:29:48.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.953+0000 7fba5effd640 1 --2- 172.21.15.28:0/2085065064 >> [v2:172.21.15.70:6800/38828,v1:172.21.15.70:6801/38828] conn(0x7fba5006dbe0 0x7fba50070000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.953+0000 7fba5effd640 1 -- 172.21.15.28:0/2085065064 --> [v2:172.21.15.70:6800/38828,v1:172.21.15.70:6801/38828] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba500706b0 con 0x7fba5006dbe0 2023-11-16T02:29:48.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.953+0000 7fba5effd640 1 -- 172.21.15.28:0/2085065064 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba640aae80 con 0x7fba700b5930 2023-11-16T02:29:48.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.953+0000 7fba6ed9d640 1 --2- 172.21.15.28:0/2085065064 >> [v2:172.21.15.70:6800/38828,v1:172.21.15.70:6801/38828] conn(0x7fba5006dbe0 0x7fba50070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.953+0000 7f03db7fe640 1 --2- 172.21.15.28:0/2730749136 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f03c8065b30 0x7f03c8067ff0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f03d4040510 tx=0x7f03d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.953+0000 7fba6ed9d640 1 --2- 172.21.15.28:0/2085065064 >> [v2:172.21.15.70:6800/38828,v1:172.21.15.70:6801/38828] conn(0x7fba5006dbe0 0x7fba50070000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.957+0000 7fba5effd640 1 -- 172.21.15.28:0/2085065064 <== osd.4 v2:172.21.15.70:6800/38828 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fba500706b0 con 0x7fba5006dbe0 2023-11-16T02:29:48.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.957+0000 7fd631857640 1 -- 172.21.15.28:0/589072758 --> [v2:172.21.15.28:6816/38725,v1:172.21.15.28:6817/38725] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd62c0b1720 con 0x7fd61806dc50 2023-11-16T02:29:48.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.957+0000 7f8286661640 1 -- 172.21.15.28:0/4227784699 --> [v2:172.21.15.70:6808/38830,v1:172.21.15.70:6810/38830] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f82800b1fd0 con 0x7f826c06dd00 2023-11-16T02:29:48.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.957+0000 7fd613fff640 1 -- 172.21.15.28:0/589072758 <== osd.3 v2:172.21.15.28:6816/38725 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd62000c040 con 0x7fd61806dc50 2023-11-16T02:29:48.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.961+0000 7f827cff9640 1 -- 172.21.15.28:0/4227784699 <== osd.5 v2:172.21.15.70:6808/38830 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f827800f040 con 0x7f826c06dd00 2023-11-16T02:29:48.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.961+0000 7f82667fc640 1 -- 172.21.15.28:0/4227784699 >> [v2:172.21.15.70:6808/38830,v1:172.21.15.70:6810/38830] conn(0x7f826c06dd00 msgr2=0x7f826c070120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.961+0000 7f82667fc640 1 --2- 172.21.15.28:0/4227784699 >> [v2:172.21.15.70:6808/38830,v1:172.21.15.70:6810/38830] conn(0x7f826c06dd00 0x7f826c070120 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.965+0000 7f82667fc640 1 -- 172.21.15.28:0/4227784699 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f826c065b60 msgr2=0x7f826c068020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.965+0000 7f2be87be640 1 -- 172.21.15.28:0/1652971852 --> [v2:172.21.15.28:6822/38724,v1:172.21.15.28:6824/38724] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2bc8002cf0 con 0x7f2bc406dd50 2023-11-16T02:29:48.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.965+0000 7f82667fc640 1 --2- 172.21.15.28:0/4227784699 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f826c065b60 0x7f826c068020 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f82700b5000 tx=0x7f8270008040 comp rx=0 tx=0).stop 2023-11-16T02:29:48.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.965+0000 7f82667fc640 1 -- 172.21.15.28:0/4227784699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82800b93b0 msgr2=0x7f828006fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.965+0000 7f82667fc640 1 --2- 172.21.15.28:0/4227784699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82800b93b0 0x7f828006fe50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f827400c410 tx=0x7f827400c8d0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.965+0000 7f8284bfe640 1 -- 172.21.15.28:0/4227784699 reap_dead start 2023-11-16T02:29:48.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.965+0000 7f82667fc640 1 -- 172.21.15.28:0/4227784699 shutdown_connections 2023-11-16T02:29:48.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.965+0000 7f82667fc640 1 -- 172.21.15.28:0/4227784699 >> 172.21.15.28:0/4227784699 conn(0x7f82800b8890 msgr2=0x7f82800b8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:48.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.965+0000 7f82667fc640 1 -- 172.21.15.28:0/4227784699 shutdown_connections 2023-11-16T02:29:48.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.965+0000 7f82667fc640 1 -- 172.21.15.28:0/4227784699 wait complete. 2023-11-16T02:29:48.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.965+0000 7f2bd6ffd640 1 -- 172.21.15.28:0/1652971852 <== osd.1 v2:172.21.15.28:6822/38724 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2bc8002cf0 con 0x7f2bc406dd50 2023-11-16T02:29:48.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.965+0000 7f2be87be640 1 -- 172.21.15.28:0/1652971852 >> [v2:172.21.15.28:6822/38724,v1:172.21.15.28:6824/38724] conn(0x7f2bc406dd50 msgr2=0x7f2bc4070170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.965+0000 7f2be87be640 1 --2- 172.21.15.28:0/1652971852 >> [v2:172.21.15.28:6822/38724,v1:172.21.15.28:6824/38724] conn(0x7f2bc406dd50 0x7f2bc4070170 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.965+0000 7f2a9dea9640 1 -- 172.21.15.28:0/1174046558 --> [v2:172.21.15.70:6811/38839,v1:172.21.15.70:6815/38839] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2a9806f710 con 0x7f2a8406dd50 2023-11-16T02:29:48.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.965+0000 7f2be87be640 1 -- 172.21.15.28:0/1652971852 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2bc4065b30 msgr2=0x7f2bc4067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.969+0000 7f2be87be640 1 --2- 172.21.15.28:0/1652971852 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2bc4065b30 0x7f2bc4067ff0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2bd00098e0 tx=0x7f2bd0009060 comp rx=0 tx=0).stop 2023-11-16T02:29:48.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.969+0000 7f2be87be640 1 -- 172.21.15.28:0/1652971852 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2be00b4f10 msgr2=0x7f2be00b1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.969+0000 7f2be87be640 1 --2- 172.21.15.28:0/1652971852 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2be00b4f10 0x7f2be00b1e80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc00b3f0 tx=0x7f2bdc00b8b0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.969+0000 7f2be6d5b640 1 -- 172.21.15.28:0/1652971852 reap_dead start 2023-11-16T02:29:48.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.969+0000 7f2be87be640 1 -- 172.21.15.28:0/1652971852 shutdown_connections 2023-11-16T02:29:48.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.969+0000 7f2be87be640 1 -- 172.21.15.28:0/1652971852 >> 172.21.15.28:0/1652971852 conn(0x7f2be0069d70 msgr2=0x7f2be006a150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:48.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.969+0000 7f2be87be640 1 -- 172.21.15.28:0/1652971852 shutdown_connections 2023-11-16T02:29:48.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.969+0000 7f2be87be640 1 -- 172.21.15.28:0/1652971852 wait complete. 2023-11-16T02:29:48.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.969+0000 7f4278574640 1 -- 172.21.15.28:0/381702781 --> [v2:172.21.15.28:6808/38722,v1:172.21.15.28:6809/38722] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4258002cc0 con 0x7f425406dc80 2023-11-16T02:29:48.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.969+0000 7f4266ffd640 1 -- 172.21.15.28:0/381702781 <== osd.0 v2:172.21.15.28:6808/38722 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4258002cc0 con 0x7f425406dc80 2023-11-16T02:29:48.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.969+0000 7f4278574640 1 -- 172.21.15.28:0/381702781 >> [v2:172.21.15.28:6808/38722,v1:172.21.15.28:6809/38722] conn(0x7f425406dc80 msgr2=0x7f42540700a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.969+0000 7f4278574640 1 --2- 172.21.15.28:0/381702781 >> [v2:172.21.15.28:6808/38722,v1:172.21.15.28:6809/38722] conn(0x7f425406dc80 0x7f42540700a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.969+0000 7f4278574640 1 -- 172.21.15.28:0/381702781 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4254065a60 msgr2=0x7f4254067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.969+0000 7f4278574640 1 --2- 172.21.15.28:0/381702781 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4254065a60 0x7f4254067f20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f426c007fd0 tx=0x7f426c009040 comp rx=0 tx=0).stop 2023-11-16T02:29:48.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.969+0000 7f4278574640 1 -- 172.21.15.28:0/381702781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42700b5e50 msgr2=0x7f4270070090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.969+0000 7f4278574640 1 --2- 172.21.15.28:0/381702781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42700b5e50 0x7f4270070090 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f42600ab000 tx=0x7f4260018ff0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.969+0000 7f4276b11640 1 -- 172.21.15.28:0/381702781 reap_dead start 2023-11-16T02:29:48.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.969+0000 7f4278574640 1 -- 172.21.15.28:0/381702781 shutdown_connections 2023-11-16T02:29:48.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.969+0000 7f4278574640 1 -- 172.21.15.28:0/381702781 >> 172.21.15.28:0/381702781 conn(0x7f42700b8890 msgr2=0x7f42700b9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:48.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.969+0000 7f4278574640 1 -- 172.21.15.28:0/381702781 shutdown_connections 2023-11-16T02:29:48.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.969+0000 7f4278574640 1 -- 172.21.15.28:0/381702781 wait complete. 2023-11-16T02:29:48.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.973+0000 7f2a957fa640 1 -- 172.21.15.28:0/1174046558 <== osd.7 v2:172.21.15.70:6811/38839 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2a88004040 con 0x7f2a8406dd50 2023-11-16T02:29:48.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.973+0000 7f2a7effd640 1 -- 172.21.15.28:0/1174046558 >> [v2:172.21.15.70:6811/38839,v1:172.21.15.70:6815/38839] conn(0x7f2a8406dd50 msgr2=0x7f2a84070170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.973+0000 7f2a7effd640 1 --2- 172.21.15.28:0/1174046558 >> [v2:172.21.15.70:6811/38839,v1:172.21.15.70:6815/38839] conn(0x7f2a8406dd50 0x7f2a84070170 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.973+0000 7f2a7effd640 1 -- 172.21.15.28:0/1174046558 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2a84065b30 msgr2=0x7f2a84067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.973+0000 7f2a7effd640 1 --2- 172.21.15.28:0/1174046558 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2a84065b30 0x7f2a84067ff0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2a900012f0 tx=0x7f2a90001820 comp rx=0 tx=0).stop 2023-11-16T02:29:48.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.973+0000 7f2a7effd640 1 -- 172.21.15.28:0/1174046558 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2a98158780 msgr2=0x7f2a981f2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.973+0000 7f2a7effd640 1 --2- 172.21.15.28:0/1174046558 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2a98158780 0x7f2a981f2e90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c016e40 tx=0x7f2a8c00b700 comp rx=0 tx=0).stop 2023-11-16T02:29:48.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.973+0000 7f2a9d6a8640 1 -- 172.21.15.28:0/1174046558 reap_dead start 2023-11-16T02:29:48.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.973+0000 7f2a7effd640 1 -- 172.21.15.28:0/1174046558 shutdown_connections 2023-11-16T02:29:48.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.973+0000 7f2a7effd640 1 -- 172.21.15.28:0/1174046558 >> 172.21.15.28:0/1174046558 conn(0x7f2a980b88e0 msgr2=0x7f2a980830e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:48.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.973+0000 7f2a7effd640 1 -- 172.21.15.28:0/1174046558 shutdown_connections 2023-11-16T02:29:48.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.973+0000 7f2a7effd640 1 -- 172.21.15.28:0/1174046558 wait complete. 2023-11-16T02:29:48.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.981+0000 7f03e28bb640 1 -- 172.21.15.28:0/2730749136 --> [v2:172.21.15.28:6800/38723,v1:172.21.15.28:6801/38723] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f03d40d0f60 con 0x7f03c806dd50 2023-11-16T02:29:48.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.981+0000 7f03d8ff9640 1 -- 172.21.15.28:0/2730749136 <== osd.2 v2:172.21.15.28:6800/38723 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f03dc125540 con 0x7f03c806dd50 2023-11-16T02:29:48.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.981+0000 7fd631857640 1 -- 172.21.15.28:0/589072758 >> [v2:172.21.15.28:6816/38725,v1:172.21.15.28:6817/38725] conn(0x7fd61806dc50 msgr2=0x7fd618070070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.981+0000 7fd631857640 1 --2- 172.21.15.28:0/589072758 >> [v2:172.21.15.28:6816/38725,v1:172.21.15.28:6817/38725] conn(0x7fd61806dc50 0x7fd618070070 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.981+0000 7fd631857640 1 -- 172.21.15.28:0/589072758 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fd618065ab0 msgr2=0x7fd618067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.981+0000 7f03e28bb640 1 -- 172.21.15.28:0/2730749136 >> [v2:172.21.15.28:6800/38723,v1:172.21.15.28:6801/38723] conn(0x7f03c806dd50 msgr2=0x7f03c8070170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.981+0000 7f03e28bb640 1 --2- 172.21.15.28:0/2730749136 >> [v2:172.21.15.28:6800/38723,v1:172.21.15.28:6801/38723] conn(0x7f03c806dd50 0x7f03c8070170 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.981+0000 7fd631857640 1 --2- 172.21.15.28:0/589072758 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fd618065ab0 0x7fd618067f70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd61c009b60 tx=0x7fd61c009190 comp rx=0 tx=0).stop 2023-11-16T02:29:48.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.981+0000 7f03e28bb640 1 -- 172.21.15.28:0/2730749136 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f03c8065b30 msgr2=0x7f03c8067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.981+0000 7f03e28bb640 1 --2- 172.21.15.28:0/2730749136 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f03c8065b30 0x7f03c8067ff0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f03d4040510 tx=0x7f03d0009040 comp rx=0 tx=0).stop 2023-11-16T02:29:48.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.981+0000 7f03e28bb640 1 -- 172.21.15.28:0/2730749136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f03d4006d30 msgr2=0x7f03d4039c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.981+0000 7f03e28bb640 1 --2- 172.21.15.28:0/2730749136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f03d4006d30 0x7f03d4039c50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f03cc004b90 tx=0x7f03cc00cb10 comp rx=0 tx=0).stop 2023-11-16T02:29:48.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.981+0000 7f03e0e58640 1 -- 172.21.15.28:0/2730749136 reap_dead start 2023-11-16T02:29:48.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.981+0000 7fd631857640 1 -- 172.21.15.28:0/589072758 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd62c0b8360 msgr2=0x7fd62c1fb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.981+0000 7fd631857640 1 --2- 172.21.15.28:0/589072758 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd62c0b8360 0x7fd62c1fb660 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd62400cae0 tx=0x7fd62400a060 comp rx=0 tx=0).stop 2023-11-16T02:29:48.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.981+0000 7fd62b7fe640 1 -- 172.21.15.28:0/589072758 reap_dead start 2023-11-16T02:29:48.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.981+0000 7fd631857640 1 -- 172.21.15.28:0/589072758 shutdown_connections 2023-11-16T02:29:48.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.981+0000 7fd631857640 1 -- 172.21.15.28:0/589072758 >> 172.21.15.28:0/589072758 conn(0x7fd62c0b8890 msgr2=0x7fd62c1592e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:48.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.981+0000 7f03e28bb640 1 -- 172.21.15.28:0/2730749136 shutdown_connections 2023-11-16T02:29:48.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.981+0000 7f03e28bb640 1 -- 172.21.15.28:0/2730749136 >> 172.21.15.28:0/2730749136 conn(0x7f03d4005dc0 msgr2=0x7f03d40309e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:48.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.981+0000 7fd631857640 1 -- 172.21.15.28:0/589072758 shutdown_connections 2023-11-16T02:29:48.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.981+0000 7fd631857640 1 -- 172.21.15.28:0/589072758 wait complete. 2023-11-16T02:29:48.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.981+0000 7f03e28bb640 1 -- 172.21.15.28:0/2730749136 shutdown_connections 2023-11-16T02:29:48.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.981+0000 7f03e28bb640 1 -- 172.21.15.28:0/2730749136 wait complete. 2023-11-16T02:29:48.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.985+0000 7f6df0bb1640 1 -- 172.21.15.28:0/1778139346 --> [v2:172.21.15.70:6809/38829,v1:172.21.15.70:6812/38829] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6dec0b2380 con 0x7f6dcc06dc80 2023-11-16T02:29:48.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.985+0000 7fba74da0640 1 -- 172.21.15.28:0/2085065064 --> [v2:172.21.15.70:6800/38828,v1:172.21.15.70:6801/38828] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fba54002cc0 con 0x7fba5006dbe0 2023-11-16T02:29:48.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.985+0000 7f6ddaffd640 1 -- 172.21.15.28:0/1778139346 <== osd.6 v2:172.21.15.70:6809/38829 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6ddc006e20 con 0x7f6dcc06dc80 2023-11-16T02:29:48.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.985+0000 7f6df0bb1640 1 -- 172.21.15.28:0/1778139346 >> [v2:172.21.15.70:6809/38829,v1:172.21.15.70:6812/38829] conn(0x7f6dcc06dc80 msgr2=0x7f6dcc0700a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.985+0000 7f6df0bb1640 1 --2- 172.21.15.28:0/1778139346 >> [v2:172.21.15.70:6809/38829,v1:172.21.15.70:6812/38829] conn(0x7f6dcc06dc80 0x7f6dcc0700a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.985+0000 7f6df0bb1640 1 -- 172.21.15.28:0/1778139346 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f6dcc065a60 msgr2=0x7f6dcc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.985+0000 7f6df0bb1640 1 --2- 172.21.15.28:0/1778139346 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f6dcc065a60 0x7f6dcc067f20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6de0009e30 tx=0x7f6de0009190 comp rx=0 tx=0).stop 2023-11-16T02:29:48.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.985+0000 7f6df0bb1640 1 -- 172.21.15.28:0/1778139346 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6dec149b80 msgr2=0x7f6dec14b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.985+0000 7f6df0bb1640 1 --2- 172.21.15.28:0/1778139346 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6dec149b80 0x7f6dec14b5c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6de400efc0 tx=0x7f6de400c490 comp rx=0 tx=0).stop 2023-11-16T02:29:48.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.985+0000 7f6dead9d640 1 -- 172.21.15.28:0/1778139346 reap_dead start 2023-11-16T02:29:48.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.985+0000 7f6df0bb1640 1 -- 172.21.15.28:0/1778139346 shutdown_connections 2023-11-16T02:29:48.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.985+0000 7f6df0bb1640 1 -- 172.21.15.28:0/1778139346 >> 172.21.15.28:0/1778139346 conn(0x7f6dec0b8890 msgr2=0x7f6dec0731d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:48.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.989+0000 7fba5effd640 1 -- 172.21.15.28:0/2085065064 <== osd.4 v2:172.21.15.70:6800/38828 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fba54002cc0 con 0x7fba5006dbe0 2023-11-16T02:29:48.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.989+0000 7f6df0bb1640 1 -- 172.21.15.28:0/1778139346 shutdown_connections 2023-11-16T02:29:48.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.989+0000 7fba74da0640 1 -- 172.21.15.28:0/2085065064 >> [v2:172.21.15.70:6800/38828,v1:172.21.15.70:6801/38828] conn(0x7fba5006dbe0 msgr2=0x7fba50070000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.989+0000 7fba74da0640 1 --2- 172.21.15.28:0/2085065064 >> [v2:172.21.15.70:6800/38828,v1:172.21.15.70:6801/38828] conn(0x7fba5006dbe0 0x7fba50070000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.989+0000 7f6df0bb1640 1 -- 172.21.15.28:0/1778139346 wait complete. 2023-11-16T02:29:48.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.989+0000 7fba74da0640 1 -- 172.21.15.28:0/2085065064 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fba50065bb0 msgr2=0x7fba50068070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.989+0000 7fba74da0640 1 --2- 172.21.15.28:0/2085065064 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fba50065bb0 0x7fba50068070 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fba700b7810 tx=0x7fba60009190 comp rx=0 tx=0).stop 2023-11-16T02:29:48.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.989+0000 7fba74da0640 1 -- 172.21.15.28:0/2085065064 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fba700b5930 msgr2=0x7fba70147d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.989+0000 7fba74da0640 1 --2- 172.21.15.28:0/2085065064 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fba700b5930 0x7fba70147d80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fba6401aba0 tx=0x7fba6401ad30 comp rx=0 tx=0).stop 2023-11-16T02:29:48.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.989+0000 7fba6ed9d640 1 -- 172.21.15.28:0/2085065064 reap_dead start 2023-11-16T02:29:48.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.989+0000 7fba74da0640 1 -- 172.21.15.28:0/2085065064 shutdown_connections 2023-11-16T02:29:48.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.989+0000 7fba74da0640 1 -- 172.21.15.28:0/2085065064 >> 172.21.15.28:0/2085065064 conn(0x7fba700b8890 msgr2=0x7fba7014df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:48.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.989+0000 7fba74da0640 1 -- 172.21.15.28:0/2085065064 shutdown_connections 2023-11-16T02:29:48.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:47.989+0000 7fba74da0640 1 -- 172.21.15.28:0/2085065064 wait complete. 2023-11-16T02:29:48.032 INFO:teuthology.orchestra.run.smithi028.stdout:64424509448 2023-11-16T02:29:48.032 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-16T02:29:48.033 INFO:teuthology.orchestra.run.smithi028.stdout:64424509447 2023-11-16T02:29:48.033 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-16T02:29:48.034 INFO:teuthology.orchestra.run.smithi028.stdout:64424509447 2023-11-16T02:29:48.035 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-16T02:29:48.035 INFO:teuthology.orchestra.run.smithi028.stdout:64424509448 2023-11-16T02:29:48.036 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-16T02:29:48.036 INFO:teuthology.orchestra.run.smithi028.stdout:60129542151 2023-11-16T02:29:48.037 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-16T02:29:48.037 INFO:teuthology.orchestra.run.smithi028.stdout:64424509447 2023-11-16T02:29:48.038 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-16T02:29:48.038 INFO:teuthology.orchestra.run.smithi028.stdout:64424509448 2023-11-16T02:29:48.039 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-16T02:29:48.039 INFO:teuthology.orchestra.run.smithi028.stdout:64424509448 2023-11-16T02:29:48.040 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-16T02:29:48.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45fd8ca640 1 Processor -- start 2023-11-16T02:29:48.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45fd8ca640 1 -- start start 2023-11-16T02:29:48.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45fd8ca640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f45f0006dd0 0x7f45f003b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45fd8ca640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f003e0f0 con 0x7f45f003b930 2023-11-16T02:29:48.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45fd8ca640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f003e3d0 con 0x7f45f00c72d0 2023-11-16T02:29:48.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45fd8ca640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f0036120 con 0x7f45f0006dd0 2023-11-16T02:29:48.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45f7fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f45f003b930 0x7f45f00c6bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:39768/0 (socket says 172.21.15.28:39768) 2023-11-16T02:29:48.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45f7fff640 1 -- 172.21.15.28:0/1379881635 learned_addr learned my addr 172.21.15.28:0/1379881635 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:48.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45fc8c8640 1 --2- 172.21.15.28:0/1379881635 >> v2:172.21.15.70:3300/0 conn(0x7f45f0006dd0 0x7f45f003b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45f77fe640 1 -- 172.21.15.28:0/1379881635 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3905273985 0 0) 0x7f45f003e0f0 con 0x7f45f003b930 2023-11-16T02:29:48.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45f77fe640 1 -- 172.21.15.28:0/1379881635 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45e8003530 con 0x7f45f003b930 2023-11-16T02:29:48.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f0813800640 1 Processor -- start 2023-11-16T02:29:48.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7ffa2d3d2640 1 Processor -- start 2023-11-16T02:29:48.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7ffa2d3d2640 1 -- start start 2023-11-16T02:29:48.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f0813800640 1 -- start start 2023-11-16T02:29:48.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45f77fe640 1 -- 172.21.15.28:0/1379881635 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1979932440 0 0) 0x7f45e8003530 con 0x7f45f003b930 2023-11-16T02:29:48.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45f77fe640 1 -- 172.21.15.28:0/1379881635 >> v2:172.21.15.70:3300/0 conn(0x7f45f0006dd0 msgr2=0x7f45f003b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:48.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45f77fe640 1 --2- 172.21.15.28:0/1379881635 >> v2:172.21.15.70:3300/0 conn(0x7f45f0006dd0 0x7f45f003b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45f77fe640 1 -- 172.21.15.28:0/1379881635 >> v1:172.21.15.70:6789/0 conn(0x7f45f00c72d0 legacy=0x7f45f00d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45f77fe640 1 -- 172.21.15.28:0/1379881635 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f003e6b0 con 0x7f45f003b930 2023-11-16T02:29:48.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45f77fe640 1 -- 172.21.15.28:0/1379881635 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7f45e4004e70 con 0x7f45f003b930 2023-11-16T02:29:48.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45f77fe640 1 -- 172.21.15.28:0/1379881635 >> v1:172.21.15.28:6789/0 conn(0x7f45f003b930 legacy=0x7f45f00c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45f77fe640 1 --2- 172.21.15.28:0/1379881635 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f45e8003980 0x7f45e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45f77fe640 1 --2- 172.21.15.28:0/1379881635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45e80047d0 0x7f45e8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45f77fe640 1 --2- 172.21.15.28:0/1379881635 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f45e8005190 0x7f45e800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45f77fe640 1 -- 172.21.15.28:0/1379881635 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f0036120 con 0x7f45e8005190 2023-11-16T02:29:48.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45f77fe640 1 -- 172.21.15.28:0/1379881635 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e800bfe0 con 0x7f45e80047d0 2023-11-16T02:29:48.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45f77fe640 1 -- 172.21.15.28:0/1379881635 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e800c1a0 con 0x7f45e8003980 2023-11-16T02:29:48.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45f7fff640 1 --2- 172.21.15.28:0/1379881635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45e80047d0 0x7f45e8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45fd0c9640 1 --2- 172.21.15.28:0/1379881635 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f45e8005190 0x7f45e800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45fc8c8640 1 --2- 172.21.15.28:0/1379881635 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f45e8003980 0x7f45e8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45f7fff640 1 -- 172.21.15.28:0/1379881635 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f45e8003980 msgr2=0x7f45e8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:48.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45f7fff640 1 --2- 172.21.15.28:0/1379881635 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f45e8003980 0x7f45e8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45f7fff640 1 -- 172.21.15.28:0/1379881635 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f45e8005190 msgr2=0x7f45e800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:48.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45f7fff640 1 --2- 172.21.15.28:0/1379881635 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f45e8005190 0x7f45e800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45f7fff640 1 -- 172.21.15.28:0/1379881635 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e8003530 con 0x7f45e80047d0 2023-11-16T02:29:48.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45fc8c8640 1 --2- 172.21.15.28:0/1379881635 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f45e8003980 0x7f45e8003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:48.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45fd0c9640 1 --2- 172.21.15.28:0/1379881635 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f45e8005190 0x7f45e800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-16T02:29:48.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f45fd0c9640 1 -- 172.21.15.28:0/1379881635 reap_dead start 2023-11-16T02:29:48.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7fbb1597a640 1 Processor -- start 2023-11-16T02:29:48.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f0813800640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f080c1542b0 0x7f080c1566a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7f0813800640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f080c06ae60 con 0x7f080c06e140 2023-11-16T02:29:48.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f0813800640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f080c0b91c0 con 0x7f080c06dd60 2023-11-16T02:29:48.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f0813800640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080c06b950 con 0x7f080c1542b0 2023-11-16T02:29:48.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7ffa2d3d2640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffa2806cec0 0x7ffa2806fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7ffa27fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffa2806cec0 0x7ffa2806fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f081159c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f080c06dd60 0x7f080c0b9fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.28:38056/0 (socket says 172.21.15.28:38056) 2023-11-16T02:29:48.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f081159c640 1 -- 172.21.15.28:0/1583421899 learned_addr learned my addr 172.21.15.28:0/1583421899 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:48.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f0811d9d640 1 --2- 172.21.15.28:0/1583421899 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f080c1542b0 0x7f080c1566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7ffa27fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffa2806cec0 0x7ffa2806fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41084/0 (socket says 172.21.15.28:41084) 2023-11-16T02:29:48.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7ffa27fff640 1 -- 172.21.15.28:0/2769696831 learned_addr learned my addr 172.21.15.28:0/2769696831 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:48.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7ffa2d3d2640 1 --2- 172.21.15.28:0/2769696831 >> v2:172.21.15.70:3300/0 conn(0x7ffa280b8d10 0x7ffa28149f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7ffa2d3d2640 1 -- 172.21.15.28:0/2769696831 --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa2814a450 con 0x7ffa2806f370 2023-11-16T02:29:48.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7ffa2d3d2640 1 -- 172.21.15.28:0/2769696831 --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa280703c0 con 0x7ffa2806cec0 2023-11-16T02:29:48.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f976ad46640 1 Processor -- start 2023-11-16T02:29:48.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7ffa2d3d2640 1 -- 172.21.15.28:0/2769696831 --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa280b8510 con 0x7ffa280b8d10 2023-11-16T02:29:48.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7ffa277fe640 1 --2- 172.21.15.28:0/2769696831 >> v2:172.21.15.70:3300/0 conn(0x7ffa280b8d10 0x7ffa28149f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7fbb1597a640 1 -- start start 2023-11-16T02:29:48.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7ffa27fff640 1 -- 172.21.15.28:0/2769696831 >> v2:172.21.15.70:3300/0 conn(0x7ffa280b8d10 msgr2=0x7ffa28149f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:48.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7ffa27fff640 1 --2- 172.21.15.28:0/2769696831 >> v2:172.21.15.70:3300/0 conn(0x7ffa280b8d10 0x7ffa28149f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7ffa27fff640 1 -- 172.21.15.28:0/2769696831 >> v1:172.21.15.28:6789/0 conn(0x7ffa2806f370 legacy=0x7ffa280b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7fbb1597a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbb08007140 0x7fbb0803e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7fbb1597a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbb08039910 0x7fbb080cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7fbb1597a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb0803e2e0 con 0x7fbb080d8b40 2023-11-16T02:29:48.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7fbb1597a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb0803afa0 con 0x7fbb08039910 2023-11-16T02:29:48.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7fbb1597a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb0803ecb0 con 0x7fbb08007140 2023-11-16T02:29:48.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7ffa27fff640 1 -- 172.21.15.28:0/2769696831 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa280b87f0 con 0x7ffa2806cec0 2023-11-16T02:29:48.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f0811d9d640 1 -- 172.21.15.28:0/1583421899 >> v1:172.21.15.70:6789/0 conn(0x7f080c06dd60 legacy=0x7f080c0b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f0811d9d640 1 -- 172.21.15.28:0/1583421899 >> v1:172.21.15.28:6789/0 conn(0x7f080c06e140 legacy=0x7f080c0b9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:48.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7fbb14978640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbb08007140 0x7fbb0803e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7fb8deb79640 1 Processor -- start 2023-11-16T02:29:48.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7fb8deb79640 1 -- start start 2023-11-16T02:29:48.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7fb8deb79640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb8d003a970 0x7fb8d00071f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7fb8deb79640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb8d003ad50 0x7fb8d00e8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7fb8deb79640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d0039ea0 con 0x7fb8d003b2f0 2023-11-16T02:29:48.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7fb8deb79640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8d003a140 con 0x7fb8d003ad50 2023-11-16T02:29:48.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.245+0000 7fb8deb79640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d003a420 con 0x7fb8d003a970 2023-11-16T02:29:48.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7fb8d7fff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb8d003b2f0 0x7fb8d0039790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.28:38062/0 (socket says 172.21.15.28:38062) 2023-11-16T02:29:48.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7fb8d7fff640 1 -- 172.21.15.28:0/4077442090 learned_addr learned my addr 172.21.15.28:0/4077442090 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:48.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7fbb14978640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fbb08007140 0x7fbb0803e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.28:43762/0 (socket says 172.21.15.28:43762) 2023-11-16T02:29:48.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7fb8dc915640 1 --2- 172.21.15.28:0/4077442090 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb8d003a970 0x7fb8d00071f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7fb8d77fe640 1 -- 172.21.15.28:0/4077442090 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2707584834 0 0) 0x7fb8d0039ea0 con 0x7fb8d003b2f0 2023-11-16T02:29:48.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7fb8dd116640 1 --2- 172.21.15.28:0/4077442090 >> v2:172.21.15.28:3300/0 conn(0x7fb8d003ad50 0x7fb8d00e8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7fbb14978640 1 -- 172.21.15.28:0/1151889190 learned_addr learned my addr 172.21.15.28:0/1151889190 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:48.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f524d57c640 1 Processor -- start 2023-11-16T02:29:48.265 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7fb8d77fe640 1 -- 172.21.15.28:0/4077442090 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8c8003510 con 0x7fb8d003b2f0 2023-11-16T02:29:48.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f976ad46640 1 -- start start 2023-11-16T02:29:48.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f976ad46640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f975c0070d0 0x7f975c0cd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f976ad46640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f975c0d1310 0x7f975c0389c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f976ad46640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975c03bbd0 con 0x7f975c03c4a0 2023-11-16T02:29:48.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f976ad46640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975c03b970 con 0x7f975c0d1310 2023-11-16T02:29:48.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f976ad46640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975c0cd740 con 0x7f975c0070d0 2023-11-16T02:29:48.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f9763fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f975c03c4a0 0x7f975c03b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:39800/0 (socket says 172.21.15.28:39800) 2023-11-16T02:29:48.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f9763fff640 1 -- 172.21.15.28:0/3228727946 learned_addr learned my addr 172.21.15.28:0/3228727946 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:48.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7fb8dd116640 1 -- 172.21.15.28:0/4077442090 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb8d003a970 msgr2=0x7fb8d00071f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:48.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7fb8dd116640 1 --2- 172.21.15.28:0/4077442090 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb8d003a970 0x7fb8d00071f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7fb8dd116640 1 -- 172.21.15.28:0/4077442090 >> v1:172.21.15.70:6789/0 conn(0x7fb8d003b2f0 legacy=0x7fb8d0039790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7fb8dd116640 1 -- 172.21.15.28:0/4077442090 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d00069f0 con 0x7fb8d003ad50 2023-11-16T02:29:48.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f9768ae2640 1 --2- 172.21.15.28:0/3228727946 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f975c0070d0 0x7f975c0cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7fbb0ffff640 1 --2- 172.21.15.28:0/1151889190 >> v2:172.21.15.28:3300/0 conn(0x7fbb08039910 0x7fbb080cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f9768ae2640 1 -- 172.21.15.28:0/3228727946 >> v2:172.21.15.28:3300/0 conn(0x7f975c0d1310 msgr2=0x7f975c0389c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:48.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f9768ae2640 1 --2- 172.21.15.28:0/3228727946 >> v2:172.21.15.28:3300/0 conn(0x7f975c0d1310 0x7f975c0389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f9768ae2640 1 -- 172.21.15.28:0/3228727946 >> v1:172.21.15.28:6789/0 conn(0x7f975c03c4a0 legacy=0x7f975c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f9768ae2640 1 -- 172.21.15.28:0/3228727946 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c0d0830 con 0x7f975c0070d0 2023-11-16T02:29:48.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7fbb14978640 1 -- 172.21.15.28:0/1151889190 >> v2:172.21.15.28:3300/0 conn(0x7fbb08039910 msgr2=0x7fbb080cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:48.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7fbb14978640 1 --2- 172.21.15.28:0/1151889190 >> v2:172.21.15.28:3300/0 conn(0x7fbb08039910 0x7fbb080cf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7fbb14978640 1 -- 172.21.15.28:0/1151889190 >> v1:172.21.15.28:6789/0 conn(0x7fbb080d8b40 legacy=0x7fbb0803ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:48.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7fbb14978640 1 -- 172.21.15.28:0/1151889190 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0803a9e0 con 0x7fbb08007140 2023-11-16T02:29:48.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f524d57c640 1 -- start start 2023-11-16T02:29:48.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f524d57c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5248140ed0 0x7f52480b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f524d57c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52480b67e0 0x7f524814a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f524d57c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5248071880 con 0x7f5248146ac0 2023-11-16T02:29:48.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f524d57c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52480b5e20 con 0x7f5248140ed0 2023-11-16T02:29:48.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f524d57c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52480b6d00 con 0x7f52480b67e0 2023-11-16T02:29:48.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f524cd7b640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f5248146ac0 0x7f5248146f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.28:38072/0 (socket says 172.21.15.28:38072) 2023-11-16T02:29:48.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f524cd7b640 1 -- 172.21.15.28:0/2872838441 learned_addr learned my addr 172.21.15.28:0/2872838441 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:48.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f52477fe640 1 --2- 172.21.15.28:0/2872838441 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52480b67e0 0x7f524814a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7ff67a0a5640 1 Processor -- start 2023-11-16T02:29:48.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7ff67a0a5640 1 -- start start 2023-11-16T02:29:48.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7ff67a0a5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff6740bbeb0 0x7ff6740b6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7ff67a0a5640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff6740b6f80 0x7ff67414f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7ff67a0a5640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff6740bc780 0x7ff67414f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7ff67a0a5640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6740b9c60 con 0x7ff6740bbeb0 2023-11-16T02:29:48.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7ff67a0a5640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6740ba500 con 0x7ff6740bc780 2023-11-16T02:29:48.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7ff67a0a5640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6740b9eb0 con 0x7ff6740b6f80 2023-11-16T02:29:48.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7ff673fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff6740bc780 0x7ff67414f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7ff673fff640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff6740bc780 0x7ff67414f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.28:43768/0 (socket says 172.21.15.28:43768) 2023-11-16T02:29:48.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7ff673fff640 1 -- 172.21.15.28:0/3414568560 learned_addr learned my addr 172.21.15.28:0/3414568560 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:48.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f5247fff640 1 --2- 172.21.15.28:0/2872838441 >> v2:172.21.15.28:3300/0 conn(0x7f5248140ed0 0x7f52480b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7fbb0ffff640 1 --2- 172.21.15.28:0/1151889190 >> v2:172.21.15.28:3300/0 conn(0x7fbb08039910 0x7fbb080cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:48.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f5246ffd640 1 -- 172.21.15.28:0/2872838441 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497552514 0 0) 0x7f5248071880 con 0x7f5248146ac0 2023-11-16T02:29:48.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7ff673fff640 1 -- 172.21.15.28:0/3414568560 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff6740b6f80 msgr2=0x7ff67414f150 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-16T02:29:48.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7ff673fff640 1 --2- 172.21.15.28:0/3414568560 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff6740b6f80 0x7ff67414f150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7ff673fff640 1 -- 172.21.15.28:0/3414568560 >> v2:172.21.15.28:3300/0 conn(0x7ff6740bbeb0 msgr2=0x7ff6740b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:48.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7ff673fff640 1 --2- 172.21.15.28:0/3414568560 >> v2:172.21.15.28:3300/0 conn(0x7ff6740bbeb0 0x7ff6740b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7ff673fff640 1 -- 172.21.15.28:0/3414568560 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6740ba190 con 0x7ff6740bc780 2023-11-16T02:29:48.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.249+0000 7f0811d9d640 1 -- 172.21.15.28:0/1583421899 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080c0ba6b0 con 0x7f080c1542b0 2023-11-16T02:29:48.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7ffa27fff640 1 --2- 172.21.15.28:0/2769696831 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa2806cec0 0x7ffa2806fcd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000f370 tx=0x7ffa200235b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=886fd04427e75726 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f0811d9d640 1 --2- 172.21.15.28:0/1583421899 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f080c1542b0 0x7f080c1566a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0804009dc0 tx=0x7f080401f140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=744b9001c88a661d server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7ffa26ffd640 1 -- 172.21.15.28:0/2769696831 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2000d2d0 con 0x7ffa2806cec0 2023-11-16T02:29:48.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7ffa26ffd640 1 -- 172.21.15.28:0/2769696831 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2000d430 con 0x7ffa2806cec0 2023-11-16T02:29:48.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7ffa26ffd640 1 -- 172.21.15.28:0/2769696831 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2000b800 con 0x7ffa2806cec0 2023-11-16T02:29:48.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f0803fff640 1 -- 172.21.15.28:0/1583421899 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08040af600 con 0x7f080c1542b0 2023-11-16T02:29:48.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f0803fff640 1 -- 172.21.15.28:0/1583421899 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08040ab050 con 0x7f080c1542b0 2023-11-16T02:29:48.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f0803fff640 1 -- 172.21.15.28:0/1583421899 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08040af980 con 0x7f080c1542b0 2023-11-16T02:29:48.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7fb8dd116640 1 --2- 172.21.15.28:0/4077442090 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8d003ad50 0x7fb8d00e8b30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb8c400bd90 tx=0x7fb8c401e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31925e243aaf1f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f5246ffd640 1 -- 172.21.15.28:0/2872838441 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5230003530 con 0x7f5248146ac0 2023-11-16T02:29:48.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f5247fff640 1 -- 172.21.15.28:0/2872838441 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52480b67e0 msgr2=0x7f524814a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:48.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f5247fff640 1 --2- 172.21.15.28:0/2872838441 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52480b67e0 0x7f524814a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f5247fff640 1 -- 172.21.15.28:0/2872838441 >> v1:172.21.15.70:6789/0 conn(0x7f5248146ac0 legacy=0x7f5248146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7ffa2d3d2640 1 -- 172.21.15.28:0/2769696831 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa2806cec0 msgr2=0x7ffa2806fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7ffa2d3d2640 1 --2- 172.21.15.28:0/2769696831 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa2806cec0 0x7ffa2806fcd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000f370 tx=0x7ffa200235b0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f5247fff640 1 -- 172.21.15.28:0/2872838441 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52480b6fe0 con 0x7f5248140ed0 2023-11-16T02:29:48.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7ffa2d3d2640 1 -- 172.21.15.28:0/2769696831 shutdown_connections 2023-11-16T02:29:48.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7ffa2d3d2640 1 --2- 172.21.15.28:0/2769696831 >> v2:172.21.15.70:3300/0 conn(0x7ffa280b8d10 0x7ffa28149f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7ffa2d3d2640 1 --2- 172.21.15.28:0/2769696831 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa2806cec0 0x7ffa2806fcd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7ffa2d3d2640 1 -- 172.21.15.28:0/2769696831 >> 172.21.15.28:0/2769696831 conn(0x7ffa2806b850 msgr2=0x7ffa2806bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:48.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f9768ae2640 1 --2- 172.21.15.28:0/3228727946 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f975c0070d0 0x7f975c0cd200 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9764074ca0 tx=0x7f97640977b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c38c7f936bed939 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7ffa2d3d2640 1 -- 172.21.15.28:0/2769696831 shutdown_connections 2023-11-16T02:29:48.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f45f7fff640 1 --2- 172.21.15.28:0/1379881635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45e80047d0 0x7f45e8004c50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f45e400d2a0 tx=0x7f45e401d200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf9362cbcc2bc4ab server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f0813800640 1 -- 172.21.15.28:0/1583421899 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f080c1542b0 msgr2=0x7f080c1566a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f0813800640 1 --2- 172.21.15.28:0/1583421899 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f080c1542b0 0x7f080c1566a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0804009dc0 tx=0x7f080401f140 comp rx=0 tx=0).stop 2023-11-16T02:29:48.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f97637fe640 1 -- 172.21.15.28:0/3228727946 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97641236b0 con 0x7f975c0070d0 2023-11-16T02:29:48.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f0813800640 1 -- 172.21.15.28:0/1583421899 shutdown_connections 2023-11-16T02:29:48.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f0813800640 1 --2- 172.21.15.28:0/1583421899 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f080c1542b0 0x7f080c1566a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f0813800640 1 -- 172.21.15.28:0/1583421899 >> 172.21.15.28:0/1583421899 conn(0x7f080c0bdff0 msgr2=0x7f080c0be400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:48.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f45f77fe640 1 -- 172.21.15.28:0/1379881635 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e40ac620 con 0x7f45e80047d0 2023-11-16T02:29:48.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f45f77fe640 1 -- 172.21.15.28:0/1379881635 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e40a8070 con 0x7f45e80047d0 2023-11-16T02:29:48.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f45f77fe640 1 -- 172.21.15.28:0/1379881635 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e40aca20 con 0x7f45e80047d0 2023-11-16T02:29:48.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7fb8d77fe640 1 -- 172.21.15.28:0/4077442090 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c40a7980 con 0x7fb8d003ad50 2023-11-16T02:29:48.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7fb8d77fe640 1 -- 172.21.15.28:0/4077442090 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c40a7ae0 con 0x7fb8d003ad50 2023-11-16T02:29:48.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7fb8d77fe640 1 -- 172.21.15.28:0/4077442090 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c40a7e70 con 0x7fb8d003ad50 2023-11-16T02:29:48.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7fb8deb79640 1 -- 172.21.15.28:0/4077442090 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8d003ad50 msgr2=0x7fb8d00e8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7fb8deb79640 1 --2- 172.21.15.28:0/4077442090 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8d003ad50 0x7fb8d00e8b30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb8c400bd90 tx=0x7fb8c401e890 comp rx=0 tx=0).stop 2023-11-16T02:29:48.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f0813800640 1 -- 172.21.15.28:0/1583421899 shutdown_connections 2023-11-16T02:29:48.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f0813800640 1 -- 172.21.15.28:0/1583421899 wait complete. 2023-11-16T02:29:48.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7fb8deb79640 1 -- 172.21.15.28:0/4077442090 shutdown_connections 2023-11-16T02:29:48.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7fb8deb79640 1 --2- 172.21.15.28:0/4077442090 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8d003ad50 0x7fb8d00e8b30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7fb8deb79640 1 --2- 172.21.15.28:0/4077442090 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb8d003a970 0x7fb8d00071f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7fb8deb79640 1 -- 172.21.15.28:0/4077442090 >> 172.21.15.28:0/4077442090 conn(0x7fb8d0005dc0 msgr2=0x7fb8d00061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:48.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7fb8deb79640 1 -- 172.21.15.28:0/4077442090 shutdown_connections 2023-11-16T02:29:48.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f97637fe640 1 -- 172.21.15.28:0/3228727946 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9764123810 con 0x7f975c0070d0 2023-11-16T02:29:48.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f97637fe640 1 -- 172.21.15.28:0/3228727946 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764123c80 con 0x7f975c0070d0 2023-11-16T02:29:48.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f976ad46640 1 -- 172.21.15.28:0/3228727946 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f975c0070d0 msgr2=0x7f975c0cd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f976ad46640 1 --2- 172.21.15.28:0/3228727946 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f975c0070d0 0x7f975c0cd200 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9764074ca0 tx=0x7f97640977b0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f45fd8ca640 1 -- 172.21.15.28:0/1379881635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45e80047d0 msgr2=0x7f45e8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f45fd8ca640 1 --2- 172.21.15.28:0/1379881635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45e80047d0 0x7f45e8004c50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f45e400d2a0 tx=0x7f45e401d200 comp rx=0 tx=0).stop 2023-11-16T02:29:48.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f45fd8ca640 1 -- 172.21.15.28:0/1379881635 shutdown_connections 2023-11-16T02:29:48.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f45fd8ca640 1 --2- 172.21.15.28:0/1379881635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45e80047d0 0x7f45e8004c50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f45fd8ca640 1 -- 172.21.15.28:0/1379881635 >> 172.21.15.28:0/1379881635 conn(0x7f45f0005e60 msgr2=0x7f45f0006270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:48.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f45fd8ca640 1 -- 172.21.15.28:0/1379881635 shutdown_connections 2023-11-16T02:29:48.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7fb8deb79640 1 -- 172.21.15.28:0/4077442090 wait complete. 2023-11-16T02:29:48.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f976ad46640 1 -- 172.21.15.28:0/3228727946 shutdown_connections 2023-11-16T02:29:48.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f976ad46640 1 --2- 172.21.15.28:0/3228727946 >> v2:172.21.15.28:3300/0 conn(0x7f975c0d1310 0x7f975c0389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f976ad46640 1 --2- 172.21.15.28:0/3228727946 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f975c0070d0 0x7f975c0cd200 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f976ad46640 1 -- 172.21.15.28:0/3228727946 >> 172.21.15.28:0/3228727946 conn(0x7f975c005f00 msgr2=0x7f975c006310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:48.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f976ad46640 1 -- 172.21.15.28:0/3228727946 shutdown_connections 2023-11-16T02:29:48.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7fbb14978640 1 --2- 172.21.15.28:0/1151889190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb08007140 0x7fbb0803e770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbb08007800 tx=0x7fbb0401c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=324f24930a988265 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7fbb0f7fe640 1 -- 172.21.15.28:0/1151889190 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb040aa610 con 0x7fbb08007140 2023-11-16T02:29:48.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7fbb0f7fe640 1 -- 172.21.15.28:0/1151889190 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb040a6040 con 0x7fbb08007140 2023-11-16T02:29:48.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7fbb0f7fe640 1 -- 172.21.15.28:0/1151889190 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb040aa990 con 0x7fbb08007140 2023-11-16T02:29:48.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7ff673fff640 1 --2- 172.21.15.28:0/3414568560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6740bc780 0x7ff67414f690 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff67414c9e0 tx=0x7ff66801c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79e84f1a1da33274 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7ff6727fc640 1 -- 172.21.15.28:0/3414568560 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6680aa660 con 0x7ff6740bc780 2023-11-16T02:29:48.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7ff6727fc640 1 -- 172.21.15.28:0/3414568560 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6680aa7c0 con 0x7ff6740bc780 2023-11-16T02:29:48.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7ff6727fc640 1 -- 172.21.15.28:0/3414568560 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6680aab50 con 0x7ff6740bc780 2023-11-16T02:29:48.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7ffa2d3d2640 1 -- 172.21.15.28:0/2769696831 wait complete. 2023-11-16T02:29:48.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7ffa2d3d2640 1 Processor -- start 2023-11-16T02:29:48.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.253+0000 7f45fd8ca640 1 -- 172.21.15.28:0/1379881635 wait complete. 2023-11-16T02:29:48.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fb8deb79640 1 Processor -- start 2023-11-16T02:29:48.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f0813800640 1 Processor -- start 2023-11-16T02:29:48.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f45fd8ca640 1 Processor -- start 2023-11-16T02:29:48.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f0813800640 1 -- start start 2023-11-16T02:29:48.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fb8deb79640 1 -- start start 2023-11-16T02:29:48.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f976ad46640 1 -- 172.21.15.28:0/3228727946 wait complete. 2023-11-16T02:29:48.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fbb1597a640 1 -- 172.21.15.28:0/1151889190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb08007140 msgr2=0x7fbb0803e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fbb1597a640 1 --2- 172.21.15.28:0/1151889190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb08007140 0x7fbb0803e770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbb08007800 tx=0x7fbb0401c4b0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fbb1597a640 1 -- 172.21.15.28:0/1151889190 shutdown_connections 2023-11-16T02:29:48.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fbb1597a640 1 --2- 172.21.15.28:0/1151889190 >> v2:172.21.15.28:3300/0 conn(0x7fbb08039910 0x7fbb080cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fbb1597a640 1 --2- 172.21.15.28:0/1151889190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb08007140 0x7fbb0803e770 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fbb1597a640 1 -- 172.21.15.28:0/1151889190 >> 172.21.15.28:0/1151889190 conn(0x7fbb0803ef20 msgr2=0x7fbb0803f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:48.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ff67a0a5640 1 -- 172.21.15.28:0/3414568560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6740bc780 msgr2=0x7ff67414f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ff67a0a5640 1 --2- 172.21.15.28:0/3414568560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6740bc780 0x7ff67414f690 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff67414c9e0 tx=0x7ff66801c520 comp rx=0 tx=0).stop 2023-11-16T02:29:48.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ff67a0a5640 1 -- 172.21.15.28:0/3414568560 shutdown_connections 2023-11-16T02:29:48.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ff67a0a5640 1 --2- 172.21.15.28:0/3414568560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6740bc780 0x7ff67414f690 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ffa2d3d2640 1 -- start start 2023-11-16T02:29:48.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ff67a0a5640 1 --2- 172.21.15.28:0/3414568560 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff6740b6f80 0x7ff67414f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ff67a0a5640 1 --2- 172.21.15.28:0/3414568560 >> v2:172.21.15.28:3300/0 conn(0x7ff6740bbeb0 0x7ff6740b6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ff67a0a5640 1 -- 172.21.15.28:0/3414568560 >> 172.21.15.28:0/3414568560 conn(0x7ff6740bcd40 msgr2=0x7ff6740bd150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:48.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ffa2d3d2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa2806cec0 0x7ffa281e3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ffa2d3d2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa2806f370 0x7ffa281efeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ffa2d3d2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa280b8d10 0x7ffa281dd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ffa2d3d2640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa281e4200 con 0x7ffa2806f370 2023-11-16T02:29:48.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ffa2d3d2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa280b4e70 con 0x7ffa2806cec0 2023-11-16T02:29:48.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ffa2d3d2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa280b5300 con 0x7ffa280b8d10 2023-11-16T02:29:48.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fbb1597a640 1 -- 172.21.15.28:0/1151889190 shutdown_connections 2023-11-16T02:29:48.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ffa2cbd1640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa280b8d10 0x7ffa281dd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ffa2cbd1640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa280b8d10 0x7ffa281dd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.28:47270/0 (socket says 172.21.15.28:47270) 2023-11-16T02:29:48.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ffa2cbd1640 1 -- 172.21.15.28:0/278316399 learned_addr learned my addr 172.21.15.28:0/278316399 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:48.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ffa277fe640 1 --2- 172.21.15.28:0/278316399 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa2806f370 0x7ffa281efeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fb8deb79640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8d003a970 0x7fb8d00e5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fb8deb79640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8d003ad50 0x7fb8d00f1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fb8deb79640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb8d003d5c0 0x7fb8d0027db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fb8deb79640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d003e820 con 0x7fb8d003ad50 2023-11-16T02:29:48.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fb8deb79640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d00e6190 con 0x7fb8d003a970 2023-11-16T02:29:48.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fb8deb79640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d003db70 con 0x7fb8d003d5c0 2023-11-16T02:29:48.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ffa27fff640 1 --2- 172.21.15.28:0/278316399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa2806cec0 0x7ffa281e3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fbb1597a640 1 -- 172.21.15.28:0/1151889190 wait complete. 2023-11-16T02:29:48.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f976ad46640 1 Processor -- start 2023-11-16T02:29:48.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fb8d7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8d003ad50 0x7fb8d00f1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fb8d7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8d003ad50 0x7fb8d00f1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41160/0 (socket says 172.21.15.28:41160) 2023-11-16T02:29:48.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fb8d7fff640 1 -- 172.21.15.28:0/3891154128 learned_addr learned my addr 172.21.15.28:0/3891154128 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:48.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ffa2cbd1640 1 -- 172.21.15.28:0/278316399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa2806cec0 msgr2=0x7ffa281e3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ffa2cbd1640 1 --2- 172.21.15.28:0/278316399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa2806cec0 0x7ffa281e3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ffa2cbd1640 1 -- 172.21.15.28:0/278316399 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa2806f370 msgr2=0x7ffa281efeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ffa2cbd1640 1 --2- 172.21.15.28:0/278316399 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa2806f370 0x7ffa281efeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ffa2cbd1640 1 -- 172.21.15.28:0/278316399 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2000f050 con 0x7ffa280b8d10 2023-11-16T02:29:48.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ffa2cbd1640 1 --2- 172.21.15.28:0/278316399 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa280b8d10 0x7ffa281dd290 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ffa1800c3c0 tx=0x7ffa1800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ffa24ff9640 1 -- 172.21.15.28:0/278316399 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa180052d0 con 0x7ffa280b8d10 2023-11-16T02:29:48.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ffa24ff9640 1 -- 172.21.15.28:0/278316399 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa18005430 con 0x7ffa280b8d10 2023-11-16T02:29:48.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f45fd8ca640 1 -- start start 2023-11-16T02:29:48.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f45fd8ca640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f45e80047d0 0x7f45f00d0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f45fd8ca640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45f00c1c40 0x7f45f00c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f45fd8ca640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f45f0032c60 0x7f45f00330e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f45fd8ca640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f00c3fb0 con 0x7f45f0032c60 2023-11-16T02:29:48.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f45fd8ca640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f00d0d70 con 0x7f45f00c1c40 2023-11-16T02:29:48.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f45fd8ca640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f00c61c0 con 0x7f45e80047d0 2023-11-16T02:29:48.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f45f7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45f00c1c40 0x7f45f00c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f45f7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45f00c1c40 0x7f45f00c20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.28:43816/0 (socket says 172.21.15.28:43816) 2023-11-16T02:29:48.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f45f7fff640 1 -- 172.21.15.28:0/1871644338 learned_addr learned my addr 172.21.15.28:0/1871644338 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:48.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fb8dc915640 1 --2- 172.21.15.28:0/3891154128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8d003a970 0x7fb8d00e5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fb8dd116640 1 --2- 172.21.15.28:0/3891154128 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb8d003d5c0 0x7fb8d0027db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fb8d7fff640 1 -- 172.21.15.28:0/3891154128 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb8d003d5c0 msgr2=0x7fb8d0027db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fb8d7fff640 1 --2- 172.21.15.28:0/3891154128 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb8d003d5c0 0x7fb8d0027db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fb8d7fff640 1 -- 172.21.15.28:0/3891154128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8d003a970 msgr2=0x7fb8d00e5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fb8d7fff640 1 --2- 172.21.15.28:0/3891154128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8d003a970 0x7fb8d00e5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fb8d7fff640 1 -- 172.21.15.28:0/3891154128 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c400ba70 con 0x7fb8d003ad50 2023-11-16T02:29:48.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fb8d7fff640 1 --2- 172.21.15.28:0/3891154128 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8d003ad50 0x7fb8d00f1780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb8d804f990 tx=0x7fb8d80735a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fb8d57fa640 1 -- 172.21.15.28:0/3891154128 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8067270 con 0x7fb8d003ad50 2023-11-16T02:29:48.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fb8d57fa640 1 -- 172.21.15.28:0/3891154128 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d804e5c0 con 0x7fb8d003ad50 2023-11-16T02:29:48.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fb8d57fa640 1 -- 172.21.15.28:0/3891154128 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8072400 con 0x7fb8d003ad50 2023-11-16T02:29:48.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f976ad46640 1 -- start start 2023-11-16T02:29:48.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f976ad46640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f975c0070d0 0x7f975c0cfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f976ad46640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f975c03c4a0 0x7f975c028cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f976ad46640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f975c0d1310 0x7f975c170560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f976ad46640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c02da60 con 0x7f975c0d1310 2023-11-16T02:29:48.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f976ad46640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c02d6f0 con 0x7f975c0070d0 2023-11-16T02:29:48.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f976ad46640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975c02a8a0 con 0x7f975c03c4a0 2023-11-16T02:29:48.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f9763fff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f975c03c4a0 0x7f975c028cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f9768ae2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f975c0070d0 0x7f975c0cfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f9768ae2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f975c0070d0 0x7f975c0cfdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.28:43806/0 (socket says 172.21.15.28:43806) 2023-11-16T02:29:48.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f9768ae2640 1 -- 172.21.15.28:0/1616369364 learned_addr learned my addr 172.21.15.28:0/1616369364 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:48.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fbb1597a640 1 Processor -- start 2023-11-16T02:29:48.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7fbb1597a640 1 -- start start 2023-11-16T02:29:48.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f0813800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f080c06dd60 0x7f080c14a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f0813800640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f080c06e140 0x7f080c14afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f0813800640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f080c1542b0 0x7f080c148820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f0813800640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c143c60 con 0x7f080c1542b0 2023-11-16T02:29:48.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f0813800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c1441c0 con 0x7f080c06dd60 2023-11-16T02:29:48.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f0813800640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080c14a5d0 con 0x7f080c06e140 2023-11-16T02:29:48.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f0811d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f080c1542b0 0x7f080c148820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f0811d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f080c1542b0 0x7f080c148820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41170/0 (socket says 172.21.15.28:41170) 2023-11-16T02:29:48.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f0811d9d640 1 -- 172.21.15.28:0/3930939893 learned_addr learned my addr 172.21.15.28:0/3930939893 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:48.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f081159c640 1 --2- 172.21.15.28:0/3930939893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f080c06dd60 0x7f080c14a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f0811d9d640 1 -- 172.21.15.28:0/3930939893 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f080c06e140 msgr2=0x7f080c14afd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-16T02:29:48.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f0811d9d640 1 --2- 172.21.15.28:0/3930939893 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f080c06e140 0x7f080c14afd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f0811d9d640 1 -- 172.21.15.28:0/3930939893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f080c06dd60 msgr2=0x7f080c14a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f0811d9d640 1 --2- 172.21.15.28:0/3930939893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f080c06dd60 0x7f080c14a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f0811d9d640 1 -- 172.21.15.28:0/3930939893 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0804009a70 con 0x7f080c1542b0 2023-11-16T02:29:48.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f0811d9d640 1 --2- 172.21.15.28:0/3930939893 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f080c1542b0 0x7f080c148820 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f080401d7f0 tx=0x7f080401bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ff67a0a5640 1 -- 172.21.15.28:0/3414568560 shutdown_connections 2023-11-16T02:29:48.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ff67a0a5640 1 -- 172.21.15.28:0/3414568560 wait complete. 2023-11-16T02:29:48.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f5247fff640 1 --2- 172.21.15.28:0/2872838441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5248140ed0 0x7f52480b7ac0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f523c00ba60 tx=0x7f523c021340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa79d628bfea0bf server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f5246ffd640 1 -- 172.21.15.28:0/2872838441 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c0b1600 con 0x7f5248140ed0 2023-11-16T02:29:48.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f5246ffd640 1 -- 172.21.15.28:0/2872838441 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523c0ad050 con 0x7f5248140ed0 2023-11-16T02:29:48.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f5246ffd640 1 -- 172.21.15.28:0/2872838441 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c0b1600 con 0x7f5248140ed0 2023-11-16T02:29:48.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f524d57c640 1 -- 172.21.15.28:0/2872838441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5248140ed0 msgr2=0x7f52480b7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7f524d57c640 1 --2- 172.21.15.28:0/2872838441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5248140ed0 0x7f52480b7ac0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f523c00ba60 tx=0x7f523c021340 comp rx=0 tx=0).stop 2023-11-16T02:29:48.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f524d57c640 1 -- 172.21.15.28:0/2872838441 shutdown_connections 2023-11-16T02:29:48.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f524d57c640 1 --2- 172.21.15.28:0/2872838441 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f52480b67e0 0x7f524814a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f524d57c640 1 --2- 172.21.15.28:0/2872838441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5248140ed0 0x7f52480b7ac0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f524d57c640 1 -- 172.21.15.28:0/2872838441 >> 172.21.15.28:0/2872838441 conn(0x7f52480b88e0 msgr2=0x7f52480b8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:48.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f524d57c640 1 -- 172.21.15.28:0/2872838441 shutdown_connections 2023-11-16T02:29:48.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ffa2d3d2640 1 -- 172.21.15.28:0/278316399 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa280b3c00 con 0x7ffa280b8d10 2023-11-16T02:29:48.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ffa24ff9640 1 -- 172.21.15.28:0/278316399 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa18007240 con 0x7ffa280b8d10 2023-11-16T02:29:48.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.257+0000 7ffa2d3d2640 1 -- 172.21.15.28:0/278316399 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa280b4b00 con 0x7ffa280b8d10 2023-11-16T02:29:48.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7fb8deb79640 1 -- 172.21.15.28:0/3891154128 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d003ddc0 con 0x7fb8d003ad50 2023-11-16T02:29:48.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7fb8deb79640 1 -- 172.21.15.28:0/3891154128 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d00e1440 con 0x7fb8d003ad50 2023-11-16T02:29:48.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f9763fff640 1 -- 172.21.15.28:0/1616369364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f975c0070d0 msgr2=0x7f975c0cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f9763fff640 1 --2- 172.21.15.28:0/1616369364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f975c0070d0 0x7f975c0cfdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f9763fff640 1 -- 172.21.15.28:0/1616369364 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f975c0d1310 msgr2=0x7f975c170560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f9763fff640 1 --2- 172.21.15.28:0/1616369364 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f975c0d1310 0x7f975c170560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f9763fff640 1 -- 172.21.15.28:0/1616369364 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9764072fb0 con 0x7f975c03c4a0 2023-11-16T02:29:48.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7ff67a0a5640 1 Processor -- start 2023-11-16T02:29:48.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f524d57c640 1 -- 172.21.15.28:0/2872838441 wait complete. 2023-11-16T02:29:48.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f45f7fff640 1 -- 172.21.15.28:0/1871644338 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f45e80047d0 msgr2=0x7f45f00d0830 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-16T02:29:48.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f45f7fff640 1 --2- 172.21.15.28:0/1871644338 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f45e80047d0 0x7f45f00d0830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f45fd0c9640 1 --2- 172.21.15.28:0/1871644338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f45f0032c60 0x7f45f00330e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f45f7fff640 1 -- 172.21.15.28:0/1871644338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f45f0032c60 msgr2=0x7f45f00330e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f9763fff640 1 --2- 172.21.15.28:0/1616369364 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f975c03c4a0 0x7f975c028cb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f975800b510 tx=0x7f975800b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f45f7fff640 1 --2- 172.21.15.28:0/1871644338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f45f0032c60 0x7f45f00330e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f45f7fff640 1 -- 172.21.15.28:0/1871644338 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f00c5440 con 0x7f45f00c1c40 2023-11-16T02:29:48.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f45fd0c9640 1 --2- 172.21.15.28:0/1871644338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f45f0032c60 0x7f45f00330e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:48.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f0801ffb640 1 -- 172.21.15.28:0/3930939893 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08040afe30 con 0x7f080c1542b0 2023-11-16T02:29:48.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f97617fa640 1 -- 172.21.15.28:0/1616369364 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975800f650 con 0x7f975c03c4a0 2023-11-16T02:29:48.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f97617fa640 1 -- 172.21.15.28:0/1616369364 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975800f7b0 con 0x7f975c03c4a0 2023-11-16T02:29:48.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7fbb1597a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb08007140 0x7fbb0801f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7ffa2d3d2640 1 -- 172.21.15.28:0/278316399 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa280b5020 con 0x7ffa280b8d10 2023-11-16T02:29:48.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7fbb14978640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb08007140 0x7fbb0801f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7fbb14978640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb08007140 0x7fbb0801f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41204/0 (socket says 172.21.15.28:41204) 2023-11-16T02:29:48.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7fbb1597a640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbb08039910 0x7fbb08038540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7fbb14978640 1 -- 172.21.15.28:0/2119292832 learned_addr learned my addr 172.21.15.28:0/2119292832 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:48.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7fbb1597a640 1 --2- 172.21.15.28:0/2119292832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb080d8b40 0x7fbb081713b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f524d57c640 1 Processor -- start 2023-11-16T02:29:48.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7fbb0ffff640 1 --2- 172.21.15.28:0/2119292832 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbb08039910 0x7fbb08038540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f524d57c640 1 -- start start 2023-11-16T02:29:48.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7fbb15179640 1 --2- 172.21.15.28:0/2119292832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb080d8b40 0x7fbb081713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7fb8d57fa640 1 -- 172.21.15.28:0/3891154128 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb8d80813c0 con 0x7fb8d003ad50 2023-11-16T02:29:48.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7ffa24ff9640 1 -- 172.21.15.28:0/278316399 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffa180073a0 con 0x7ffa280b8d10 2023-11-16T02:29:48.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7ff67a0a5640 1 -- start start 2023-11-16T02:29:48.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7ff67a0a5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6740bbeb0 0x7ff674149e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7ff67a0a5640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff6740bc780 0x7ff6740bf990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7ff67a0a5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff67414b900 0x7ff6740a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7ff67a0a5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6740bfed0 con 0x7ff67414b900 2023-11-16T02:29:48.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7ff67a0a5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6740b38c0 con 0x7ff6740bbeb0 2023-11-16T02:29:48.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7ff67a0a5640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6741ea440 con 0x7ff6740bc780 2023-11-16T02:29:48.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f97617fa640 1 -- 172.21.15.28:0/1616369364 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975800fb20 con 0x7f975c03c4a0 2023-11-16T02:29:48.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f0813800640 1 -- 172.21.15.28:0/3930939893 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f080c142940 con 0x7f080c1542b0 2023-11-16T02:29:48.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f0813800640 1 -- 172.21.15.28:0/3930939893 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080c14a850 con 0x7f080c1542b0 2023-11-16T02:29:48.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7fbb1597a640 1 -- 172.21.15.28:0/2119292832 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb08038a80 con 0x7fbb08007140 2023-11-16T02:29:48.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7ff672ffd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff6740bc780 0x7ff6740bf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7ff672ffd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff6740bc780 0x7ff6740bf990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.28:47334/0 (socket says 172.21.15.28:47334) 2023-11-16T02:29:48.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7ff672ffd640 1 -- 172.21.15.28:0/1292250044 learned_addr learned my addr 172.21.15.28:0/1292250044 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:48.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7fbb1597a640 1 -- 172.21.15.28:0/2119292832 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb08170f20 con 0x7fbb080d8b40 2023-11-16T02:29:48.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7ffa24ff9640 1 --2- 172.21.15.28:0/278316399 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ffa08065a60 0x7ffa08067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7ffa24ff9640 1 -- 172.21.15.28:0/278316399 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa18082530 con 0x7ffa280b8d10 2023-11-16T02:29:48.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7ffa27fff640 1 --2- 172.21.15.28:0/278316399 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ffa08065a60 0x7ffa08067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7ffa27fff640 1 --2- 172.21.15.28:0/278316399 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ffa08065a60 0x7ffa08067f20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffa200b6000 tx=0x7ffa200af000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f45f7fff640 1 --2- 172.21.15.28:0/1871644338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45f00c1c40 0x7f45f00c20a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f45e401cc70 tx=0x7f45e8005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f45f57fa640 1 -- 172.21.15.28:0/1871644338 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e40ac620 con 0x7f45f00c1c40 2023-11-16T02:29:48.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f45f57fa640 1 -- 172.21.15.28:0/1871644338 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e40ac780 con 0x7f45f00c1c40 2023-11-16T02:29:48.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f45f57fa640 1 -- 172.21.15.28:0/1871644338 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e40acb30 con 0x7f45f00c1c40 2023-11-16T02:29:48.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f45fd8ca640 1 -- 172.21.15.28:0/1871644338 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f0033620 con 0x7f45f00c1c40 2023-11-16T02:29:48.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f45fd8ca640 1 -- 172.21.15.28:0/1871644338 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f00c59c0 con 0x7f45f00c1c40 2023-11-16T02:29:48.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7f45fd8ca640 1 -- 172.21.15.28:0/1871644338 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d8005260 con 0x7f45f00c1c40 2023-11-16T02:29:48.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7fb8deb79640 1 -- 172.21.15.28:0/3891154128 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d0005280 con 0x7fb8d003ad50 2023-11-16T02:29:48.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7fb8d57fa640 1 --2- 172.21.15.28:0/3891154128 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb8bc065ab0 0x7fb8bc067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7fb8d57fa640 1 -- 172.21.15.28:0/3891154128 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8d80eb6e0 con 0x7fb8d003ad50 2023-11-16T02:29:48.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7fb8dc915640 1 --2- 172.21.15.28:0/3891154128 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb8bc065ab0 0x7fb8bc067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7fb8dc915640 1 --2- 172.21.15.28:0/3891154128 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb8bc065ab0 0x7fb8bc067f70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc00a4e0 tx=0x7fb8cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f976ad46640 1 -- 172.21.15.28:0/1616369364 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975c02d130 con 0x7f975c03c4a0 2023-11-16T02:29:48.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f976ad46640 1 -- 172.21.15.28:0/1616369364 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975c02ab80 con 0x7f975c03c4a0 2023-11-16T02:29:48.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7f976ad46640 1 -- 172.21.15.28:0/1616369364 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f975c02d550 con 0x7f975c03c4a0 2023-11-16T02:29:48.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7fbb1597a640 1 -- 172.21.15.28:0/2119292832 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0801cc40 con 0x7fbb08039910 2023-11-16T02:29:48.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7fbb14978640 1 -- 172.21.15.28:0/2119292832 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbb08039910 msgr2=0x7fbb08038540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7fbb14978640 1 --2- 172.21.15.28:0/2119292832 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbb08039910 0x7fbb08038540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7fbb14978640 1 -- 172.21.15.28:0/2119292832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb080d8b40 msgr2=0x7fbb081713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7fbb14978640 1 --2- 172.21.15.28:0/2119292832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb080d8b40 0x7fbb081713b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7fbb14978640 1 -- 172.21.15.28:0/2119292832 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb040094d0 con 0x7fbb08007140 2023-11-16T02:29:48.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7fbb14978640 1 --2- 172.21.15.28:0/2119292832 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb08007140 0x7fbb0801f4e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbb0401a0e0 tx=0x7fbb0401acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f07f77fe640 1 -- 172.21.15.28:0/3930939893 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07ec005260 con 0x7f080c1542b0 2023-11-16T02:29:48.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7f0801ffb640 1 -- 172.21.15.28:0/3930939893 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08040ba630 con 0x7f080c1542b0 2023-11-16T02:29:48.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7f0801ffb640 1 -- 172.21.15.28:0/3930939893 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08040ba9a0 con 0x7f080c1542b0 2023-11-16T02:29:48.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7f0801ffb640 1 -- 172.21.15.28:0/3930939893 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f08040bab80 con 0x7f080c1542b0 2023-11-16T02:29:48.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7f0801ffb640 1 --2- 172.21.15.28:0/3930939893 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f07f0065bb0 0x7f07f0068070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7f0801ffb640 1 -- 172.21.15.28:0/3930939893 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0804121e80 con 0x7f080c1542b0 2023-11-16T02:29:48.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7f081159c640 1 --2- 172.21.15.28:0/3930939893 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f07f0065bb0 0x7f07f0068070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7ff6737fe640 1 --2- 172.21.15.28:0/1292250044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6740bbeb0 0x7ff674149e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7ff673fff640 1 --2- 172.21.15.28:0/1292250044 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff67414b900 0x7ff6740a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7ff6737fe640 1 -- 172.21.15.28:0/1292250044 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff6740bc780 msgr2=0x7ff6740bf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7ff6737fe640 1 --2- 172.21.15.28:0/1292250044 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff6740bc780 0x7ff6740bf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7ff6737fe640 1 -- 172.21.15.28:0/1292250044 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff67414b900 msgr2=0x7ff6740a5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7ff6737fe640 1 --2- 172.21.15.28:0/1292250044 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff67414b900 0x7ff6740a5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7ff6737fe640 1 -- 172.21.15.28:0/1292250044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6680094d0 con 0x7ff6740bbeb0 2023-11-16T02:29:48.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7ff6737fe640 1 --2- 172.21.15.28:0/1292250044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6740bbeb0 0x7ff674149e80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff66400b3f0 tx=0x7ff66400b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7ff65bfff640 1 -- 172.21.15.28:0/1292250044 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff664011830 con 0x7ff6740bbeb0 2023-11-16T02:29:48.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f524d57c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52480b67e0 0x7f5248143020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f524d57c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5248140ed0 0x7f5248141f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f524d57c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5248146ac0 0x7f52481db360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f524d57c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52480b25d0 con 0x7f5248146ac0 2023-11-16T02:29:48.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f524d57c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52481458e0 con 0x7f52480b67e0 2023-11-16T02:29:48.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f524d57c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52480b1cc0 con 0x7f5248140ed0 2023-11-16T02:29:48.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f52477fe640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5248140ed0 0x7f5248141f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f52477fe640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5248140ed0 0x7f5248141f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.28:47338/0 (socket says 172.21.15.28:47338) 2023-11-16T02:29:48.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f52477fe640 1 -- 172.21.15.28:0/3252199512 learned_addr learned my addr 172.21.15.28:0/3252199512 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:48.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f524cd7b640 1 --2- 172.21.15.28:0/3252199512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5248146ac0 0x7f52481db360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.261+0000 7f5247fff640 1 --2- 172.21.15.28:0/3252199512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52480b67e0 0x7f5248143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7f5247fff640 1 -- 172.21.15.28:0/3252199512 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5248140ed0 msgr2=0x7f5248141f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7f5247fff640 1 --2- 172.21.15.28:0/3252199512 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5248140ed0 0x7f5248141f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7f5247fff640 1 -- 172.21.15.28:0/3252199512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5248146ac0 msgr2=0x7f52481db360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7f5247fff640 1 --2- 172.21.15.28:0/3252199512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5248146ac0 0x7f52481db360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7f5247fff640 1 -- 172.21.15.28:0/3252199512 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c00b6c0 con 0x7f52480b67e0 2023-11-16T02:29:48.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7f52477fe640 1 --2- 172.21.15.28:0/3252199512 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5248140ed0 0x7f5248141f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-16T02:29:48.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7f524cd7b640 1 --2- 172.21.15.28:0/3252199512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5248146ac0 0x7f52481db360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-16T02:29:48.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7f5247fff640 1 --2- 172.21.15.28:0/3252199512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52480b67e0 0x7f5248143020 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f523c0b1000 tx=0x7f523c01e0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7ff67a0a5640 1 -- 172.21.15.28:0/1292250044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6741ea720 con 0x7ff6740bbeb0 2023-11-16T02:29:48.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7ff67a0a5640 1 -- 172.21.15.28:0/1292250044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6741eace0 con 0x7ff6740bbeb0 2023-11-16T02:29:48.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7ff65bfff640 1 -- 172.21.15.28:0/1292250044 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff664011990 con 0x7ff6740bbeb0 2023-11-16T02:29:48.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7ff65bfff640 1 -- 172.21.15.28:0/1292250044 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff664011d20 con 0x7ff6740bbeb0 2023-11-16T02:29:48.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7f081159c640 1 --2- 172.21.15.28:0/3930939893 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f07f0065bb0 0x7f07f0068070 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0808005890 tx=0x7f0808009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7ff67a0a5640 1 -- 172.21.15.28:0/1292250044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6741eaef0 con 0x7ff6740bbeb0 2023-11-16T02:29:48.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7f45f57fa640 1 -- 172.21.15.28:0/1871644338 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f45e40b3030 con 0x7f45f00c1c40 2023-11-16T02:29:48.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7f45f57fa640 1 --2- 172.21.15.28:0/1871644338 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f45dc065ae0 0x7f45dc067fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7f45f57fa640 1 -- 172.21.15.28:0/1871644338 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45e4009040 con 0x7f45f00c1c40 2023-11-16T02:29:48.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.265+0000 7f45fc8c8640 1 --2- 172.21.15.28:0/1871644338 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f45dc065ae0 0x7f45dc067fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.269+0000 7ff65bfff640 1 -- 172.21.15.28:0/1292250044 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff66401a400 con 0x7ff6740bbeb0 2023-11-16T02:29:48.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.269+0000 7f45fc8c8640 1 --2- 172.21.15.28:0/1871644338 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f45dc065ae0 0x7f45dc067fa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00ab80 tx=0x7f45ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.269+0000 7ff65bfff640 1 --2- 172.21.15.28:0/1292250044 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff660065ae0 0x7ff660067fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.269+0000 7ff672ffd640 1 --2- 172.21.15.28:0/1292250044 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff660065ae0 0x7ff660067fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.269+0000 7fbb0d7fa640 1 -- 172.21.15.28:0/2119292832 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb040bd5f0 con 0x7fbb08007140 2023-11-16T02:29:48.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.269+0000 7fbb1597a640 1 -- 172.21.15.28:0/2119292832 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb080cffe0 con 0x7fbb08007140 2023-11-16T02:29:48.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.269+0000 7fbb1597a640 1 -- 172.21.15.28:0/2119292832 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0801d1a0 con 0x7fbb08007140 2023-11-16T02:29:48.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.269+0000 7fb8d57fa640 1 -- 172.21.15.28:0/3891154128 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fb8d80b9230 con 0x7fb8d003ad50 2023-11-16T02:29:48.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.269+0000 7ff672ffd640 1 --2- 172.21.15.28:0/1292250044 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff660065ae0 0x7ff660067fa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff6740b76c0 tx=0x7ff66c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.269+0000 7fbb1597a640 1 -- 172.21.15.28:0/2119292832 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb08008850 con 0x7fbb08007140 2023-11-16T02:29:48.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.273+0000 7fbb0d7fa640 1 -- 172.21.15.28:0/2119292832 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb040059a0 con 0x7fbb08007140 2023-11-16T02:29:48.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.273+0000 7fbb0d7fa640 1 -- 172.21.15.28:0/2119292832 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb04005d10 con 0x7fbb08007140 2023-11-16T02:29:48.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.273+0000 7fbb0d7fa640 1 -- 172.21.15.28:0/2119292832 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbb040c7420 con 0x7fbb08007140 2023-11-16T02:29:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.273+0000 7fbb0d7fa640 1 --2- 172.21.15.28:0/2119292832 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fbaf4065a90 0x7fbaf4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.273+0000 7fbb0d7fa640 1 -- 172.21.15.28:0/2119292832 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb0411db30 con 0x7fbb08007140 2023-11-16T02:29:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.273+0000 7fbb0ffff640 1 --2- 172.21.15.28:0/2119292832 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fbaf4065a90 0x7fbaf4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.273+0000 7fbb0ffff640 1 --2- 172.21.15.28:0/2119292832 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fbaf4065a90 0x7fbaf4067f50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbb10073e00 tx=0x7fbb1006d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.277+0000 7f0801ffb640 1 -- 172.21.15.28:0/3930939893 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f08040f33f0 con 0x7f080c1542b0 2023-11-16T02:29:48.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.277+0000 7ffa24ff9640 1 -- 172.21.15.28:0/278316399 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7ffa280b5020 con 0x7ffa280b8d10 2023-11-16T02:29:48.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.277+0000 7fbb0d7fa640 1 -- 172.21.15.28:0/2119292832 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fbb040eb590 con 0x7fbb08007140 2023-11-16T02:29:48.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.281+0000 7f45f57fa640 1 -- 172.21.15.28:0/1871644338 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f45e40ec000 con 0x7f45f00c1c40 2023-11-16T02:29:48.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.281+0000 7f5244ff9640 1 -- 172.21.15.28:0/3252199512 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c003620 con 0x7f52480b67e0 2023-11-16T02:29:48.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.277+0000 7f97617fa640 1 -- 172.21.15.28:0/1616369364 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f975800fc80 con 0x7f975c03c4a0 2023-11-16T02:29:48.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.281+0000 7f97617fa640 1 --2- 172.21.15.28:0/1616369364 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f9748065a60 0x7f9748067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.281+0000 7f97617fa640 1 -- 172.21.15.28:0/1616369364 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9758009040 con 0x7f975c03c4a0 2023-11-16T02:29:48.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.281+0000 7f9768ae2640 1 --2- 172.21.15.28:0/1616369364 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f9748065a60 0x7f9748067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.281+0000 7f524d57c640 1 -- 172.21.15.28:0/3252199512 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5248143850 con 0x7f52480b67e0 2023-11-16T02:29:48.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.281+0000 7f524d57c640 1 -- 172.21.15.28:0/3252199512 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52480b96c0 con 0x7f52480b67e0 2023-11-16T02:29:48.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.281+0000 7ff65bfff640 1 -- 172.21.15.28:0/1292250044 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff664055560 con 0x7ff6740bbeb0 2023-11-16T02:29:48.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.281+0000 7f9768ae2640 1 --2- 172.21.15.28:0/1616369364 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f9748065a60 0x7f9748067f20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9764072600 tx=0x7f976412d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.281+0000 7f524d57c640 1 -- 172.21.15.28:0/3252199512 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5248061980 con 0x7f52480b67e0 2023-11-16T02:29:48.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.289+0000 7f97617fa640 1 -- 172.21.15.28:0/1616369364 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f9758051370 con 0x7f975c03c4a0 2023-11-16T02:29:48.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.289+0000 7f5244ff9640 1 -- 172.21.15.28:0/3252199512 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523c003780 con 0x7f52480b67e0 2023-11-16T02:29:48.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.293+0000 7f5244ff9640 1 -- 172.21.15.28:0/3252199512 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c003b10 con 0x7f52480b67e0 2023-11-16T02:29:48.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.293+0000 7ff65bfff640 1 -- 172.21.15.28:0/1292250044 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7ff6640511a0 con 0x7ff6740bbeb0 2023-11-16T02:29:48.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.293+0000 7f5244ff9640 1 -- 172.21.15.28:0/3252199512 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f523c003c70 con 0x7f52480b67e0 2023-11-16T02:29:48.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.293+0000 7f5244ff9640 1 --2- 172.21.15.28:0/3252199512 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5234065a60 0x7f5234067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:48.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.293+0000 7f5244ff9640 1 -- 172.21.15.28:0/3252199512 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f523c0aae40 con 0x7f52480b67e0 2023-11-16T02:29:48.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.293+0000 7f52477fe640 1 --2- 172.21.15.28:0/3252199512 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5234065a60 0x7f5234067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:48.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.297+0000 7f52477fe640 1 --2- 172.21.15.28:0/3252199512 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5234065a60 0x7f5234067f20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5238003fd0 tx=0x7f523800c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:48.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.305+0000 7f5244ff9640 1 -- 172.21.15.28:0/3252199512 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f523c0f7960 con 0x7f52480b67e0 2023-11-16T02:29:48.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.569+0000 7f07f77fe640 1 -- 172.21.15.28:0/3930939893 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f07ec005510 con 0x7f080c1542b0 2023-11-16T02:29:48.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.573+0000 7f0801ffb640 1 -- 172.21.15.28:0/3930939893 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f08040f2f80 con 0x7f080c1542b0 2023-11-16T02:29:48.576 INFO:teuthology.orchestra.run.smithi028.stdout:64424509446 2023-11-16T02:29:48.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.573+0000 7f0813800640 1 -- 172.21.15.28:0/3930939893 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f07f0065bb0 msgr2=0x7f07f0068070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.573+0000 7f0813800640 1 --2- 172.21.15.28:0/3930939893 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f07f0065bb0 0x7f07f0068070 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0808005890 tx=0x7f0808009040 comp rx=0 tx=0).stop 2023-11-16T02:29:48.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.573+0000 7f0813800640 1 -- 172.21.15.28:0/3930939893 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f080c1542b0 msgr2=0x7f080c148820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.573+0000 7f0813800640 1 --2- 172.21.15.28:0/3930939893 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f080c1542b0 0x7f080c148820 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f080401d7f0 tx=0x7f080401bee0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.573+0000 7f0813800640 1 -- 172.21.15.28:0/3930939893 shutdown_connections 2023-11-16T02:29:48.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.573+0000 7f0813800640 1 --2- 172.21.15.28:0/3930939893 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f07f0065bb0 0x7f07f0068070 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.573+0000 7f0813800640 1 --2- 172.21.15.28:0/3930939893 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f080c1542b0 0x7f080c148820 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.573+0000 7f0813800640 1 --2- 172.21.15.28:0/3930939893 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f080c06e140 0x7f080c14afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.573+0000 7f0813800640 1 --2- 172.21.15.28:0/3930939893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f080c06dd60 0x7f080c14a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.573+0000 7f0813800640 1 -- 172.21.15.28:0/3930939893 >> 172.21.15.28:0/3930939893 conn(0x7f080c0bdff0 msgr2=0x7f080c0bb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:48.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.573+0000 7f0813800640 1 -- 172.21.15.28:0/3930939893 shutdown_connections 2023-11-16T02:29:48.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.573+0000 7f0813800640 1 -- 172.21.15.28:0/3930939893 wait complete. 2023-11-16T02:29:48.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.589+0000 7fb8deb79640 1 -- 172.21.15.28:0/3891154128 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb8d00f14e0 con 0x7fb8d003ad50 2023-11-16T02:29:48.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.589+0000 7fb8d57fa640 1 -- 172.21.15.28:0/3891154128 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb8d807c020 con 0x7fb8d003ad50 2023-11-16T02:29:48.595 INFO:teuthology.orchestra.run.smithi028.stdout:64424509446 2023-11-16T02:29:48.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.593+0000 7fb8c2ffd640 1 -- 172.21.15.28:0/3891154128 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb8bc065ab0 msgr2=0x7fb8bc067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.593+0000 7fb8c2ffd640 1 --2- 172.21.15.28:0/3891154128 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb8bc065ab0 0x7fb8bc067f70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc00a4e0 tx=0x7fb8cc008040 comp rx=0 tx=0).stop 2023-11-16T02:29:48.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.593+0000 7fb8c2ffd640 1 -- 172.21.15.28:0/3891154128 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8d003ad50 msgr2=0x7fb8d00f1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.593+0000 7fb8c2ffd640 1 --2- 172.21.15.28:0/3891154128 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8d003ad50 0x7fb8d00f1780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb8d804f990 tx=0x7fb8d80735a0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.593+0000 7fb8c2ffd640 1 -- 172.21.15.28:0/3891154128 shutdown_connections 2023-11-16T02:29:48.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.593+0000 7fb8c2ffd640 1 --2- 172.21.15.28:0/3891154128 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb8bc065ab0 0x7fb8bc067f70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.593+0000 7fb8c2ffd640 1 --2- 172.21.15.28:0/3891154128 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb8d003d5c0 0x7fb8d0027db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.593+0000 7fb8c2ffd640 1 --2- 172.21.15.28:0/3891154128 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8d003ad50 0x7fb8d00f1780 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.593+0000 7fb8c2ffd640 1 --2- 172.21.15.28:0/3891154128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8d003a970 0x7fb8d00e5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.593+0000 7fb8c2ffd640 1 -- 172.21.15.28:0/3891154128 >> 172.21.15.28:0/3891154128 conn(0x7fb8d0005dc0 msgr2=0x7fb8d0039690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:48.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.593+0000 7fb8c2ffd640 1 -- 172.21.15.28:0/3891154128 shutdown_connections 2023-11-16T02:29:48.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.3 2023-11-16T02:29:48.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.597+0000 7fb8c2ffd640 1 -- 172.21.15.28:0/3891154128 wait complete. 2023-11-16T02:29:48.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.601+0000 7ffa2d3d2640 1 -- 172.21.15.28:0/278316399 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffa280b4fe0 con 0x7ffa280b8d10 2023-11-16T02:29:48.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.601+0000 7ffa24ff9640 1 -- 172.21.15.28:0/278316399 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffa1804fe80 con 0x7ffa280b8d10 2023-11-16T02:29:48.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.605+0000 7fbb1597a640 1 -- 172.21.15.28:0/2119292832 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbb080082a0 con 0x7fbb08007140 2023-11-16T02:29:48.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.605+0000 7fbb0d7fa640 1 -- 172.21.15.28:0/2119292832 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb040eebb0 con 0x7fbb08007140 2023-11-16T02:29:48.608 INFO:teuthology.orchestra.run.smithi028.stdout:60129542150 2023-11-16T02:29:48.610 INFO:teuthology.orchestra.run.smithi028.stdout:64424509446 2023-11-16T02:29:48.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.605+0000 7ff67a0a5640 1 -- 172.21.15.28:0/1292250044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff674061980 con 0x7ff6740bbeb0 2023-11-16T02:29:48.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7fbb1597a640 1 -- 172.21.15.28:0/2119292832 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fbaf4065a90 msgr2=0x7fbaf4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7fbb1597a640 1 --2- 172.21.15.28:0/2119292832 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fbaf4065a90 0x7fbaf4067f50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbb10073e00 tx=0x7fbb1006d040 comp rx=0 tx=0).stop 2023-11-16T02:29:48.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7fbb1597a640 1 -- 172.21.15.28:0/2119292832 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb08007140 msgr2=0x7fbb0801f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7fbb1597a640 1 --2- 172.21.15.28:0/2119292832 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb08007140 0x7fbb0801f4e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbb0401a0e0 tx=0x7fbb0401acf0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7ff65bfff640 1 -- 172.21.15.28:0/1292250044 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff6640547c0 con 0x7ff6740bbeb0 2023-11-16T02:29:48.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7fbb1597a640 1 -- 172.21.15.28:0/2119292832 shutdown_connections 2023-11-16T02:29:48.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7fbb1597a640 1 --2- 172.21.15.28:0/2119292832 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fbaf4065a90 0x7fbaf4067f50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7fbb1597a640 1 --2- 172.21.15.28:0/2119292832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb080d8b40 0x7fbb081713b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7fbb1597a640 1 --2- 172.21.15.28:0/2119292832 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbb08039910 0x7fbb08038540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7fbb1597a640 1 --2- 172.21.15.28:0/2119292832 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbb08007140 0x7fbb0801f4e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7fbb1597a640 1 -- 172.21.15.28:0/2119292832 >> 172.21.15.28:0/2119292832 conn(0x7fbb0803ef20 msgr2=0x7fbb080d6940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:48.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7fbb1597a640 1 -- 172.21.15.28:0/2119292832 shutdown_connections 2023-11-16T02:29:48.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7fbb1597a640 1 -- 172.21.15.28:0/2119292832 wait complete. 2023-11-16T02:29:48.613 INFO:teuthology.orchestra.run.smithi028.stdout:64424509447 2023-11-16T02:29:48.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7f45fd8ca640 1 -- 172.21.15.28:0/1871644338 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f45d80057e0 con 0x7f45f00c1c40 2023-11-16T02:29:48.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7f524d57c640 1 -- 172.21.15.28:0/3252199512 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f52480af770 con 0x7f52480b67e0 2023-11-16T02:29:48.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7f45f57fa640 1 -- 172.21.15.28:0/1871644338 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f45e40ef620 con 0x7f45f00c1c40 2023-11-16T02:29:48.615 INFO:teuthology.orchestra.run.smithi028.stdout:64424509447 2023-11-16T02:29:48.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7ffa2d3d2640 1 -- 172.21.15.28:0/278316399 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ffa08065a60 msgr2=0x7ffa08067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7ffa2d3d2640 1 --2- 172.21.15.28:0/278316399 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ffa08065a60 0x7ffa08067f20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffa200b6000 tx=0x7ffa200af000 comp rx=0 tx=0).stop 2023-11-16T02:29:48.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7ffa2d3d2640 1 -- 172.21.15.28:0/278316399 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa280b8d10 msgr2=0x7ffa281dd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7ffa2d3d2640 1 --2- 172.21.15.28:0/278316399 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa280b8d10 0x7ffa281dd290 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ffa1800c3c0 tx=0x7ffa1800c880 comp rx=0 tx=0).stop 2023-11-16T02:29:48.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7f5244ff9640 1 -- 172.21.15.28:0/3252199512 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f523c0d7020 con 0x7f52480b67e0 2023-11-16T02:29:48.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7ffa2d3d2640 1 -- 172.21.15.28:0/278316399 shutdown_connections 2023-11-16T02:29:48.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7ffa2d3d2640 1 --2- 172.21.15.28:0/278316399 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ffa08065a60 0x7ffa08067f20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7ffa2d3d2640 1 --2- 172.21.15.28:0/278316399 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ffa280b8d10 0x7ffa281dd290 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7ffa2d3d2640 1 --2- 172.21.15.28:0/278316399 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa2806f370 0x7ffa281efeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7ffa2d3d2640 1 --2- 172.21.15.28:0/278316399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa2806cec0 0x7ffa281e3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7ffa2d3d2640 1 -- 172.21.15.28:0/278316399 >> 172.21.15.28:0/278316399 conn(0x7ffa2806b850 msgr2=0x7ffa281402c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:48.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7ffa2d3d2640 1 -- 172.21.15.28:0/278316399 shutdown_connections 2023-11-16T02:29:48.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7ffa2d3d2640 1 -- 172.21.15.28:0/278316399 wait complete. 2023-11-16T02:29:48.617 INFO:teuthology.orchestra.run.smithi028.stdout:64424509447 2023-11-16T02:29:48.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7ff67a0a5640 1 -- 172.21.15.28:0/1292250044 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff660065ae0 msgr2=0x7ff660067fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.609+0000 7ff67a0a5640 1 --2- 172.21.15.28:0/1292250044 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff660065ae0 0x7ff660067fa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff6740b76c0 tx=0x7ff66c00b040 comp rx=0 tx=0).stop 2023-11-16T02:29:48.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7ff67a0a5640 1 -- 172.21.15.28:0/1292250044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6740bbeb0 msgr2=0x7ff674149e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7ff67a0a5640 1 --2- 172.21.15.28:0/1292250044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6740bbeb0 0x7ff674149e80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff66400b3f0 tx=0x7ff66400b8b0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7ff67a0a5640 1 -- 172.21.15.28:0/1292250044 shutdown_connections 2023-11-16T02:29:48.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7ff67a0a5640 1 --2- 172.21.15.28:0/1292250044 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff660065ae0 0x7ff660067fa0 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff6740b76c0 tx=0x7ff66c00b040 comp rx=0 tx=0).stop 2023-11-16T02:29:48.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7ff67a0a5640 1 --2- 172.21.15.28:0/1292250044 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff67414b900 0x7ff6740a5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7ff67a0a5640 1 --2- 172.21.15.28:0/1292250044 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff6740bc780 0x7ff6740bf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7ff67a0a5640 1 --2- 172.21.15.28:0/1292250044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6740bbeb0 0x7ff674149e80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7ff67a0a5640 1 -- 172.21.15.28:0/1292250044 >> 172.21.15.28:0/1292250044 conn(0x7ff6740bcd40 msgr2=0x7ff6740b5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:48.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7ff67a0a5640 1 -- 172.21.15.28:0/1292250044 shutdown_connections 2023-11-16T02:29:48.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7ff67a0a5640 1 -- 172.21.15.28:0/1292250044 wait complete. 2023-11-16T02:29:48.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7f45fd8ca640 1 -- 172.21.15.28:0/1871644338 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f45dc065ae0 msgr2=0x7f45dc067fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7f976ad46640 1 -- 172.21.15.28:0/1616369364 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f975c02dba0 con 0x7f975c03c4a0 2023-11-16T02:29:48.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7f45fd8ca640 1 --2- 172.21.15.28:0/1871644338 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f45dc065ae0 0x7f45dc067fa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00ab80 tx=0x7f45ec008040 comp rx=0 tx=0).stop 2023-11-16T02:29:48.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7f45fd8ca640 1 -- 172.21.15.28:0/1871644338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45f00c1c40 msgr2=0x7f45f00c20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7f45fd8ca640 1 --2- 172.21.15.28:0/1871644338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45f00c1c40 0x7f45f00c20a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f45e401cc70 tx=0x7f45e8005800 comp rx=0 tx=0).stop 2023-11-16T02:29:48.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7f524d57c640 1 -- 172.21.15.28:0/3252199512 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5234065a60 msgr2=0x7f5234067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7f524d57c640 1 --2- 172.21.15.28:0/3252199512 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5234065a60 0x7f5234067f20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5238003fd0 tx=0x7f523800c040 comp rx=0 tx=0).stop 2023-11-16T02:29:48.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7f524d57c640 1 -- 172.21.15.28:0/3252199512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52480b67e0 msgr2=0x7f5248143020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7f524d57c640 1 --2- 172.21.15.28:0/3252199512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52480b67e0 0x7f5248143020 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f523c0b1000 tx=0x7f523c01e0e0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7f524d57c640 1 -- 172.21.15.28:0/3252199512 shutdown_connections 2023-11-16T02:29:48.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7f524d57c640 1 --2- 172.21.15.28:0/3252199512 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5234065a60 0x7f5234067f20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7f524d57c640 1 --2- 172.21.15.28:0/3252199512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5248146ac0 0x7f52481db360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7f524d57c640 1 --2- 172.21.15.28:0/3252199512 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5248140ed0 0x7f5248141f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7f524d57c640 1 --2- 172.21.15.28:0/3252199512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52480b67e0 0x7f5248143020 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7f524d57c640 1 -- 172.21.15.28:0/3252199512 >> 172.21.15.28:0/3252199512 conn(0x7f52480b88e0 msgr2=0x7f52481404e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:48.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7f45fd8ca640 1 -- 172.21.15.28:0/1871644338 shutdown_connections 2023-11-16T02:29:48.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7f45fd8ca640 1 --2- 172.21.15.28:0/1871644338 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f45dc065ae0 0x7f45dc067fa0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7f97617fa640 1 -- 172.21.15.28:0/1616369364 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f975c02dba0 con 0x7f975c03c4a0 2023-11-16T02:29:48.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7f45fd8ca640 1 --2- 172.21.15.28:0/1871644338 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f45f0032c60 0x7f45f00330e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7f45fd8ca640 1 --2- 172.21.15.28:0/1871644338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45f00c1c40 0x7f45f00c20a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7f45fd8ca640 1 --2- 172.21.15.28:0/1871644338 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f45e80047d0 0x7f45f00d0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7f45fd8ca640 1 -- 172.21.15.28:0/1871644338 >> 172.21.15.28:0/1871644338 conn(0x7f45f0005e60 msgr2=0x7f45f0005550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:48.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7f45fd8ca640 1 -- 172.21.15.28:0/1871644338 shutdown_connections 2023-11-16T02:29:48.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7f524d57c640 1 -- 172.21.15.28:0/3252199512 shutdown_connections 2023-11-16T02:29:48.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7f45fd8ca640 1 -- 172.21.15.28:0/1871644338 wait complete. 2023-11-16T02:29:48.624 INFO:teuthology.orchestra.run.smithi028.stdout:64424509447 2023-11-16T02:29:48.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.613+0000 7f524d57c640 1 -- 172.21.15.28:0/3252199512 wait complete. 2023-11-16T02:29:48.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.617+0000 7f976ad46640 1 -- 172.21.15.28:0/1616369364 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f9748065a60 msgr2=0x7f9748067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.617+0000 7f976ad46640 1 --2- 172.21.15.28:0/1616369364 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f9748065a60 0x7f9748067f20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9764072600 tx=0x7f976412d040 comp rx=0 tx=0).stop 2023-11-16T02:29:48.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.617+0000 7f976ad46640 1 -- 172.21.15.28:0/1616369364 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f975c03c4a0 msgr2=0x7f975c028cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:48.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.617+0000 7f976ad46640 1 --2- 172.21.15.28:0/1616369364 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f975c03c4a0 0x7f975c028cb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f975800b510 tx=0x7f975800b9d0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.617+0000 7f976ad46640 1 -- 172.21.15.28:0/1616369364 shutdown_connections 2023-11-16T02:29:48.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.617+0000 7f976ad46640 1 --2- 172.21.15.28:0/1616369364 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f9748065a60 0x7f9748067f20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.617+0000 7f976ad46640 1 --2- 172.21.15.28:0/1616369364 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f975c0d1310 0x7f975c170560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.617+0000 7f976ad46640 1 --2- 172.21.15.28:0/1616369364 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f975c03c4a0 0x7f975c028cb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.617+0000 7f976ad46640 1 --2- 172.21.15.28:0/1616369364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f975c0070d0 0x7f975c0cfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:48.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.617+0000 7f976ad46640 1 -- 172.21.15.28:0/1616369364 >> 172.21.15.28:0/1616369364 conn(0x7f975c005f00 msgr2=0x7f975c02e450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:48.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.617+0000 7f976ad46640 1 -- 172.21.15.28:0/1616369364 shutdown_connections 2023-11-16T02:29:48.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:48.617+0000 7f976ad46640 1 -- 172.21.15.28:0/1616369364 wait complete. 2023-11-16T02:29:48.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.1 2023-11-16T02:29:48.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.2 2023-11-16T02:29:48.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.5 2023-11-16T02:29:48.652 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.6 2023-11-16T02:29:48.652 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.0 2023-11-16T02:29:48.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.4 2023-11-16T02:29:48.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.7 2023-11-16T02:29:49.601 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-16T02:29:49.630 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-16T02:29:49.648 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-16T02:29:49.652 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-16T02:29:49.653 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-16T02:29:49.653 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-16T02:29:49.655 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-16T02:29:49.655 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-16T02:29:49.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.757+0000 7fe35967a640 1 Processor -- start 2023-11-16T02:29:49.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.757+0000 7fe35967a640 1 -- start start 2023-11-16T02:29:49.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.761+0000 7fe35967a640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe354140c20 0x7fe354149f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.761+0000 7fe35967a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe3540b5e50 0x7fe35406c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.761+0000 7fe35967a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3540b1cd0 con 0x7fe3540b6790 2023-11-16T02:29:49.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.761+0000 7fe35967a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3540b1710 con 0x7fe3540b5e50 2023-11-16T02:29:49.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.761+0000 7fe35967a640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3540b19f0 con 0x7fe354140c20 2023-11-16T02:29:49.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.761+0000 7fe3537fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe3540b6790 0x7fe3540b6c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:39810/0 (socket says 172.21.15.28:39810) 2023-11-16T02:29:49.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.761+0000 7fe3537fe640 1 -- 172.21.15.28:0/659271919 learned_addr learned my addr 172.21.15.28:0/659271919 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:49.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.761+0000 7fe3527fc640 1 --2- 172.21.15.28:0/659271919 >> v2:172.21.15.70:3300/0 conn(0x7fe3540b5e50 0x7fe35406c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.761+0000 7fe3527fc640 1 -- 172.21.15.28:0/659271919 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe354140c20 msgr2=0x7fe354149f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:49.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.761+0000 7fe3527fc640 1 --2- 172.21.15.28:0/659271919 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe354140c20 0x7fe354149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.761+0000 7fe3527fc640 1 -- 172.21.15.28:0/659271919 >> v1:172.21.15.28:6789/0 conn(0x7fe3540b6790 legacy=0x7fe3540b6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.761+0000 7fe3527fc640 1 -- 172.21.15.28:0/659271919 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3540b1fd0 con 0x7fe3540b5e50 2023-11-16T02:29:49.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.761+0000 7fe351ffb640 1 -- 172.21.15.28:0/659271919 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1435732691 0 0) 0x7fe3540b1cd0 con 0x7fe3540b6790 2023-11-16T02:29:49.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.765+0000 7fe3527fc640 1 --2- 172.21.15.28:0/659271919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3540b5e50 0x7fe35406c3d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe34c00d1e0 tx=0x7fe34c021550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a710bb03da971c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:49.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.765+0000 7fe351ffb640 1 -- 172.21.15.28:0/659271919 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c0b4410 con 0x7fe3540b5e50 2023-11-16T02:29:49.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.765+0000 7fe351ffb640 1 -- 172.21.15.28:0/659271919 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34c0ae030 con 0x7fe3540b5e50 2023-11-16T02:29:49.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.765+0000 7fe35967a640 1 -- 172.21.15.28:0/659271919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3540b5e50 msgr2=0x7fe35406c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.765+0000 7fe35967a640 1 --2- 172.21.15.28:0/659271919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3540b5e50 0x7fe35406c3d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe34c00d1e0 tx=0x7fe34c021550 comp rx=0 tx=0).stop 2023-11-16T02:29:49.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.765+0000 7fe35967a640 1 -- 172.21.15.28:0/659271919 shutdown_connections 2023-11-16T02:29:49.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.765+0000 7fe35967a640 1 --2- 172.21.15.28:0/659271919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3540b5e50 0x7fe35406c3d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.765+0000 7fe35967a640 1 --2- 172.21.15.28:0/659271919 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe354140c20 0x7fe354149f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.765+0000 7fe35967a640 1 -- 172.21.15.28:0/659271919 >> 172.21.15.28:0/659271919 conn(0x7fe3540b8890 msgr2=0x7fe3540b8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:49.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.765+0000 7fe35967a640 1 -- 172.21.15.28:0/659271919 shutdown_connections 2023-11-16T02:29:49.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.765+0000 7fe35967a640 1 -- 172.21.15.28:0/659271919 wait complete. 2023-11-16T02:29:49.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.769+0000 7fe35967a640 1 Processor -- start 2023-11-16T02:29:49.771 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.769+0000 7fe35967a640 1 -- start start 2023-11-16T02:29:49.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.769+0000 7fe35967a640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe3540b5e50 0x7fe3541e0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.769+0000 7fe35967a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3540b6790 0x7fe3541dc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.769+0000 7fe35967a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe354140c20 0x7fe354149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.769+0000 7fe35967a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe354149aa0 con 0x7fe354140c20 2023-11-16T02:29:49.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.769+0000 7fe35967a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe354139f70 con 0x7fe3540b6790 2023-11-16T02:29:49.772 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.769+0000 7fe35967a640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe354146700 con 0x7fe3540b5e50 2023-11-16T02:29:49.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.769+0000 7fe3537fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe354140c20 0x7fe354149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.769+0000 7fe352ffd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe3540b5e50 0x7fe3541e0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.769+0000 7fe3537fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe354140c20 0x7fe354149560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41236/0 (socket says 172.21.15.28:41236) 2023-11-16T02:29:49.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.769+0000 7fe3537fe640 1 -- 172.21.15.28:0/4278015570 learned_addr learned my addr 172.21.15.28:0/4278015570 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:49.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.769+0000 7fe3527fc640 1 --2- 172.21.15.28:0/4278015570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3540b6790 0x7fe3541dc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.769+0000 7fe3537fe640 1 -- 172.21.15.28:0/4278015570 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe3540b5e50 msgr2=0x7fe3541e0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.769+0000 7fe3537fe640 1 --2- 172.21.15.28:0/4278015570 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe3540b5e50 0x7fe3541e0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.769+0000 7fe3537fe640 1 -- 172.21.15.28:0/4278015570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3540b6790 msgr2=0x7fe3541dc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.769+0000 7fe3537fe640 1 --2- 172.21.15.28:0/4278015570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3540b6790 0x7fe3541dc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.774 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.769+0000 7fe3537fe640 1 -- 172.21.15.28:0/4278015570 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34c007910 con 0x7fe354140c20 2023-11-16T02:29:49.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.769+0000 7fe3537fe640 1 --2- 172.21.15.28:0/4278015570 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe354140c20 0x7fe354149560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe34400c440 tx=0x7fe34400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:49.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.769+0000 7fe33b7fe640 1 -- 172.21.15.28:0/4278015570 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3440074e0 con 0x7fe354140c20 2023-11-16T02:29:49.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.769+0000 7fe33b7fe640 1 -- 172.21.15.28:0/4278015570 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe344007660 con 0x7fe354140c20 2023-11-16T02:29:49.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.769+0000 7fe33b7fe640 1 -- 172.21.15.28:0/4278015570 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe344004a30 con 0x7fe354140c20 2023-11-16T02:29:49.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.769+0000 7fe35967a640 1 -- 172.21.15.28:0/4278015570 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe354146970 con 0x7fe354140c20 2023-11-16T02:29:49.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.769+0000 7fe35967a640 1 -- 172.21.15.28:0/4278015570 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3541df900 con 0x7fe354140c20 2023-11-16T02:29:49.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.773+0000 7fe33b7fe640 1 -- 172.21.15.28:0/4278015570 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe344004b90 con 0x7fe354140c20 2023-11-16T02:29:49.779 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.773+0000 7fe33b7fe640 1 --2- 172.21.15.28:0/4278015570 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe340065b30 0x7fe340067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.779 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.777+0000 7fe33b7fe640 1 -- 172.21.15.28:0/4278015570 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe344082d30 con 0x7fe354140c20 2023-11-16T02:29:49.779 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.777+0000 7fe352ffd640 1 --2- 172.21.15.28:0/4278015570 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe340065b30 0x7fe340067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.779 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.777+0000 7fe35967a640 1 -- 172.21.15.28:0/4278015570 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe334005260 con 0x7fe354140c20 2023-11-16T02:29:49.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.785+0000 7fe33b7fe640 1 -- 172.21.15.28:0/4278015570 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fe344054210 con 0x7fe354140c20 2023-11-16T02:29:49.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.785+0000 7fe352ffd640 1 --2- 172.21.15.28:0/4278015570 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe340065b30 0x7fe340067ff0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe348009990 tx=0x7fe348009110 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:49.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.813+0000 7fde7fe8d640 1 Processor -- start 2023-11-16T02:29:49.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.813+0000 7fde7fe8d640 1 -- start start 2023-11-16T02:29:49.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.813+0000 7fde7fe8d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fde780b5e50 0x7fde7806c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.813+0000 7fde7fe8d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde780b1cd0 con 0x7fde78140c20 2023-11-16T02:29:49.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.813+0000 7fde7fe8d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde780b1710 con 0x7fde7814f300 2023-11-16T02:29:49.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.813+0000 7fde7fe8d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde7814a690 con 0x7fde780b5e50 2023-11-16T02:29:49.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.813+0000 7fde7d428640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fde780b5e50 0x7fde7806c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.813+0000 7fde7d428640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fde780b5e50 0x7fde7806c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:41252/0 (socket says 172.21.15.28:41252) 2023-11-16T02:29:49.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.813+0000 7fde7d428640 1 -- 172.21.15.28:0/57406625 learned_addr learned my addr 172.21.15.28:0/57406625 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:49.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.813+0000 7fde7cc27640 1 -- 172.21.15.28:0/57406625 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2621605650 0 0) 0x7fde780b1cd0 con 0x7fde78140c20 2023-11-16T02:29:49.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.813+0000 7fde7cc27640 1 -- 172.21.15.28:0/57406625 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde64003530 con 0x7fde78140c20 2023-11-16T02:29:49.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.813+0000 7fde7d428640 1 -- 172.21.15.28:0/57406625 >> v1:172.21.15.70:6789/0 conn(0x7fde7814f300 legacy=0x7fde781516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:49.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.813+0000 7fde7d428640 1 -- 172.21.15.28:0/57406625 >> v1:172.21.15.28:6789/0 conn(0x7fde78140c20 legacy=0x7fde78149f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.813+0000 7fde7d428640 1 -- 172.21.15.28:0/57406625 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde780b19f0 con 0x7fde780b5e50 2023-11-16T02:29:49.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.817+0000 7fbda09aa640 1 Processor -- start 2023-11-16T02:29:49.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.817+0000 7fbda09aa640 1 -- start start 2023-11-16T02:29:49.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.817+0000 7fbda09aa640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbd9c150310 0x7fbd9c152700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.817+0000 7fbda09aa640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd9c0b1cd0 con 0x7fbd9c0b5e50 2023-11-16T02:29:49.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.817+0000 7fbda09aa640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd9c06cae0 con 0x7fbd9c140c20 2023-11-16T02:29:49.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.817+0000 7fbda09aa640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c14a690 con 0x7fbd9c150310 2023-11-16T02:29:49.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.817+0000 7fbd9a59c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fbd9c140c20 0x7fbd9c149f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.28:38076/0 (socket says 172.21.15.28:38076) 2023-11-16T02:29:49.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.817+0000 7fbd9a59c640 1 -- 172.21.15.28:0/3574121755 learned_addr learned my addr 172.21.15.28:0/3574121755 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:49.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.817+0000 7fbd9ad9d640 1 --2- 172.21.15.28:0/3574121755 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbd9c150310 0x7fbd9c152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.817+0000 7fde7d428640 1 --2- 172.21.15.28:0/57406625 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde780b5e50 0x7fde7806c3d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fde70010520 tx=0x7fde70023780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a30d9205166bc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:49.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.817+0000 7fbd9ad9d640 1 -- 172.21.15.28:0/3574121755 >> v1:172.21.15.70:6789/0 conn(0x7fbd9c140c20 legacy=0x7fbd9c149f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.817+0000 7fbd9ad9d640 1 -- 172.21.15.28:0/3574121755 >> v1:172.21.15.28:6789/0 conn(0x7fbd9c0b5e50 legacy=0x7fbd9c06c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.817+0000 7fde7cc27640 1 -- 172.21.15.28:0/57406625 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde700b1670 con 0x7fde780b5e50 2023-11-16T02:29:49.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.817+0000 7fde7cc27640 1 -- 172.21.15.28:0/57406625 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde700b17d0 con 0x7fde780b5e50 2023-11-16T02:29:49.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.817+0000 7fde7cc27640 1 -- 172.21.15.28:0/57406625 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde700b1b60 con 0x7fde780b5e50 2023-11-16T02:29:49.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.817+0000 7fde7fe8d640 1 -- 172.21.15.28:0/57406625 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde780b5e50 msgr2=0x7fde7806c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.817+0000 7fde7fe8d640 1 --2- 172.21.15.28:0/57406625 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde780b5e50 0x7fde7806c3d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fde70010520 tx=0x7fde70023780 comp rx=0 tx=0).stop 2023-11-16T02:29:49.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.821+0000 7fde7fe8d640 1 -- 172.21.15.28:0/57406625 shutdown_connections 2023-11-16T02:29:49.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.821+0000 7fde7fe8d640 1 --2- 172.21.15.28:0/57406625 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde780b5e50 0x7fde7806c3d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.821+0000 7fde7fe8d640 1 -- 172.21.15.28:0/57406625 >> 172.21.15.28:0/57406625 conn(0x7fde780b8890 msgr2=0x7fde780b8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:49.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.821+0000 7fde7fe8d640 1 -- 172.21.15.28:0/57406625 shutdown_connections 2023-11-16T02:29:49.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.817+0000 7fbd9ad9d640 1 -- 172.21.15.28:0/3574121755 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9c0b1710 con 0x7fbd9c150310 2023-11-16T02:29:49.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.821+0000 7fde7fe8d640 1 -- 172.21.15.28:0/57406625 wait complete. 2023-11-16T02:29:49.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.821+0000 7fde7fe8d640 1 Processor -- start 2023-11-16T02:29:49.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.821+0000 7fbd9ad9d640 1 --2- 172.21.15.28:0/3574121755 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbd9c150310 0x7fbd9c152700 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c009770 tx=0x7fbd8c01d5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e2eca2d0afdd565 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:49.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.821+0000 7fde7fe8d640 1 -- start start 2023-11-16T02:29:49.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.821+0000 7fbd9959a640 1 -- 172.21.15.28:0/3574121755 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c0a76b0 con 0x7fbd9c150310 2023-11-16T02:29:49.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.821+0000 7fbd9959a640 1 -- 172.21.15.28:0/3574121755 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8c0a7810 con 0x7fbd9c150310 2023-11-16T02:29:49.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.821+0000 7fbd9959a640 1 -- 172.21.15.28:0/3574121755 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c0a7ba0 con 0x7fbd9c150310 2023-11-16T02:29:49.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.821+0000 7fde7fe8d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fde780b5e50 0x7fde781e39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.821+0000 7fde7fe8d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde78140c20 0x7fde7814b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.821+0000 7fde7fe8d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde7814f300 0x7fde78070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.821+0000 7fde7fe8d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7814eff0 con 0x7fde7814f300 2023-11-16T02:29:49.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.821+0000 7fde7fe8d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde781e3f10 con 0x7fde78140c20 2023-11-16T02:29:49.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.821+0000 7fde7fe8d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7814eda0 con 0x7fde780b5e50 2023-11-16T02:29:49.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.825+0000 7fde7d428640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde78140c20 0x7fde7814b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.825+0000 7fde7dc29640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fde780b5e50 0x7fde781e39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.825+0000 7fde7d428640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde78140c20 0x7fde7814b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.28:43854/0 (socket says 172.21.15.28:43854) 2023-11-16T02:29:49.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.825+0000 7fde7d428640 1 -- 172.21.15.28:0/2340794105 learned_addr learned my addr 172.21.15.28:0/2340794105 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:49.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.825+0000 7fbda09aa640 1 -- 172.21.15.28:0/3574121755 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbd9c150310 msgr2=0x7fbd9c152700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.825+0000 7fbda09aa640 1 --2- 172.21.15.28:0/3574121755 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbd9c150310 0x7fbd9c152700 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c009770 tx=0x7fbd8c01d5b0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.825+0000 7fde7e42a640 1 --2- 172.21.15.28:0/2340794105 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde7814f300 0x7fde78070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.825+0000 7fbda09aa640 1 -- 172.21.15.28:0/3574121755 shutdown_connections 2023-11-16T02:29:49.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.825+0000 7fbda09aa640 1 --2- 172.21.15.28:0/3574121755 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbd9c150310 0x7fbd9c152700 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.825+0000 7fbda09aa640 1 -- 172.21.15.28:0/3574121755 >> 172.21.15.28:0/3574121755 conn(0x7fbd9c0b8890 msgr2=0x7fbd9c0b8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:49.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.825+0000 7fbda09aa640 1 -- 172.21.15.28:0/3574121755 shutdown_connections 2023-11-16T02:29:49.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.825+0000 7fde7d428640 1 -- 172.21.15.28:0/2340794105 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fde780b5e50 msgr2=0x7fde781e39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.825+0000 7fde7d428640 1 --2- 172.21.15.28:0/2340794105 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fde780b5e50 0x7fde781e39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.825+0000 7fde7d428640 1 -- 172.21.15.28:0/2340794105 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde7814f300 msgr2=0x7fde78070fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.825+0000 7fde7d428640 1 --2- 172.21.15.28:0/2340794105 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde7814f300 0x7fde78070fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.825+0000 7fde7d428640 1 -- 172.21.15.28:0/2340794105 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde70007790 con 0x7fde78140c20 2023-11-16T02:29:49.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.825+0000 7fde7d428640 1 --2- 172.21.15.28:0/2340794105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde78140c20 0x7fde7814b3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fde70007210 tx=0x7fde70020520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:49.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.825+0000 7fde6e7fc640 1 -- 172.21.15.28:0/2340794105 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde70007d20 con 0x7fde78140c20 2023-11-16T02:29:49.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.825+0000 7fbda09aa640 1 -- 172.21.15.28:0/3574121755 wait complete. 2023-11-16T02:29:49.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.825+0000 7fbda09aa640 1 Processor -- start 2023-11-16T02:29:49.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.825+0000 7fde7fe8d640 1 -- 172.21.15.28:0/2340794105 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde7806c620 con 0x7fde78140c20 2023-11-16T02:29:49.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.825+0000 7fde7fe8d640 1 -- 172.21.15.28:0/2340794105 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde78147710 con 0x7fde78140c20 2023-11-16T02:29:49.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.825+0000 7fde6e7fc640 1 -- 172.21.15.28:0/2340794105 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde70007e80 con 0x7fde78140c20 2023-11-16T02:29:49.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.825+0000 7fde6e7fc640 1 -- 172.21.15.28:0/2340794105 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde700b1b80 con 0x7fde78140c20 2023-11-16T02:29:49.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.825+0000 7fbda09aa640 1 -- start start 2023-11-16T02:29:49.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.829+0000 7fbda09aa640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbd9c0b5e50 0x7fbd9c142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.829+0000 7fbda09aa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd9c140c20 0x7fbd9c143430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.829+0000 7fbda09aa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd9c150310 0x7fbd9c1e6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.829+0000 7fbda09aa640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c141cd0 con 0x7fbd9c150310 2023-11-16T02:29:49.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.829+0000 7fbda09aa640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c141fb0 con 0x7fbd9c140c20 2023-11-16T02:29:49.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.829+0000 7fbda09aa640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c142290 con 0x7fbd9c0b5e50 2023-11-16T02:29:49.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.829+0000 7fbd9a59c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbd9c0b5e50 0x7fbd9c142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.829+0000 7fbd9a59c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbd9c0b5e50 0x7fbd9c142ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.28:47388/0 (socket says 172.21.15.28:47388) 2023-11-16T02:29:49.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.829+0000 7fbd9a59c640 1 -- 172.21.15.28:0/273466134 learned_addr learned my addr 172.21.15.28:0/273466134 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:49.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.829+0000 7fbd9ad9d640 1 --2- 172.21.15.28:0/273466134 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd9c150310 0x7fbd9c1e6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.829+0000 7fde7fe8d640 1 -- 172.21.15.28:0/2340794105 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde78147570 con 0x7fde78140c20 2023-11-16T02:29:49.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.829+0000 7fbd9a59c640 1 -- 172.21.15.28:0/273466134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd9c140c20 msgr2=0x7fbd9c143430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-16T02:29:49.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.829+0000 7fbd9a59c640 1 --2- 172.21.15.28:0/273466134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd9c140c20 0x7fbd9c143430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.829+0000 7fbd9a59c640 1 -- 172.21.15.28:0/273466134 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd9c150310 msgr2=0x7fbd9c1e6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.829+0000 7fbd9a59c640 1 --2- 172.21.15.28:0/273466134 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd9c150310 0x7fbd9c1e6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.829+0000 7fbd9a59c640 1 -- 172.21.15.28:0/273466134 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c009420 con 0x7fbd9c0b5e50 2023-11-16T02:29:49.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.829+0000 7fde6e7fc640 1 -- 172.21.15.28:0/2340794105 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fde700b1ce0 con 0x7fde78140c20 2023-11-16T02:29:49.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.829+0000 7fbd9a59c640 1 --2- 172.21.15.28:0/273466134 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbd9c0b5e50 0x7fbd9c142ef0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400f870 tx=0x7fbd9400fd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:49.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.829+0000 7fde6e7fc640 1 --2- 172.21.15.28:0/2340794105 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fde5c065b30 0x7fde5c067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.829+0000 7fde6e7fc640 1 -- 172.21.15.28:0/2340794105 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde701212b0 con 0x7fde78140c20 2023-11-16T02:29:49.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.829+0000 7fde7dc29640 1 --2- 172.21.15.28:0/2340794105 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fde5c065b30 0x7fde5c067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.829+0000 7fbd8affd640 1 -- 172.21.15.28:0/273466134 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9400d640 con 0x7fbd9c0b5e50 2023-11-16T02:29:49.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.829+0000 7fbda09aa640 1 -- 172.21.15.28:0/273466134 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd9c1407c0 con 0x7fbd9c0b5e50 2023-11-16T02:29:49.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.829+0000 7fbda09aa640 1 -- 172.21.15.28:0/273466134 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd9c141a50 con 0x7fbd9c0b5e50 2023-11-16T02:29:49.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.829+0000 7fde7dc29640 1 --2- 172.21.15.28:0/2340794105 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fde5c065b30 0x7fde5c067ff0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fde740011f0 tx=0x7fde74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:49.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.833+0000 7fbd8affd640 1 -- 172.21.15.28:0/273466134 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9400d7a0 con 0x7fbd9c0b5e50 2023-11-16T02:29:49.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.833+0000 7fbd8affd640 1 -- 172.21.15.28:0/273466134 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9400db50 con 0x7fbd9c0b5e50 2023-11-16T02:29:49.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.833+0000 7fbd8affd640 1 -- 172.21.15.28:0/273466134 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbd94008500 con 0x7fbd9c0b5e50 2023-11-16T02:29:49.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.833+0000 7fbda09aa640 1 -- 172.21.15.28:0/273466134 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd80005260 con 0x7fbd9c0b5e50 2023-11-16T02:29:49.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.833+0000 7fbd8affd640 1 --2- 172.21.15.28:0/273466134 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fbd7c065b60 0x7fbd7c068020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.833+0000 7fbd8affd640 1 -- 172.21.15.28:0/273466134 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd940860b0 con 0x7fbd9c0b5e50 2023-11-16T02:29:49.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.833+0000 7fbd99d9b640 1 --2- 172.21.15.28:0/273466134 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fbd7c065b60 0x7fbd7c068020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.837+0000 7fbd99d9b640 1 --2- 172.21.15.28:0/273466134 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fbd7c065b60 0x7fbd7c068020 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbd90007fd0 tx=0x7fbd900079a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:49.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.841+0000 7fde6e7fc640 1 -- 172.21.15.28:0/2340794105 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fde78147570 con 0x7fde78140c20 2023-11-16T02:29:49.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.845+0000 7fbd8affd640 1 -- 172.21.15.28:0/273466134 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fbd94053a50 con 0x7fbd9c0b5e50 2023-11-16T02:29:49.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.861+0000 7fbf5891e640 1 Processor -- start 2023-11-16T02:29:49.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.861+0000 7fbf5891e640 1 -- start start 2023-11-16T02:29:49.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.861+0000 7fbf5891e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbf540b8b40 0x7fbf54152370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.861+0000 7fbf5891e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbf540b8450 0x7fbf54148c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.861+0000 7fbf5891e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf5406fab0 con 0x7fbf540b7da0 2023-11-16T02:29:49.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.861+0000 7fbf5891e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf5406ef80 con 0x7fbf540b8b40 2023-11-16T02:29:49.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.861+0000 7fbf5891e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5406eca0 con 0x7fbf540b8450 2023-11-16T02:29:49.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.861+0000 7fbf52d9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbf540b8b40 0x7fbf54152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.861+0000 7fbf52d9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbf540b8b40 0x7fbf54152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47038/0 (socket says 172.21.15.28:47038) 2023-11-16T02:29:49.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.861+0000 7fbf52d9d640 1 -- 172.21.15.28:0/2658898529 learned_addr learned my addr 172.21.15.28:0/2658898529 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:49.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.861+0000 7fbf5259c640 1 --2- 172.21.15.28:0/2658898529 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbf540b8450 0x7fbf54148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.861+0000 7fbf52d9d640 1 -- 172.21.15.28:0/2658898529 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbf540b8450 msgr2=0x7fbf54148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:49.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.861+0000 7fbf52d9d640 1 --2- 172.21.15.28:0/2658898529 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbf540b8450 0x7fbf54148c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.861+0000 7fbf52d9d640 1 -- 172.21.15.28:0/2658898529 >> v1:172.21.15.70:6789/0 conn(0x7fbf540b7da0 legacy=0x7fbf5414ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.861+0000 7fbf52d9d640 1 -- 172.21.15.28:0/2658898529 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf541528b0 con 0x7fbf540b8b40 2023-11-16T02:29:49.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.865+0000 7f68d164f640 1 Processor -- start 2023-11-16T02:29:49.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.865+0000 7f68d164f640 1 -- start start 2023-11-16T02:29:49.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.865+0000 7f68d164f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f68cc0b7150 0x7f68cc0700d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.865+0000 7f68d164f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68cc153110 0x7f68cc14ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.867 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.865+0000 7f68d164f640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68cc14f470 con 0x7f68cc0b9c80 2023-11-16T02:29:49.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.865+0000 7f68d164f640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68cc070730 con 0x7f68cc0b7150 2023-11-16T02:29:49.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.865+0000 7f68d164f640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc14fe80 con 0x7f68cc153110 2023-11-16T02:29:49.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.865+0000 7f68cb7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f68cc0b7150 0x7f68cc0700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.865+0000 7f68cb7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f68cc0b7150 0x7f68cc0700d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47044/0 (socket says 172.21.15.28:47044) 2023-11-16T02:29:49.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.865+0000 7f68cb7fe640 1 -- 172.21.15.28:0/1448525927 learned_addr learned my addr 172.21.15.28:0/1448525927 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:49.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.865+0000 7f68cb7fe640 1 -- 172.21.15.28:0/1448525927 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68cc153110 msgr2=0x7f68cc14ef30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-16T02:29:49.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.865+0000 7f68cb7fe640 1 --2- 172.21.15.28:0/1448525927 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68cc153110 0x7f68cc14ef30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.865+0000 7f68cb7fe640 1 -- 172.21.15.28:0/1448525927 >> v1:172.21.15.70:6789/0 conn(0x7f68cc0b9c80 legacy=0x7f68cc14f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.865+0000 7f68cb7fe640 1 -- 172.21.15.28:0/1448525927 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68cc152630 con 0x7f68cc0b7150 2023-11-16T02:29:49.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.865+0000 7f13e5aa2640 1 Processor -- start 2023-11-16T02:29:49.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.865+0000 7ff1540c2640 1 Processor -- start 2023-11-16T02:29:49.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.865+0000 7fbf52d9d640 1 --2- 172.21.15.28:0/2658898529 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf540b8b40 0x7fbf54152370 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbf44009870 tx=0x7fbf4401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f5b1e61f10d3db server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:49.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.865+0000 7f13e5aa2640 1 -- start start 2023-11-16T02:29:49.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.865+0000 7ff1540c2640 1 -- start start 2023-11-16T02:29:49.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7ff1540c2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff14c0b5bb0 0x7ff14c06f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7ff1540c2640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff14c0709c0 0x7ff14c14a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7ff1540c2640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff14c0b62a0 con 0x7ff14c06ffd0 2023-11-16T02:29:49.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7ff1540c2640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14c0b68d0 con 0x7ff14c0709c0 2023-11-16T02:29:49.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7ff1540c2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c0b6cf0 con 0x7ff14c0b5bb0 2023-11-16T02:29:49.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7ff15165d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff14c0709c0 0x7ff14c14a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7ff15265f640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff14c06ffd0 0x7ff14c146f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55906/0 (socket says 172.21.15.28:55906) 2023-11-16T02:29:49.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7ff15165d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff14c0709c0 0x7ff14c14a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47052/0 (socket says 172.21.15.28:47052) 2023-11-16T02:29:49.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7ff15265f640 1 -- 172.21.15.28:0/3725766249 learned_addr learned my addr 172.21.15.28:0/3725766249 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:49.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.865+0000 7f13e5aa2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f13e0140ed0 0x7f13e00b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.865+0000 7f13e5aa2640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f13e014f3c0 0x7f13e01517b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.873 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.865+0000 7f13e5aa2640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e0071880 con 0x7f13e00b67e0 2023-11-16T02:29:49.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.865+0000 7f13e5aa2640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e00b5e20 con 0x7f13e014f3c0 2023-11-16T02:29:49.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.865+0000 7f13e5aa2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e014a750 con 0x7f13e0140ed0 2023-11-16T02:29:49.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7f13e52a1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f13e014f3c0 0x7f13e01517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7f13e52a1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f13e014f3c0 0x7f13e01517b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.28:46928/0 (socket says 172.21.15.28:46928) 2023-11-16T02:29:49.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7f13e52a1640 1 -- 172.21.15.28:0/1911916850 learned_addr learned my addr 172.21.15.28:0/1911916850 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:49.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7f13e4aa0640 1 --2- 172.21.15.28:0/1911916850 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f13e0140ed0 0x7f13e00b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.874 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7fbf51d9b640 1 -- 172.21.15.28:0/2658898529 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf440ab660 con 0x7fbf540b8b40 2023-11-16T02:29:49.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7fbf51d9b640 1 -- 172.21.15.28:0/2658898529 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf440ab7c0 con 0x7fbf540b8b40 2023-11-16T02:29:49.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7fbf51d9b640 1 -- 172.21.15.28:0/2658898529 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf440abb90 con 0x7fbf540b8b40 2023-11-16T02:29:49.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7fbf5891e640 1 -- 172.21.15.28:0/2658898529 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf540b8b40 msgr2=0x7fbf54152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7fbf5891e640 1 --2- 172.21.15.28:0/2658898529 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf540b8b40 0x7fbf54152370 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbf44009870 tx=0x7fbf4401c440 comp rx=0 tx=0).stop 2023-11-16T02:29:49.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7fbf5891e640 1 -- 172.21.15.28:0/2658898529 shutdown_connections 2023-11-16T02:29:49.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7fbf5891e640 1 --2- 172.21.15.28:0/2658898529 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbf540b8450 0x7fbf54148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7fbf5891e640 1 --2- 172.21.15.28:0/2658898529 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf540b8b40 0x7fbf54152370 secure :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbf44009870 tx=0x7fbf4401c440 comp rx=0 tx=0).stop 2023-11-16T02:29:49.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7fbf5891e640 1 -- 172.21.15.28:0/2658898529 >> 172.21.15.28:0/2658898529 conn(0x7fbf5406b850 msgr2=0x7fbf5406bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:49.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7f68cb7fe640 1 --2- 172.21.15.28:0/1448525927 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f68cc0b7150 0x7f68cc0700d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f68c0009870 tx=0x7f68c001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea69be795f0cfe35 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:49.877 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7f68caffd640 1 -- 172.21.15.28:0/1448525927 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c00ab650 con 0x7f68cc0b7150 2023-11-16T02:29:49.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7f68caffd640 1 -- 172.21.15.28:0/1448525927 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c00ab7b0 con 0x7f68cc0b7150 2023-11-16T02:29:49.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7f68caffd640 1 -- 172.21.15.28:0/1448525927 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c00abb40 con 0x7f68cc0b7150 2023-11-16T02:29:49.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7ff15165d640 1 -- 172.21.15.28:0/3725766249 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff14c0b5bb0 msgr2=0x7ff14c06f6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-16T02:29:49.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7fbf5891e640 1 -- 172.21.15.28:0/2658898529 shutdown_connections 2023-11-16T02:29:49.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7ff15165d640 1 --2- 172.21.15.28:0/3725766249 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff14c0b5bb0 0x7ff14c06f6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7ff15165d640 1 -- 172.21.15.28:0/3725766249 >> v1:172.21.15.28:6789/0 conn(0x7ff14c06ffd0 legacy=0x7ff14c146f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7ff15165d640 1 -- 172.21.15.28:0/3725766249 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c0715c0 con 0x7ff14c0709c0 2023-11-16T02:29:49.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7f68d164f640 1 -- 172.21.15.28:0/1448525927 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f68cc0b7150 msgr2=0x7f68cc0700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7f68d164f640 1 --2- 172.21.15.28:0/1448525927 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f68cc0b7150 0x7f68cc0700d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f68c0009870 tx=0x7f68c001c560 comp rx=0 tx=0).stop 2023-11-16T02:29:49.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7f68d164f640 1 -- 172.21.15.28:0/1448525927 shutdown_connections 2023-11-16T02:29:49.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7f68d164f640 1 --2- 172.21.15.28:0/1448525927 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68cc153110 0x7f68cc14ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7f68d164f640 1 --2- 172.21.15.28:0/1448525927 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f68cc0b7150 0x7f68cc0700d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7f68d164f640 1 -- 172.21.15.28:0/1448525927 >> 172.21.15.28:0/1448525927 conn(0x7f68cc06b050 msgr2=0x7f68cc06b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:49.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7f68d164f640 1 -- 172.21.15.28:0/1448525927 shutdown_connections 2023-11-16T02:29:49.880 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7fbf5891e640 1 -- 172.21.15.28:0/2658898529 wait complete. 2023-11-16T02:29:49.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7fbf5891e640 1 Processor -- start 2023-11-16T02:29:49.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7f68d164f640 1 -- 172.21.15.28:0/1448525927 wait complete. 2023-11-16T02:29:49.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7f68d164f640 1 Processor -- start 2023-11-16T02:29:49.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7f13e52a1640 1 -- 172.21.15.28:0/1911916850 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f13e0140ed0 msgr2=0x7f13e00b7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:49.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7f13e52a1640 1 --2- 172.21.15.28:0/1911916850 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f13e0140ed0 0x7f13e00b7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7f13e52a1640 1 -- 172.21.15.28:0/1911916850 >> v1:172.21.15.28:6789/0 conn(0x7f13e00b67e0 legacy=0x7f13e014a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:49.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7f13e52a1640 1 -- 172.21.15.28:0/1911916850 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e00b6d00 con 0x7f13e014f3c0 2023-11-16T02:29:49.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.869+0000 7f68d164f640 1 -- start start 2023-11-16T02:29:49.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f2aceb32640 1 Processor -- start 2023-11-16T02:29:49.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f13e52a1640 1 --2- 172.21.15.28:0/1911916850 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13e014f3c0 0x7f13e01517b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f13d800c110 tx=0x7f13d801f3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0f6c7d6cf9c4065 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:49.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7ff15165d640 1 --2- 172.21.15.28:0/3725766249 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff14c0709c0 0x7ff14c14a480 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff1480097c0 tx=0x7ff14801c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd59a3581ababb3 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:49.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f13df7fe640 1 -- 172.21.15.28:0/1911916850 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d80a8ea0 con 0x7f13e014f3c0 2023-11-16T02:29:49.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f13df7fe640 1 -- 172.21.15.28:0/1911916850 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d80ab030 con 0x7f13e014f3c0 2023-11-16T02:29:49.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f13df7fe640 1 -- 172.21.15.28:0/1911916850 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d80b1610 con 0x7f13e014f3c0 2023-11-16T02:29:49.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f13e5aa2640 1 -- 172.21.15.28:0/1911916850 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13e014f3c0 msgr2=0x7f13e01517b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f13e5aa2640 1 --2- 172.21.15.28:0/1911916850 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13e014f3c0 0x7f13e01517b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f13d800c110 tx=0x7f13d801f3e0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7fbf5891e640 1 -- start start 2023-11-16T02:29:49.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7fbf5891e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf540b7da0 0x7fbf5412e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7fbf5891e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbf540b8450 0x7fbf540b9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7fbf5891e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf540ba180 0x7fbf5413ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7fbf5891e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5412e6f0 con 0x7fbf540b7da0 2023-11-16T02:29:49.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7fbf5891e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5412eef0 con 0x7fbf540ba180 2023-11-16T02:29:49.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7fbf5891e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5412ec10 con 0x7fbf540b8450 2023-11-16T02:29:49.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7fbf5359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf540ba180 0x7fbf5413ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7fbf5359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf540ba180 0x7fbf5413ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.28:46948/0 (socket says 172.21.15.28:46948) 2023-11-16T02:29:49.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7fbf5359e640 1 -- 172.21.15.28:0/381681414 learned_addr learned my addr 172.21.15.28:0/381681414 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:49.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f2aceb32640 1 -- start start 2023-11-16T02:29:49.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f2aceb32640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ac0007220 0x7f2ac00c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f2aceb32640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2ac00c7170 0x7f2ac00d0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f2aceb32640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac0036100 con 0x7f2ac0006e40 2023-11-16T02:29:49.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f2aceb32640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac00c75e0 con 0x7f2ac00c7170 2023-11-16T02:29:49.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f2aceb32640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac003bb70 con 0x7f2ac0007220 2023-11-16T02:29:49.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f68d164f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f68cc0b7150 0x7f68cc1f3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f68d164f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68cc0b9c80 0x7f68cc0a7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f68d164f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68cc153110 0x7f68cc0a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f68d164f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc14aaf0 con 0x7f68cc0b7150 2023-11-16T02:29:49.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f68d164f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc1f41e0 con 0x7f68cc0b9c80 2023-11-16T02:29:49.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f68d164f640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc1f44c0 con 0x7f68cc153110 2023-11-16T02:29:49.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f68d0e4e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68cc153110 0x7f68cc0a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f68d0e4e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68cc153110 0x7f68cc0a7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.28:44812/0 (socket says 172.21.15.28:44812) 2023-11-16T02:29:49.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f68d0e4e640 1 -- 172.21.15.28:0/2052618550 learned_addr learned my addr 172.21.15.28:0/2052618550 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:49.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f68cb7fe640 1 --2- 172.21.15.28:0/2052618550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68cc0b9c80 0x7f68cc0a7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f68cbfff640 1 --2- 172.21.15.28:0/2052618550 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f68cc0b7150 0x7f68cc1f3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f13e5aa2640 1 -- 172.21.15.28:0/1911916850 shutdown_connections 2023-11-16T02:29:49.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f13e5aa2640 1 --2- 172.21.15.28:0/1911916850 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13e014f3c0 0x7f13e01517b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f13e5aa2640 1 --2- 172.21.15.28:0/1911916850 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f13e0140ed0 0x7f13e00b7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f13e5aa2640 1 -- 172.21.15.28:0/1911916850 >> 172.21.15.28:0/1911916850 conn(0x7f13e00b88e0 msgr2=0x7f13e00b8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:49.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7ff150e5c640 1 -- 172.21.15.28:0/3725766249 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1480ab600 con 0x7ff14c0709c0 2023-11-16T02:29:49.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7ff150e5c640 1 -- 172.21.15.28:0/3725766249 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1480a7050 con 0x7ff14c0709c0 2023-11-16T02:29:49.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7ff150e5c640 1 -- 172.21.15.28:0/3725766249 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1480ab980 con 0x7ff14c0709c0 2023-11-16T02:29:49.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f13e5aa2640 1 -- 172.21.15.28:0/1911916850 shutdown_connections 2023-11-16T02:29:49.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7fbf5259c640 1 --2- 172.21.15.28:0/381681414 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbf540b8450 0x7fbf540b9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f2acd32f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ac0007220 0x7f2ac00c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f2acd32f640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ac0007220 0x7f2ac00c6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.28:44834/0 (socket says 172.21.15.28:44834) 2023-11-16T02:29:49.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f2acd32f640 1 -- 172.21.15.28:0/1735193859 learned_addr learned my addr 172.21.15.28:0/1735193859 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:49.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f2ace331640 1 --2- 172.21.15.28:0/1735193859 >> v2:172.21.15.28:3300/0 conn(0x7f2ac00c7170 0x7f2ac00d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f68cb7fe640 1 -- 172.21.15.28:0/2052618550 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68cc153110 msgr2=0x7f68cc0a7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f68cb7fe640 1 --2- 172.21.15.28:0/2052618550 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68cc153110 0x7f68cc0a7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f68cb7fe640 1 -- 172.21.15.28:0/2052618550 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f68cc0b7150 msgr2=0x7f68cc1f3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f68cb7fe640 1 --2- 172.21.15.28:0/2052618550 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f68cc0b7150 0x7f68cc1f3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f68cb7fe640 1 -- 172.21.15.28:0/2052618550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c00094d0 con 0x7f68cc0b9c80 2023-11-16T02:29:49.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7fbf5359e640 1 -- 172.21.15.28:0/381681414 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbf540b8450 msgr2=0x7fbf540b9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7fbf5359e640 1 --2- 172.21.15.28:0/381681414 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbf540b8450 0x7fbf540b9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7fbf5359e640 1 -- 172.21.15.28:0/381681414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf540b7da0 msgr2=0x7fbf5412e1b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-16T02:29:49.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7fbf5359e640 1 --2- 172.21.15.28:0/381681414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf540b7da0 0x7fbf5412e1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7fbf5359e640 1 -- 172.21.15.28:0/381681414 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf440094d0 con 0x7fbf540ba180 2023-11-16T02:29:49.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7ff1540c2640 1 -- 172.21.15.28:0/3725766249 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff14c0709c0 msgr2=0x7ff14c14a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7ff1540c2640 1 --2- 172.21.15.28:0/3725766249 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff14c0709c0 0x7ff14c14a480 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff1480097c0 tx=0x7ff14801c2a0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7ff1540c2640 1 -- 172.21.15.28:0/3725766249 shutdown_connections 2023-11-16T02:29:49.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7ff1540c2640 1 --2- 172.21.15.28:0/3725766249 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff14c0709c0 0x7ff14c14a480 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7ff1540c2640 1 --2- 172.21.15.28:0/3725766249 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff14c0b5bb0 0x7ff14c06f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7ff1540c2640 1 -- 172.21.15.28:0/3725766249 >> 172.21.15.28:0/3725766249 conn(0x7ff14c06de20 msgr2=0x7ff14c069d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:49.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f68cb7fe640 1 --2- 172.21.15.28:0/2052618550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68cc0b9c80 0x7f68cc0a7a80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f68c00ac000 tx=0x7f68c001ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:49.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f13e5aa2640 1 -- 172.21.15.28:0/1911916850 wait complete. 2023-11-16T02:29:49.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7ff1540c2640 1 -- 172.21.15.28:0/3725766249 shutdown_connections 2023-11-16T02:29:49.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f68c8ff9640 1 -- 172.21.15.28:0/2052618550 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c00b48c0 con 0x7f68cc0b9c80 2023-11-16T02:29:49.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f68d164f640 1 -- 172.21.15.28:0/2052618550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68cc0a7560 con 0x7f68cc0b9c80 2023-11-16T02:29:49.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f68d164f640 1 -- 172.21.15.28:0/2052618550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68cc0ab570 con 0x7f68cc0b9c80 2023-11-16T02:29:49.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f13e5aa2640 1 Processor -- start 2023-11-16T02:29:49.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7ff1540c2640 1 -- 172.21.15.28:0/3725766249 wait complete. 2023-11-16T02:29:49.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7ff1540c2640 1 Processor -- start 2023-11-16T02:29:49.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f13e5aa2640 1 -- start start 2023-11-16T02:29:49.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f13e5aa2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13e00b67e0 0x7f13e014af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f13e5aa2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f13e0140ed0 0x7f13e01e0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f13e5aa2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f13e014f3c0 0x7f13e01e0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f13e5aa2640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e01ed0d0 con 0x7f13e014f3c0 2023-11-16T02:29:49.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f13e5aa2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e014c410 con 0x7f13e00b67e0 2023-11-16T02:29:49.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f13e5aa2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e014b4d0 con 0x7f13e0140ed0 2023-11-16T02:29:49.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f68c8ff9640 1 -- 172.21.15.28:0/2052618550 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c00b4a20 con 0x7f68cc0b9c80 2023-11-16T02:29:49.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f68c8ff9640 1 -- 172.21.15.28:0/2052618550 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c00b4dd0 con 0x7f68cc0b9c80 2023-11-16T02:29:49.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f2acd32f640 1 -- 172.21.15.28:0/1735193859 >> v2:172.21.15.28:3300/0 conn(0x7f2ac00c7170 msgr2=0x7f2ac00d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:49.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f2acd32f640 1 --2- 172.21.15.28:0/1735193859 >> v2:172.21.15.28:3300/0 conn(0x7f2ac00c7170 0x7f2ac00d0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f2acd32f640 1 -- 172.21.15.28:0/1735193859 >> v1:172.21.15.70:6789/0 conn(0x7f2ac0006e40 legacy=0x7f2ac003b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.873+0000 7f2acd32f640 1 -- 172.21.15.28:0/1735193859 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac003e160 con 0x7f2ac0007220 2023-11-16T02:29:49.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f13dffff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f13e0140ed0 0x7f13e01e0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f13dffff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f13e0140ed0 0x7f13e01e0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.28:44846/0 (socket says 172.21.15.28:44846) 2023-11-16T02:29:49.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f13dffff640 1 -- 172.21.15.28:0/299946140 learned_addr learned my addr 172.21.15.28:0/299946140 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:49.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f13e4aa0640 1 --2- 172.21.15.28:0/299946140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13e00b67e0 0x7f13e014af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7ff1540c2640 1 -- start start 2023-11-16T02:29:49.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7ff1540c2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff14c06ffd0 0x7ff14c1defb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7ff1540c2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff14c1dcb10 0x7ff14c1de090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7ff1540c2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff14c1e7fa0 0x7ff14c1e8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7ff1540c2640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c1df4f0 con 0x7ff14c06ffd0 2023-11-16T02:29:49.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7ff1540c2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c1e7b10 con 0x7ff14c1e7fa0 2023-11-16T02:29:49.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7ff1540c2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c1de5d0 con 0x7ff14c1dcb10 2023-11-16T02:29:49.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f13e52a1640 1 --2- 172.21.15.28:0/299946140 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f13e014f3c0 0x7f13e01e0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7ff15165d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff14c1dcb10 0x7ff14c1de090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7ff15165d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff14c1dcb10 0x7ff14c1de090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.28:44854/0 (socket says 172.21.15.28:44854) 2023-11-16T02:29:49.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7ff15165d640 1 -- 172.21.15.28:0/3623592730 learned_addr learned my addr 172.21.15.28:0/3623592730 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:49.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7fbf5359e640 1 --2- 172.21.15.28:0/381681414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf540ba180 0x7fbf5413ad80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbf4800c3f0 tx=0x7fbf4800c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:49.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7ff15265f640 1 --2- 172.21.15.28:0/3623592730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff14c1e7fa0 0x7ff14c1e8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f13e4aa0640 1 -- 172.21.15.28:0/299946140 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f13e0140ed0 msgr2=0x7f13e01e0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f13e4aa0640 1 --2- 172.21.15.28:0/299946140 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f13e0140ed0 0x7f13e01e0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f13e4aa0640 1 -- 172.21.15.28:0/299946140 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f13e014f3c0 msgr2=0x7f13e01e0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f13e4aa0640 1 --2- 172.21.15.28:0/299946140 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f13e014f3c0 0x7f13e01e0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f13e4aa0640 1 -- 172.21.15.28:0/299946140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d8007790 con 0x7f13e00b67e0 2023-11-16T02:29:49.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7ff151e5e640 1 --2- 172.21.15.28:0/3623592730 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff14c06ffd0 0x7ff14c1defb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7fbf3b7fe640 1 -- 172.21.15.28:0/381681414 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf480052d0 con 0x7fbf540ba180 2023-11-16T02:29:49.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7ff15165d640 1 -- 172.21.15.28:0/3623592730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff14c1e7fa0 msgr2=0x7ff14c1e8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7ff15165d640 1 --2- 172.21.15.28:0/3623592730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff14c1e7fa0 0x7ff14c1e8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7ff15165d640 1 -- 172.21.15.28:0/3623592730 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff14c06ffd0 msgr2=0x7ff14c1defb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f13e4aa0640 1 --2- 172.21.15.28:0/299946140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13e00b67e0 0x7f13e014af90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f13cc00bb50 tx=0x7f13cc00f480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:49.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7ff15165d640 1 --2- 172.21.15.28:0/3623592730 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff14c06ffd0 0x7ff14c1defb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7ff15165d640 1 -- 172.21.15.28:0/3623592730 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff148009420 con 0x7ff14c1dcb10 2023-11-16T02:29:49.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7ff151e5e640 1 --2- 172.21.15.28:0/3623592730 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff14c06ffd0 0x7ff14c1defb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-16T02:29:49.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f68c8ff9640 1 -- 172.21.15.28:0/2052618550 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f68c00be3f0 con 0x7f68cc0b9c80 2023-11-16T02:29:49.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f68c8ff9640 1 --2- 172.21.15.28:0/2052618550 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f68b8065a60 0x7f68b8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f13dd7fa640 1 -- 172.21.15.28:0/299946140 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc00be40 con 0x7f13e00b67e0 2023-11-16T02:29:49.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f68c8ff9640 1 -- 172.21.15.28:0/2052618550 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f68c011def0 con 0x7f68cc0b9c80 2023-11-16T02:29:49.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7ff15165d640 1 --2- 172.21.15.28:0/3623592730 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff14c1dcb10 0x7ff14c1de090 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff14801cb40 tx=0x7ff14801aae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:49.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7ff1427fc640 1 -- 172.21.15.28:0/3623592730 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1480b7650 con 0x7ff14c1dcb10 2023-11-16T02:29:49.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7fbf5891e640 1 -- 172.21.15.28:0/381681414 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf54150490 con 0x7fbf540ba180 2023-11-16T02:29:49.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7fbf5891e640 1 -- 172.21.15.28:0/381681414 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf54152340 con 0x7fbf540ba180 2023-11-16T02:29:49.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7ff1427fc640 1 -- 172.21.15.28:0/3623592730 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1480b77b0 con 0x7ff14c1dcb10 2023-11-16T02:29:49.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7ff1427fc640 1 -- 172.21.15.28:0/3623592730 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1480b7b40 con 0x7ff14c1dcb10 2023-11-16T02:29:49.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7ff1540c2640 1 -- 172.21.15.28:0/3623592730 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14c1e8960 con 0x7ff14c1dcb10 2023-11-16T02:29:49.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.881+0000 7ff1540c2640 1 -- 172.21.15.28:0/3623592730 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14c1dd280 con 0x7ff14c1dcb10 2023-11-16T02:29:49.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.881+0000 7ff1540c2640 1 -- 172.21.15.28:0/3623592730 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff134005260 con 0x7ff14c1dcb10 2023-11-16T02:29:49.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f13e5aa2640 1 -- 172.21.15.28:0/299946140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e014c680 con 0x7f13e00b67e0 2023-11-16T02:29:49.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f13e5aa2640 1 -- 172.21.15.28:0/299946140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e01eca80 con 0x7f13e00b67e0 2023-11-16T02:29:49.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.881+0000 7f13e5aa2640 1 -- 172.21.15.28:0/299946140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e00b8750 con 0x7f13e00b67e0 2023-11-16T02:29:49.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.881+0000 7f13dd7fa640 1 -- 172.21.15.28:0/299946140 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13cc00d2e0 con 0x7f13e00b67e0 2023-11-16T02:29:49.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.881+0000 7f13dd7fa640 1 -- 172.21.15.28:0/299946140 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc00fd10 con 0x7f13e00b67e0 2023-11-16T02:29:49.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.881+0000 7fbf3b7fe640 1 -- 172.21.15.28:0/381681414 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf48005430 con 0x7fbf540ba180 2023-11-16T02:29:49.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.881+0000 7fbf5891e640 1 -- 172.21.15.28:0/381681414 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf541509b0 con 0x7fbf540ba180 2023-11-16T02:29:49.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.881+0000 7fbf3b7fe640 1 -- 172.21.15.28:0/381681414 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf48007260 con 0x7fbf540ba180 2023-11-16T02:29:49.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f2acd32f640 1 --2- 172.21.15.28:0/1735193859 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ac0007220 0x7f2ac00c6c30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4008870 tx=0x7f2ac4021180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c309d65069863bac server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:49.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.881+0000 7f2accb2e640 1 -- 172.21.15.28:0/1735193859 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac40aae70 con 0x7f2ac0007220 2023-11-16T02:29:49.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.881+0000 7f2accb2e640 1 -- 172.21.15.28:0/1735193859 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac40ae070 con 0x7f2ac0007220 2023-11-16T02:29:49.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.881+0000 7f2accb2e640 1 -- 172.21.15.28:0/1735193859 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac40b4620 con 0x7f2ac0007220 2023-11-16T02:29:49.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.881+0000 7f2aceb32640 1 -- 172.21.15.28:0/1735193859 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ac0007220 msgr2=0x7f2ac00c6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.881+0000 7f2aceb32640 1 --2- 172.21.15.28:0/1735193859 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ac0007220 0x7f2ac00c6c30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4008870 tx=0x7f2ac4021180 comp rx=0 tx=0).stop 2023-11-16T02:29:49.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.877+0000 7f68cbfff640 1 --2- 172.21.15.28:0/2052618550 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f68b8065a60 0x7f68b8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.881+0000 7f68cbfff640 1 --2- 172.21.15.28:0/2052618550 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f68b8065a60 0x7f68b8067f20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f68bc000f70 tx=0x7f68bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:49.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.881+0000 7f13dd7fa640 1 -- 172.21.15.28:0/299946140 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f13cc014070 con 0x7f13e00b67e0 2023-11-16T02:29:49.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.881+0000 7ff1427fc640 1 -- 172.21.15.28:0/3623592730 <== mon.2 v2:172.21.15.70:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff1480b7ca0 con 0x7ff14c1dcb10 2023-11-16T02:29:49.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7f13dd7fa640 1 --2- 172.21.15.28:0/299946140 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f13c4065b60 0x7f13c4068020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7ff1427fc640 1 --2- 172.21.15.28:0/3623592730 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff130065a90 0x7ff130067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7ff1427fc640 1 -- 172.21.15.28:0/3623592730 <== mon.2 v2:172.21.15.70:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff14811d990 con 0x7ff14c1dcb10 2023-11-16T02:29:49.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7ff151e5e640 1 --2- 172.21.15.28:0/3623592730 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff130065a90 0x7ff130067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7f13dd7fa640 1 -- 172.21.15.28:0/299946140 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13cc082c20 con 0x7f13e00b67e0 2023-11-16T02:29:49.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7f13dffff640 1 --2- 172.21.15.28:0/299946140 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f13c4065b60 0x7f13c4068020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.881+0000 7fbf3b7fe640 1 -- 172.21.15.28:0/381681414 <== mon.1 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbf480073c0 con 0x7fbf540ba180 2023-11-16T02:29:49.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7fbf3b7fe640 1 --2- 172.21.15.28:0/381681414 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fbf40065a90 0x7fbf40067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7fbf3b7fe640 1 -- 172.21.15.28:0/381681414 <== mon.1 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf48082470 con 0x7fbf540ba180 2023-11-16T02:29:49.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.881+0000 7f2aceb32640 1 -- 172.21.15.28:0/1735193859 shutdown_connections 2023-11-16T02:29:49.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.881+0000 7f2aceb32640 1 --2- 172.21.15.28:0/1735193859 >> v2:172.21.15.28:3300/0 conn(0x7f2ac00c7170 0x7f2ac00d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.881+0000 7f2aceb32640 1 --2- 172.21.15.28:0/1735193859 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ac0007220 0x7f2ac00c6c30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.881+0000 7f2aceb32640 1 -- 172.21.15.28:0/1735193859 >> 172.21.15.28:0/1735193859 conn(0x7f2ac0005ed0 msgr2=0x7f2ac00062e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:49.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.881+0000 7f68d164f640 1 -- 172.21.15.28:0/2052618550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68ac005260 con 0x7f68cc0b9c80 2023-11-16T02:29:49.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7f13dffff640 1 --2- 172.21.15.28:0/299946140 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f13c4065b60 0x7f13c4068020 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f13e00b3d80 tx=0x7f13d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:49.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7ff151e5e640 1 --2- 172.21.15.28:0/3623592730 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff130065a90 0x7ff130067f50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff13c006fd0 tx=0x7ff13c0090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:49.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7f2aceb32640 1 -- 172.21.15.28:0/1735193859 shutdown_connections 2023-11-16T02:29:49.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7f2aceb32640 1 -- 172.21.15.28:0/1735193859 wait complete. 2023-11-16T02:29:49.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7fbf52d9d640 1 --2- 172.21.15.28:0/381681414 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fbf40065a90 0x7fbf40067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7fbf52d9d640 1 --2- 172.21.15.28:0/381681414 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fbf40065a90 0x7fbf40067f50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbf440af000 tx=0x7fbf44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:49.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7f2aceb32640 1 Processor -- start 2023-11-16T02:29:49.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7f2aceb32640 1 -- start start 2023-11-16T02:29:49.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7f2aceb32640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ac0006e40 0x7f2ac0030070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7f2aceb32640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ac0007220 0x7f2ac00cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7f2aceb32640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ac00c7170 0x7f2ac00cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7f2aceb32640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac00305b0 con 0x7f2ac0007220 2023-11-16T02:29:49.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7f2aceb32640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac00cb010 con 0x7f2ac0006e40 2023-11-16T02:29:49.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7f2aceb32640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac00ce220 con 0x7f2ac00c7170 2023-11-16T02:29:49.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7f2acd32f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ac0007220 0x7f2ac00cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7f2acd32f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ac0007220 0x7f2ac00cc840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47094/0 (socket says 172.21.15.28:47094) 2023-11-16T02:29:49.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7f2acd32f640 1 -- 172.21.15.28:0/3412092783 learned_addr learned my addr 172.21.15.28:0/3412092783 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:49.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7f2acdb30640 1 --2- 172.21.15.28:0/3412092783 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ac0006e40 0x7f2ac0030070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7f2ace331640 1 --2- 172.21.15.28:0/3412092783 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ac00c7170 0x7f2ac00cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7f2acd32f640 1 -- 172.21.15.28:0/3412092783 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ac00c7170 msgr2=0x7f2ac00cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7f2acd32f640 1 --2- 172.21.15.28:0/3412092783 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ac00c7170 0x7f2ac00cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7f2acd32f640 1 -- 172.21.15.28:0/3412092783 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ac0006e40 msgr2=0x7f2ac0030070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:49.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7f2acd32f640 1 --2- 172.21.15.28:0/3412092783 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ac0006e40 0x7f2ac0030070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:49.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7f2acd32f640 1 -- 172.21.15.28:0/3412092783 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac4008550 con 0x7f2ac0007220 2023-11-16T02:29:49.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.885+0000 7f2acd32f640 1 --2- 172.21.15.28:0/3412092783 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ac0007220 0x7f2ac00cc840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2ac401f830 tx=0x7f2ac401f9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:49.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.889+0000 7f2abe7fc640 1 -- 172.21.15.28:0/3412092783 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac400b360 con 0x7f2ac0007220 2023-11-16T02:29:49.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.889+0000 7f2abe7fc640 1 -- 172.21.15.28:0/3412092783 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac400b4e0 con 0x7f2ac0007220 2023-11-16T02:29:49.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.889+0000 7f2abe7fc640 1 -- 172.21.15.28:0/3412092783 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac400b890 con 0x7f2ac0007220 2023-11-16T02:29:49.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.889+0000 7f2aceb32640 1 -- 172.21.15.28:0/3412092783 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac00cf4c0 con 0x7f2ac0007220 2023-11-16T02:29:49.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.889+0000 7f2aceb32640 1 -- 172.21.15.28:0/3412092783 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac00cdd70 con 0x7f2ac0007220 2023-11-16T02:29:49.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.889+0000 7f2aceb32640 1 -- 172.21.15.28:0/3412092783 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac0005390 con 0x7f2ac0007220 2023-11-16T02:29:49.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.889+0000 7f2abe7fc640 1 -- 172.21.15.28:0/3412092783 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2ac40b4400 con 0x7f2ac0007220 2023-11-16T02:29:49.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.889+0000 7f2abe7fc640 1 --2- 172.21.15.28:0/3412092783 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2aac065a60 0x7f2aac067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:49.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.889+0000 7f2abe7fc640 1 -- 172.21.15.28:0/3412092783 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ac4120480 con 0x7f2ac0007220 2023-11-16T02:29:49.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.889+0000 7f2acdb30640 1 --2- 172.21.15.28:0/3412092783 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2aac065a60 0x7f2aac067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:49.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.889+0000 7f2acdb30640 1 --2- 172.21.15.28:0/3412092783 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2aac065a60 0x7f2aac067f20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8007fd0 tx=0x7f2ab8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:49.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.897+0000 7f13dd7fa640 1 -- 172.21.15.28:0/299946140 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f13cc0505e0 con 0x7f13e00b67e0 2023-11-16T02:29:49.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.897+0000 7ff1427fc640 1 -- 172.21.15.28:0/3623592730 <== mon.2 v2:172.21.15.70:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7ff1480eb350 con 0x7ff14c1dcb10 2023-11-16T02:29:49.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.897+0000 7f2abe7fc640 1 -- 172.21.15.28:0/3412092783 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f2ac40ee060 con 0x7f2ac0007220 2023-11-16T02:29:49.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.905+0000 7fbf3b7fe640 1 -- 172.21.15.28:0/381681414 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fbf4804fea0 con 0x7fbf540ba180 2023-11-16T02:29:49.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:49.917+0000 7f68c8ff9640 1 -- 172.21.15.28:0/2052618550 <== mon.1 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f68c00eb950 con 0x7f68cc0b9c80 2023-11-16T02:29:50.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.153+0000 7fde7fe8d640 1 -- 172.21.15.28:0/2340794105 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fde78147570 con 0x7fde78140c20 2023-11-16T02:29:50.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.153+0000 7fde6e7fc640 1 -- 172.21.15.28:0/2340794105 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fde78147570 con 0x7fde78140c20 2023-11-16T02:29:50.168 INFO:teuthology.orchestra.run.smithi028.stdout:60129542151 2023-11-16T02:29:50.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.165+0000 7fbda09aa640 1 -- 172.21.15.28:0/273466134 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbd800050d0 con 0x7fbd9c0b5e50 2023-11-16T02:29:50.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.165+0000 7fe35967a640 1 -- 172.21.15.28:0/4278015570 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe334005510 con 0x7fe354140c20 2023-11-16T02:29:50.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.165+0000 7fde7fe8d640 1 -- 172.21.15.28:0/2340794105 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fde5c065b30 msgr2=0x7fde5c067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.165+0000 7fde7fe8d640 1 --2- 172.21.15.28:0/2340794105 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fde5c065b30 0x7fde5c067ff0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fde740011f0 tx=0x7fde74009040 comp rx=0 tx=0).stop 2023-11-16T02:29:50.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.165+0000 7fe33b7fe640 1 -- 172.21.15.28:0/4278015570 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe344053da0 con 0x7fe354140c20 2023-11-16T02:29:50.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.165+0000 7fbd8affd640 1 -- 172.21.15.28:0/273466134 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbd94057070 con 0x7fbd9c0b5e50 2023-11-16T02:29:50.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.165+0000 7fde7fe8d640 1 -- 172.21.15.28:0/2340794105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde78140c20 msgr2=0x7fde7814b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.171 INFO:teuthology.orchestra.run.smithi028.stdout:64424509447 2023-11-16T02:29:50.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.165+0000 7fde7fe8d640 1 --2- 172.21.15.28:0/2340794105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde78140c20 0x7fde7814b3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fde70007210 tx=0x7fde70020520 comp rx=0 tx=0).stop 2023-11-16T02:29:50.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.165+0000 7fde7fe8d640 1 -- 172.21.15.28:0/2340794105 shutdown_connections 2023-11-16T02:29:50.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.165+0000 7fde7fe8d640 1 --2- 172.21.15.28:0/2340794105 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fde5c065b30 0x7fde5c067ff0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.165+0000 7fde7fe8d640 1 --2- 172.21.15.28:0/2340794105 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde7814f300 0x7fde78070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.165+0000 7fde7fe8d640 1 --2- 172.21.15.28:0/2340794105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde78140c20 0x7fde7814b3c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.165+0000 7fde7fe8d640 1 --2- 172.21.15.28:0/2340794105 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fde780b5e50 0x7fde781e39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.165+0000 7fde7fe8d640 1 -- 172.21.15.28:0/2340794105 >> 172.21.15.28:0/2340794105 conn(0x7fde780b8890 msgr2=0x7fde780b9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:50.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.169+0000 7fde7fe8d640 1 -- 172.21.15.28:0/2340794105 shutdown_connections 2023-11-16T02:29:50.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.169+0000 7fde7fe8d640 1 -- 172.21.15.28:0/2340794105 wait complete. 2023-11-16T02:29:50.174 INFO:teuthology.orchestra.run.smithi028.stdout:64424509447 2023-11-16T02:29:50.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.173+0000 7fbda09aa640 1 -- 172.21.15.28:0/273466134 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fbd7c065b60 msgr2=0x7fbd7c068020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.173+0000 7fbda09aa640 1 --2- 172.21.15.28:0/273466134 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fbd7c065b60 0x7fbd7c068020 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbd90007fd0 tx=0x7fbd900079a0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.173+0000 7fbda09aa640 1 -- 172.21.15.28:0/273466134 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbd9c0b5e50 msgr2=0x7fbd9c142ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.173+0000 7fbda09aa640 1 --2- 172.21.15.28:0/273466134 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbd9c0b5e50 0x7fbd9c142ef0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400f870 tx=0x7fbd9400fd30 comp rx=0 tx=0).stop 2023-11-16T02:29:50.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.173+0000 7fbda09aa640 1 -- 172.21.15.28:0/273466134 shutdown_connections 2023-11-16T02:29:50.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.173+0000 7fbda09aa640 1 --2- 172.21.15.28:0/273466134 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fbd7c065b60 0x7fbd7c068020 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.173+0000 7fbda09aa640 1 --2- 172.21.15.28:0/273466134 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd9c150310 0x7fbd9c1e6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.173+0000 7fbda09aa640 1 --2- 172.21.15.28:0/273466134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbd9c140c20 0x7fbd9c143430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.173+0000 7fbda09aa640 1 --2- 172.21.15.28:0/273466134 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbd9c0b5e50 0x7fbd9c142ef0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.173+0000 7fbda09aa640 1 -- 172.21.15.28:0/273466134 >> 172.21.15.28:0/273466134 conn(0x7fbd9c0b8890 msgr2=0x7fbd9c0b9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:50.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.173+0000 7fbda09aa640 1 -- 172.21.15.28:0/273466134 shutdown_connections 2023-11-16T02:29:50.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.173+0000 7fbda09aa640 1 -- 172.21.15.28:0/273466134 wait complete. 2023-11-16T02:29:50.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.193+0000 7fe3397fa640 1 -- 172.21.15.28:0/4278015570 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe340065b30 msgr2=0x7fe340067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.193+0000 7fe3397fa640 1 --2- 172.21.15.28:0/4278015570 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe340065b30 0x7fe340067ff0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe348009990 tx=0x7fe348009110 comp rx=0 tx=0).stop 2023-11-16T02:29:50.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.193+0000 7fe3397fa640 1 -- 172.21.15.28:0/4278015570 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe354140c20 msgr2=0x7fe354149560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.193+0000 7fe3397fa640 1 --2- 172.21.15.28:0/4278015570 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe354140c20 0x7fe354149560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe34400c440 tx=0x7fe34400c900 comp rx=0 tx=0).stop 2023-11-16T02:29:50.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.193+0000 7fe3397fa640 1 -- 172.21.15.28:0/4278015570 shutdown_connections 2023-11-16T02:29:50.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.193+0000 7fe3397fa640 1 --2- 172.21.15.28:0/4278015570 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe340065b30 0x7fe340067ff0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.193+0000 7fe3397fa640 1 --2- 172.21.15.28:0/4278015570 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe354140c20 0x7fe354149560 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.193+0000 7fe3397fa640 1 --2- 172.21.15.28:0/4278015570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe3540b6790 0x7fe3541dc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.193+0000 7fe3397fa640 1 --2- 172.21.15.28:0/4278015570 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe3540b5e50 0x7fe3541e0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.193+0000 7fe3397fa640 1 -- 172.21.15.28:0/4278015570 >> 172.21.15.28:0/4278015570 conn(0x7fe3540b8890 msgr2=0x7fe3540b9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:50.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.193+0000 7fe3397fa640 1 -- 172.21.15.28:0/4278015570 shutdown_connections 2023-11-16T02:29:50.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.193+0000 7fe3397fa640 1 -- 172.21.15.28:0/4278015570 wait complete. 2023-11-16T02:29:50.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.2 2023-11-16T02:29:50.199 DEBUG:teuthology.parallel:result is None 2023-11-16T02:29:50.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.1 2023-11-16T02:29:50.203 DEBUG:teuthology.parallel:result is None 2023-11-16T02:29:50.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.209+0000 7f13e5aa2640 1 -- 172.21.15.28:0/299946140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f13e0061980 con 0x7f13e00b67e0 2023-11-16T02:29:50.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.209+0000 7f2aceb32640 1 -- 172.21.15.28:0/3412092783 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f2ac0038320 con 0x7f2ac0007220 2023-11-16T02:29:50.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.209+0000 7f13dd7fa640 1 -- 172.21.15.28:0/299946140 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f13cc01b070 con 0x7f13e00b67e0 2023-11-16T02:29:50.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.209+0000 7f2abe7fc640 1 -- 172.21.15.28:0/3412092783 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2ac40c3090 con 0x7f2ac0007220 2023-11-16T02:29:50.215 INFO:teuthology.orchestra.run.smithi028.stdout:64424509448 2023-11-16T02:29:50.215 INFO:teuthology.orchestra.run.smithi028.stdout:64424509448 2023-11-16T02:29:50.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.213+0000 7f2aceb32640 1 -- 172.21.15.28:0/3412092783 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2aac065a60 msgr2=0x7f2aac067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.213+0000 7f2aceb32640 1 --2- 172.21.15.28:0/3412092783 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2aac065a60 0x7f2aac067f20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8007fd0 tx=0x7f2ab8009040 comp rx=0 tx=0).stop 2023-11-16T02:29:50.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.213+0000 7f2aceb32640 1 -- 172.21.15.28:0/3412092783 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ac0007220 msgr2=0x7f2ac00cc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.213+0000 7f2aceb32640 1 --2- 172.21.15.28:0/3412092783 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ac0007220 0x7f2ac00cc840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2ac401f830 tx=0x7f2ac401f9c0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.213+0000 7f2aceb32640 1 -- 172.21.15.28:0/3412092783 shutdown_connections 2023-11-16T02:29:50.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.213+0000 7f2aceb32640 1 --2- 172.21.15.28:0/3412092783 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2aac065a60 0x7f2aac067f20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.213+0000 7f2aceb32640 1 --2- 172.21.15.28:0/3412092783 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2ac00c7170 0x7f2ac00cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.213+0000 7f2aceb32640 1 --2- 172.21.15.28:0/3412092783 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2ac0007220 0x7f2ac00cc840 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.213+0000 7f2aceb32640 1 --2- 172.21.15.28:0/3412092783 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ac0006e40 0x7f2ac0030070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.213+0000 7f2aceb32640 1 -- 172.21.15.28:0/3412092783 >> 172.21.15.28:0/3412092783 conn(0x7f2ac0005ed0 msgr2=0x7f2ac00376b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:50.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.213+0000 7f2aceb32640 1 -- 172.21.15.28:0/3412092783 shutdown_connections 2023-11-16T02:29:50.222 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.213+0000 7f13e5aa2640 1 -- 172.21.15.28:0/299946140 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f13c4065b60 msgr2=0x7f13c4068020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.222 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.213+0000 7f13e5aa2640 1 --2- 172.21.15.28:0/299946140 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f13c4065b60 0x7f13c4068020 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f13e00b3d80 tx=0x7f13d4009040 comp rx=0 tx=0).stop 2023-11-16T02:29:50.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.213+0000 7f13e5aa2640 1 -- 172.21.15.28:0/299946140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13e00b67e0 msgr2=0x7f13e014af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.213+0000 7f13e5aa2640 1 --2- 172.21.15.28:0/299946140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13e00b67e0 0x7f13e014af90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f13cc00bb50 tx=0x7f13cc00f480 comp rx=0 tx=0).stop 2023-11-16T02:29:50.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.213+0000 7f2aceb32640 1 -- 172.21.15.28:0/3412092783 wait complete. 2023-11-16T02:29:50.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.213+0000 7f13e5aa2640 1 -- 172.21.15.28:0/299946140 shutdown_connections 2023-11-16T02:29:50.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.213+0000 7f13e5aa2640 1 --2- 172.21.15.28:0/299946140 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f13c4065b60 0x7f13c4068020 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.213+0000 7f13e5aa2640 1 --2- 172.21.15.28:0/299946140 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f13e014f3c0 0x7f13e01e0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.213+0000 7f13e5aa2640 1 --2- 172.21.15.28:0/299946140 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f13e0140ed0 0x7f13e01e0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.213+0000 7f13e5aa2640 1 --2- 172.21.15.28:0/299946140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13e00b67e0 0x7f13e014af90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.213+0000 7f13e5aa2640 1 -- 172.21.15.28:0/299946140 >> 172.21.15.28:0/299946140 conn(0x7f13e00b88e0 msgr2=0x7f13e00bb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:50.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.213+0000 7f13e5aa2640 1 -- 172.21.15.28:0/299946140 shutdown_connections 2023-11-16T02:29:50.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.213+0000 7f13e5aa2640 1 -- 172.21.15.28:0/299946140 wait complete. 2023-11-16T02:29:50.226 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.217+0000 7ff1540c2640 1 -- 172.21.15.28:0/3623592730 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff1340057e0 con 0x7ff14c1dcb10 2023-11-16T02:29:50.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.3 2023-11-16T02:29:50.228 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.217+0000 7ff1427fc640 1 -- 172.21.15.28:0/3623592730 <== mon.2 v2:172.21.15.70:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff1480b0090 con 0x7ff14c1dcb10 2023-11-16T02:29:50.229 INFO:teuthology.orchestra.run.smithi028.stdout:64424509448 2023-11-16T02:29:50.229 DEBUG:teuthology.parallel:result is None 2023-11-16T02:29:50.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.221+0000 7ff1540c2640 1 -- 172.21.15.28:0/3623592730 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff130065a90 msgr2=0x7ff130067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.221+0000 7ff1540c2640 1 --2- 172.21.15.28:0/3623592730 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff130065a90 0x7ff130067f50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff13c006fd0 tx=0x7ff13c0090e0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.221+0000 7ff1540c2640 1 -- 172.21.15.28:0/3623592730 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff14c1dcb10 msgr2=0x7ff14c1de090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.221+0000 7ff1540c2640 1 --2- 172.21.15.28:0/3623592730 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff14c1dcb10 0x7ff14c1de090 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff14801cb40 tx=0x7ff14801aae0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.221+0000 7ff1540c2640 1 -- 172.21.15.28:0/3623592730 shutdown_connections 2023-11-16T02:29:50.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.221+0000 7ff1540c2640 1 --2- 172.21.15.28:0/3623592730 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff130065a90 0x7ff130067f50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.221+0000 7ff1540c2640 1 --2- 172.21.15.28:0/3623592730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff14c1e7fa0 0x7ff14c1e8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.221+0000 7ff1540c2640 1 --2- 172.21.15.28:0/3623592730 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff14c1dcb10 0x7ff14c1de090 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.221+0000 7ff1540c2640 1 --2- 172.21.15.28:0/3623592730 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff14c06ffd0 0x7ff14c1defb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.221+0000 7ff1540c2640 1 -- 172.21.15.28:0/3623592730 >> 172.21.15.28:0/3623592730 conn(0x7ff14c06de20 msgr2=0x7ff14c0b5070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:50.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.221+0000 7ff1540c2640 1 -- 172.21.15.28:0/3623592730 shutdown_connections 2023-11-16T02:29:50.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.221+0000 7ff1540c2640 1 -- 172.21.15.28:0/3623592730 wait complete. 2023-11-16T02:29:50.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.233+0000 7f68d164f640 1 -- 172.21.15.28:0/2052618550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f68ac0050d0 con 0x7f68cc0b9c80 2023-11-16T02:29:50.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.233+0000 7f68c8ff9640 1 -- 172.21.15.28:0/2052618550 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f68c00eef70 con 0x7f68cc0b9c80 2023-11-16T02:29:50.238 INFO:teuthology.orchestra.run.smithi028.stdout:64424509448 2023-11-16T02:29:50.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.237+0000 7f68d164f640 1 -- 172.21.15.28:0/2052618550 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f68b8065a60 msgr2=0x7f68b8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.237+0000 7f68d164f640 1 --2- 172.21.15.28:0/2052618550 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f68b8065a60 0x7f68b8067f20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f68bc000f70 tx=0x7f68bc009040 comp rx=0 tx=0).stop 2023-11-16T02:29:50.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.237+0000 7f68d164f640 1 -- 172.21.15.28:0/2052618550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68cc0b9c80 msgr2=0x7f68cc0a7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.237+0000 7f68d164f640 1 --2- 172.21.15.28:0/2052618550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68cc0b9c80 0x7f68cc0a7a80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f68c00ac000 tx=0x7f68c001ada0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.237+0000 7f68d164f640 1 -- 172.21.15.28:0/2052618550 shutdown_connections 2023-11-16T02:29:50.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.237+0000 7f68d164f640 1 --2- 172.21.15.28:0/2052618550 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f68b8065a60 0x7f68b8067f20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.237+0000 7f68d164f640 1 --2- 172.21.15.28:0/2052618550 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f68cc153110 0x7f68cc0a7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.237+0000 7f68d164f640 1 --2- 172.21.15.28:0/2052618550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68cc0b9c80 0x7f68cc0a7a80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.237+0000 7f68d164f640 1 --2- 172.21.15.28:0/2052618550 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f68cc0b7150 0x7f68cc1f3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.237+0000 7f68d164f640 1 -- 172.21.15.28:0/2052618550 >> 172.21.15.28:0/2052618550 conn(0x7f68cc06b050 msgr2=0x7f68cc13dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:50.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.237+0000 7f68d164f640 1 -- 172.21.15.28:0/2052618550 shutdown_connections 2023-11-16T02:29:50.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.237+0000 7f68d164f640 1 -- 172.21.15.28:0/2052618550 wait complete. 2023-11-16T02:29:50.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.4 2023-11-16T02:29:50.246 DEBUG:teuthology.parallel:result is None 2023-11-16T02:29:50.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.6 2023-11-16T02:29:50.247 DEBUG:teuthology.parallel:result is None 2023-11-16T02:29:50.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.5 2023-11-16T02:29:50.253 DEBUG:teuthology.parallel:result is None 2023-11-16T02:29:50.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.257+0000 7fbf5891e640 1 -- 172.21.15.28:0/381681414 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbf541509b0 con 0x7fbf540ba180 2023-11-16T02:29:50.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.7 2023-11-16T02:29:50.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.257+0000 7fbf3b7fe640 1 -- 172.21.15.28:0/381681414 <== mon.1 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbf541509b0 con 0x7fbf540ba180 2023-11-16T02:29:50.260 INFO:teuthology.orchestra.run.smithi028.stdout:64424509447 2023-11-16T02:29:50.260 DEBUG:teuthology.parallel:result is None 2023-11-16T02:29:50.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.257+0000 7fbf5891e640 1 -- 172.21.15.28:0/381681414 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fbf40065a90 msgr2=0x7fbf40067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.257+0000 7fbf5891e640 1 --2- 172.21.15.28:0/381681414 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fbf40065a90 0x7fbf40067f50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbf440af000 tx=0x7fbf44008040 comp rx=0 tx=0).stop 2023-11-16T02:29:50.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.257+0000 7fbf5891e640 1 -- 172.21.15.28:0/381681414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf540ba180 msgr2=0x7fbf5413ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.257+0000 7fbf5891e640 1 --2- 172.21.15.28:0/381681414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf540ba180 0x7fbf5413ad80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbf4800c3f0 tx=0x7fbf4800c8b0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.257+0000 7fbf5891e640 1 -- 172.21.15.28:0/381681414 shutdown_connections 2023-11-16T02:29:50.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.257+0000 7fbf5891e640 1 --2- 172.21.15.28:0/381681414 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fbf40065a90 0x7fbf40067f50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.257+0000 7fbf5891e640 1 --2- 172.21.15.28:0/381681414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf540ba180 0x7fbf5413ad80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.257+0000 7fbf5891e640 1 --2- 172.21.15.28:0/381681414 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fbf540b8450 0x7fbf540b9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.257+0000 7fbf5891e640 1 --2- 172.21.15.28:0/381681414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbf540b7da0 0x7fbf5412e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.257+0000 7fbf5891e640 1 -- 172.21.15.28:0/381681414 >> 172.21.15.28:0/381681414 conn(0x7fbf5406b850 msgr2=0x7fbf54147400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:50.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.257+0000 7fbf5891e640 1 -- 172.21.15.28:0/381681414 shutdown_connections 2023-11-16T02:29:50.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.257+0000 7fbf5891e640 1 -- 172.21.15.28:0/381681414 wait complete. 2023-11-16T02:29:50.277 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.0 2023-11-16T02:29:50.277 DEBUG:teuthology.parallel:result is None 2023-11-16T02:29:50.277 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-16T02:29:50.277 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-16T02:29:50.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.425+0000 7fab2e7d1640 1 Processor -- start 2023-11-16T02:29:50.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.425+0000 7fab2e7d1640 1 -- start start 2023-11-16T02:29:50.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.425+0000 7fab2e7d1640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fab280b8240 0x7fab280bc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:50.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.429+0000 7fab2e7d1640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fab280b3b60 0x7fab28148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:50.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.429+0000 7fab2e7d1640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab280b52b0 con 0x7fab28148960 2023-11-16T02:29:50.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.429+0000 7fab2e7d1640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab280b6220 con 0x7fab280b3b60 2023-11-16T02:29:50.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.429+0000 7fab2e7d1640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab280b4040 con 0x7fab280b8240 2023-11-16T02:29:50.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.429+0000 7fab2cd6e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fab280b3b60 0x7fab28148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:50.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.429+0000 7fab2cd6e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fab280b3b60 0x7fab28148dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47096/0 (socket says 172.21.15.28:47096) 2023-11-16T02:29:50.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.429+0000 7fab2cd6e640 1 -- 172.21.15.28:0/1750425026 learned_addr learned my addr 172.21.15.28:0/1750425026 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:50.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.429+0000 7fab2cd6e640 1 -- 172.21.15.28:0/1750425026 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fab280b8240 msgr2=0x7fab280bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:50.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.429+0000 7fab2cd6e640 1 --2- 172.21.15.28:0/1750425026 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fab280b8240 0x7fab280bc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.429+0000 7fab2cd6e640 1 -- 172.21.15.28:0/1750425026 >> v1:172.21.15.70:6789/0 conn(0x7fab28148960 legacy=0x7fab280b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:50.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.429+0000 7fab2cd6e640 1 -- 172.21.15.28:0/1750425026 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab280b5a20 con 0x7fab280b3b60 2023-11-16T02:29:50.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.429+0000 7fab2cd6e640 1 --2- 172.21.15.28:0/1750425026 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab280b3b60 0x7fab28148dc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fab18009e50 tx=0x7fab1801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8218ebf35bf3de3b server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:50.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.429+0000 7fab26ffd640 1 -- 172.21.15.28:0/1750425026 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab180a5730 con 0x7fab280b3b60 2023-11-16T02:29:50.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.429+0000 7fab26ffd640 1 -- 172.21.15.28:0/1750425026 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab180a5890 con 0x7fab280b3b60 2023-11-16T02:29:50.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.429+0000 7fab26ffd640 1 -- 172.21.15.28:0/1750425026 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab180a5c20 con 0x7fab280b3b60 2023-11-16T02:29:50.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.429+0000 7fab2e7d1640 1 -- 172.21.15.28:0/1750425026 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab280b3b60 msgr2=0x7fab28148dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.429+0000 7fab2e7d1640 1 --2- 172.21.15.28:0/1750425026 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab280b3b60 0x7fab28148dc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fab18009e50 tx=0x7fab1801c9a0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.429+0000 7fab2e7d1640 1 -- 172.21.15.28:0/1750425026 shutdown_connections 2023-11-16T02:29:50.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.429+0000 7fab2e7d1640 1 --2- 172.21.15.28:0/1750425026 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab280b3b60 0x7fab28148dc0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.429+0000 7fab2e7d1640 1 --2- 172.21.15.28:0/1750425026 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fab280b8240 0x7fab280bc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.429+0000 7fab2e7d1640 1 -- 172.21.15.28:0/1750425026 >> 172.21.15.28:0/1750425026 conn(0x7fab280b9050 msgr2=0x7fab280bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:50.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.429+0000 7fab2e7d1640 1 -- 172.21.15.28:0/1750425026 shutdown_connections 2023-11-16T02:29:50.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.429+0000 7fab2e7d1640 1 -- 172.21.15.28:0/1750425026 wait complete. 2023-11-16T02:29:50.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab2e7d1640 1 Processor -- start 2023-11-16T02:29:50.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab2e7d1640 1 -- start start 2023-11-16T02:29:50.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab2e7d1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab280b3b60 0x7fab2806f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:50.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab2e7d1640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fab280b8240 0x7fab28136f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:50.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab2e7d1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab28148960 0x7fab281e2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:50.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab2e7d1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab28147650 con 0x7fab28148960 2023-11-16T02:29:50.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab2e7d1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab28146d20 con 0x7fab280b3b60 2023-11-16T02:29:50.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab2e7d1640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab28147000 con 0x7fab280b8240 2023-11-16T02:29:50.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab2cd6e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab28148960 0x7fab281e2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:50.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab2cd6e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab28148960 0x7fab281e2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47100/0 (socket says 172.21.15.28:47100) 2023-11-16T02:29:50.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab2cd6e640 1 -- 172.21.15.28:0/366156500 learned_addr learned my addr 172.21.15.28:0/366156500 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:50.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab277fe640 1 --2- 172.21.15.28:0/366156500 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fab280b8240 0x7fab28136f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:50.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab27fff640 1 --2- 172.21.15.28:0/366156500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab280b3b60 0x7fab2806f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:50.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab2cd6e640 1 -- 172.21.15.28:0/366156500 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fab280b8240 msgr2=0x7fab28136f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab2cd6e640 1 --2- 172.21.15.28:0/366156500 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fab280b8240 0x7fab28136f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab2cd6e640 1 -- 172.21.15.28:0/366156500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab280b3b60 msgr2=0x7fab2806f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab2cd6e640 1 --2- 172.21.15.28:0/366156500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab280b3b60 0x7fab2806f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab2cd6e640 1 -- 172.21.15.28:0/366156500 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab18009b30 con 0x7fab28148960 2023-11-16T02:29:50.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab2cd6e640 1 --2- 172.21.15.28:0/366156500 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab28148960 0x7fab281e2e70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fab180af040 tx=0x7fab18019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:50.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab24ff9640 1 -- 172.21.15.28:0/366156500 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab180b8670 con 0x7fab28148960 2023-11-16T02:29:50.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab24ff9640 1 -- 172.21.15.28:0/366156500 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab180b87d0 con 0x7fab28148960 2023-11-16T02:29:50.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab2e7d1640 1 -- 172.21.15.28:0/366156500 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab281472e0 con 0x7fab28148960 2023-11-16T02:29:50.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab24ff9640 1 -- 172.21.15.28:0/366156500 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab180b8b80 con 0x7fab28148960 2023-11-16T02:29:50.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab2e7d1640 1 -- 172.21.15.28:0/366156500 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab28139e50 con 0x7fab28148960 2023-11-16T02:29:50.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab2e7d1640 1 -- 172.21.15.28:0/366156500 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab28139fe0 con 0x7fab28148960 2023-11-16T02:29:50.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab24ff9640 1 -- 172.21.15.28:0/366156500 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fab180b8ce0 con 0x7fab28148960 2023-11-16T02:29:50.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.433+0000 7fab24ff9640 1 --2- 172.21.15.28:0/366156500 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fab08065a60 0x7fab08067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:50.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.437+0000 7fab24ff9640 1 -- 172.21.15.28:0/366156500 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab1811e920 con 0x7fab28148960 2023-11-16T02:29:50.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.437+0000 7fab27fff640 1 --2- 172.21.15.28:0/366156500 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fab08065a60 0x7fab08067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:50.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.437+0000 7fab27fff640 1 --2- 172.21.15.28:0/366156500 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fab08065a60 0x7fab08067f20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fab20006fd0 tx=0x7fab20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:50.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.437+0000 7fab24ff9640 1 -- 172.21.15.28:0/366156500 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fab180ec490 con 0x7fab28148960 2023-11-16T02:29:50.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.589+0000 7fab2e7d1640 1 -- 172.21.15.28:0/366156500 --> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fab28155ac0 con 0x7fab08065a60 2023-11-16T02:29:50.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.601+0000 7fab24ff9640 1 -- 172.21.15.28:0/366156500 <== mgr.4104 v2:172.21.15.28:6832/38651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264410 (secure 0 0 0) 0x7fab20009e20 con 0x7fab08065a60 2023-11-16T02:29:50.606 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:50.608 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-11-16T02:29:50.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.605+0000 7fab2e7d1640 1 -- 172.21.15.28:0/366156500 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fab08065a60 msgr2=0x7fab08067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.605+0000 7fab2e7d1640 1 --2- 172.21.15.28:0/366156500 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fab08065a60 0x7fab08067f20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fab20006fd0 tx=0x7fab20008040 comp rx=0 tx=0).stop 2023-11-16T02:29:50.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.605+0000 7fab2e7d1640 1 -- 172.21.15.28:0/366156500 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab28148960 msgr2=0x7fab281e2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.605+0000 7fab2e7d1640 1 --2- 172.21.15.28:0/366156500 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab28148960 0x7fab281e2e70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fab180af040 tx=0x7fab18019740 comp rx=0 tx=0).stop 2023-11-16T02:29:50.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.605+0000 7fab2e7d1640 1 -- 172.21.15.28:0/366156500 shutdown_connections 2023-11-16T02:29:50.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.605+0000 7fab2e7d1640 1 --2- 172.21.15.28:0/366156500 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fab08065a60 0x7fab08067f20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.605+0000 7fab2e7d1640 1 --2- 172.21.15.28:0/366156500 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab28148960 0x7fab281e2e70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.605+0000 7fab2e7d1640 1 --2- 172.21.15.28:0/366156500 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fab280b8240 0x7fab28136f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.605+0000 7fab2e7d1640 1 --2- 172.21.15.28:0/366156500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab280b3b60 0x7fab2806f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.605+0000 7fab2e7d1640 1 -- 172.21.15.28:0/366156500 >> 172.21.15.28:0/366156500 conn(0x7fab280b9050 msgr2=0x7fab28141e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:50.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.605+0000 7fab2e7d1640 1 -- 172.21.15.28:0/366156500 shutdown_connections 2023-11-16T02:29:50.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.605+0000 7fab2e7d1640 1 -- 172.21.15.28:0/366156500 wait complete. 2023-11-16T02:29:50.625 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-11-16T02:29:50.419711+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":251336,"kb_used_data":2952,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754723384,"statfs":{"total":773094113280,"available":772836745216,"internally_reserved":0,"allocated":3022848,"data_stored":1795380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.544320"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893446+0000","last_change":"2023-11-16T02:29:37.934110+0000","last_active":"2023-11-16T02:29:39.893446+0000","last_peered":"2023-11-16T02:29:39.893446+0000","last_clean":"2023-11-16T02:29:39.893446+0000","last_became_active":"2023-11-16T02:29:37.933578+0000","last_became_peered":"2023-11-16T02:29:37.933578+0000","last_unstale":"2023-11-16T02:29:39.893446+0000","last_undegraded":"2023-11-16T02:29:39.893446+0000","last_fullsized":"2023-11-16T02:29:39.893446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:40:54.967365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879002+0000","last_change":"2023-11-16T02:29:37.889075+0000","last_active":"2023-11-16T02:29:38.879002+0000","last_peered":"2023-11-16T02:29:38.879002+0000","last_clean":"2023-11-16T02:29:38.879002+0000","last_became_active":"2023-11-16T02:29:37.888736+0000","last_became_peered":"2023-11-16T02:29:37.888736+0000","last_unstale":"2023-11-16T02:29:38.879002+0000","last_undegraded":"2023-11-16T02:29:38.879002+0000","last_fullsized":"2023-11-16T02:29:38.879002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:25:48.005968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892513+0000","last_change":"2023-11-16T02:29:37.888531+0000","last_active":"2023-11-16T02:29:39.892513+0000","last_peered":"2023-11-16T02:29:39.892513+0000","last_clean":"2023-11-16T02:29:39.892513+0000","last_became_active":"2023-11-16T02:29:37.888011+0000","last_became_peered":"2023-11-16T02:29:37.888011+0000","last_unstale":"2023-11-16T02:29:39.892513+0000","last_undegraded":"2023-11-16T02:29:39.892513+0000","last_fullsized":"2023-11-16T02:29:39.892513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:27:01.501132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879881+0000","last_change":"2023-11-16T02:29:37.933231+0000","last_active":"2023-11-16T02:29:38.879881+0000","last_peered":"2023-11-16T02:29:38.879881+0000","last_clean":"2023-11-16T02:29:38.879881+0000","last_became_active":"2023-11-16T02:29:37.932560+0000","last_became_peered":"2023-11-16T02:29:37.932560+0000","last_unstale":"2023-11-16T02:29:38.879881+0000","last_undegraded":"2023-11-16T02:29:38.879881+0000","last_fullsized":"2023-11-16T02:29:38.879881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:40:54.967365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893326+0000","last_change":"2023-11-16T02:29:37.924836+0000","last_active":"2023-11-16T02:29:39.893326+0000","last_peered":"2023-11-16T02:29:39.893326+0000","last_clean":"2023-11-16T02:29:39.893326+0000","last_became_active":"2023-11-16T02:29:37.923955+0000","last_became_peered":"2023-11-16T02:29:37.923955+0000","last_unstale":"2023-11-16T02:29:39.893326+0000","last_undegraded":"2023-11-16T02:29:39.893326+0000","last_fullsized":"2023-11-16T02:29:39.893326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:16:52.591980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879892+0000","last_change":"2023-11-16T02:29:37.927564+0000","last_active":"2023-11-16T02:29:38.879892+0000","last_peered":"2023-11-16T02:29:38.879892+0000","last_clean":"2023-11-16T02:29:38.879892+0000","last_became_active":"2023-11-16T02:29:37.925508+0000","last_became_peered":"2023-11-16T02:29:37.925508+0000","last_unstale":"2023-11-16T02:29:38.879892+0000","last_undegraded":"2023-11-16T02:29:38.879892+0000","last_fullsized":"2023-11-16T02:29:38.879892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:53:52.129290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892495+0000","last_change":"2023-11-16T02:29:37.908302+0000","last_active":"2023-11-16T02:29:39.892495+0000","last_peered":"2023-11-16T02:29:39.892495+0000","last_clean":"2023-11-16T02:29:39.892495+0000","last_became_active":"2023-11-16T02:29:37.907469+0000","last_became_peered":"2023-11-16T02:29:37.907469+0000","last_unstale":"2023-11-16T02:29:39.892495+0000","last_undegraded":"2023-11-16T02:29:39.892495+0000","last_fullsized":"2023-11-16T02:29:39.892495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:30:42.074843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891934+0000","last_change":"2023-11-16T02:29:37.936720+0000","last_active":"2023-11-16T02:29:39.891934+0000","last_peered":"2023-11-16T02:29:39.891934+0000","last_clean":"2023-11-16T02:29:39.891934+0000","last_became_active":"2023-11-16T02:29:37.936424+0000","last_became_peered":"2023-11-16T02:29:37.936424+0000","last_unstale":"2023-11-16T02:29:39.891934+0000","last_undegraded":"2023-11-16T02:29:39.891934+0000","last_fullsized":"2023-11-16T02:29:39.891934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:53:52.129290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893619+0000","last_change":"2023-11-16T02:29:37.941366+0000","last_active":"2023-11-16T02:29:39.893619+0000","last_peered":"2023-11-16T02:29:39.893619+0000","last_clean":"2023-11-16T02:29:39.893619+0000","last_became_active":"2023-11-16T02:29:37.940672+0000","last_became_peered":"2023-11-16T02:29:37.940672+0000","last_unstale":"2023-11-16T02:29:39.893619+0000","last_undegraded":"2023-11-16T02:29:39.893619+0000","last_fullsized":"2023-11-16T02:29:39.893619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:45:26.924071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881259+0000","last_change":"2023-11-16T02:29:37.925689+0000","last_active":"2023-11-16T02:29:38.881259+0000","last_peered":"2023-11-16T02:29:38.881259+0000","last_clean":"2023-11-16T02:29:38.881259+0000","last_became_active":"2023-11-16T02:29:37.925132+0000","last_became_peered":"2023-11-16T02:29:37.925132+0000","last_unstale":"2023-11-16T02:29:38.881259+0000","last_undegraded":"2023-11-16T02:29:38.881259+0000","last_fullsized":"2023-11-16T02:29:38.881259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:16:58.785873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880724+0000","last_change":"2023-11-16T02:29:37.927099+0000","last_active":"2023-11-16T02:29:38.880724+0000","last_peered":"2023-11-16T02:29:38.880724+0000","last_clean":"2023-11-16T02:29:38.880724+0000","last_became_active":"2023-11-16T02:29:37.926533+0000","last_became_peered":"2023-11-16T02:29:37.926533+0000","last_unstale":"2023-11-16T02:29:38.880724+0000","last_undegraded":"2023-11-16T02:29:38.880724+0000","last_fullsized":"2023-11-16T02:29:38.880724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:43:20.665096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893022+0000","last_change":"2023-11-16T02:29:37.902388+0000","last_active":"2023-11-16T02:29:39.893022+0000","last_peered":"2023-11-16T02:29:39.893022+0000","last_clean":"2023-11-16T02:29:39.893022+0000","last_became_active":"2023-11-16T02:29:37.901626+0000","last_became_peered":"2023-11-16T02:29:37.901626+0000","last_unstale":"2023-11-16T02:29:39.893022+0000","last_undegraded":"2023-11-16T02:29:39.893022+0000","last_fullsized":"2023-11-16T02:29:39.893022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:09:39.001233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891187+0000","last_change":"2023-11-16T02:29:37.907449+0000","last_active":"2023-11-16T02:29:39.891187+0000","last_peered":"2023-11-16T02:29:39.891187+0000","last_clean":"2023-11-16T02:29:39.891187+0000","last_became_active":"2023-11-16T02:29:37.907166+0000","last_became_peered":"2023-11-16T02:29:37.907166+0000","last_unstale":"2023-11-16T02:29:39.891187+0000","last_undegraded":"2023-11-16T02:29:39.891187+0000","last_fullsized":"2023-11-16T02:29:39.891187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:37:34.233429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891915+0000","last_change":"2023-11-16T02:29:37.892022+0000","last_active":"2023-11-16T02:29:39.891915+0000","last_peered":"2023-11-16T02:29:39.891915+0000","last_clean":"2023-11-16T02:29:39.891915+0000","last_became_active":"2023-11-16T02:29:37.891566+0000","last_became_peered":"2023-11-16T02:29:37.891566+0000","last_unstale":"2023-11-16T02:29:39.891915+0000","last_undegraded":"2023-11-16T02:29:39.891915+0000","last_fullsized":"2023-11-16T02:29:39.891915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:06:12.705211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878687+0000","last_change":"2023-11-16T02:29:37.924750+0000","last_active":"2023-11-16T02:29:38.878687+0000","last_peered":"2023-11-16T02:29:38.878687+0000","last_clean":"2023-11-16T02:29:38.878687+0000","last_became_active":"2023-11-16T02:29:37.924471+0000","last_became_peered":"2023-11-16T02:29:37.924471+0000","last_unstale":"2023-11-16T02:29:38.878687+0000","last_undegraded":"2023-11-16T02:29:38.878687+0000","last_fullsized":"2023-11-16T02:29:38.878687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:43:20.665096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879402+0000","last_change":"2023-11-16T02:29:37.912953+0000","last_active":"2023-11-16T02:29:38.879402+0000","last_peered":"2023-11-16T02:29:38.879402+0000","last_clean":"2023-11-16T02:29:38.879402+0000","last_became_active":"2023-11-16T02:29:37.912132+0000","last_became_peered":"2023-11-16T02:29:37.912132+0000","last_unstale":"2023-11-16T02:29:38.879402+0000","last_undegraded":"2023-11-16T02:29:38.879402+0000","last_fullsized":"2023-11-16T02:29:38.879402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:52:41.161159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.882380+0000","last_change":"2023-11-16T02:29:37.933833+0000","last_active":"2023-11-16T02:29:38.882380+0000","last_peered":"2023-11-16T02:29:38.882380+0000","last_clean":"2023-11-16T02:29:38.882380+0000","last_became_active":"2023-11-16T02:29:37.933117+0000","last_became_peered":"2023-11-16T02:29:37.933117+0000","last_unstale":"2023-11-16T02:29:38.882380+0000","last_undegraded":"2023-11-16T02:29:38.882380+0000","last_fullsized":"2023-11-16T02:29:38.882380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:16:52.591980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930738+0000","last_change":"2023-11-16T02:29:37.890129+0000","last_active":"2023-11-16T02:29:38.930738+0000","last_peered":"2023-11-16T02:29:38.930738+0000","last_clean":"2023-11-16T02:29:38.930738+0000","last_became_active":"2023-11-16T02:29:37.889784+0000","last_became_peered":"2023-11-16T02:29:37.889784+0000","last_unstale":"2023-11-16T02:29:38.930738+0000","last_undegraded":"2023-11-16T02:29:38.930738+0000","last_fullsized":"2023-11-16T02:29:38.930738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:57:07.831898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893749+0000","last_change":"2023-11-16T02:29:37.916610+0000","last_active":"2023-11-16T02:29:39.893749+0000","last_peered":"2023-11-16T02:29:39.893749+0000","last_clean":"2023-11-16T02:29:39.893749+0000","last_became_active":"2023-11-16T02:29:37.915744+0000","last_became_peered":"2023-11-16T02:29:37.915744+0000","last_unstale":"2023-11-16T02:29:39.893749+0000","last_undegraded":"2023-11-16T02:29:39.893749+0000","last_fullsized":"2023-11-16T02:29:39.893749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:39:21.513129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880946+0000","last_change":"2023-11-16T02:29:37.928237+0000","last_active":"2023-11-16T02:29:38.880946+0000","last_peered":"2023-11-16T02:29:38.880946+0000","last_clean":"2023-11-16T02:29:38.880946+0000","last_became_active":"2023-11-16T02:29:37.927434+0000","last_became_peered":"2023-11-16T02:29:37.927434+0000","last_unstale":"2023-11-16T02:29:38.880946+0000","last_undegraded":"2023-11-16T02:29:38.880946+0000","last_fullsized":"2023-11-16T02:29:38.880946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:37:34.233429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891411+0000","last_change":"2023-11-16T02:29:37.919211+0000","last_active":"2023-11-16T02:29:39.891411+0000","last_peered":"2023-11-16T02:29:39.891411+0000","last_clean":"2023-11-16T02:29:39.891411+0000","last_became_active":"2023-11-16T02:29:37.918942+0000","last_became_peered":"2023-11-16T02:29:37.918942+0000","last_unstale":"2023-11-16T02:29:39.891411+0000","last_undegraded":"2023-11-16T02:29:39.891411+0000","last_fullsized":"2023-11-16T02:29:39.891411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:02:14.259774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879910+0000","last_change":"2023-11-16T02:29:37.926517+0000","last_active":"2023-11-16T02:29:38.879910+0000","last_peered":"2023-11-16T02:29:38.879910+0000","last_clean":"2023-11-16T02:29:38.879910+0000","last_became_active":"2023-11-16T02:29:37.924700+0000","last_became_peered":"2023-11-16T02:29:37.924700+0000","last_unstale":"2023-11-16T02:29:38.879910+0000","last_undegraded":"2023-11-16T02:29:38.879910+0000","last_fullsized":"2023-11-16T02:29:38.879910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:39:21.513129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891489+0000","last_change":"2023-11-16T02:29:37.936251+0000","last_active":"2023-11-16T02:29:39.891489+0000","last_peered":"2023-11-16T02:29:39.891489+0000","last_clean":"2023-11-16T02:29:39.891489+0000","last_became_active":"2023-11-16T02:29:37.935980+0000","last_became_peered":"2023-11-16T02:29:37.935980+0000","last_unstale":"2023-11-16T02:29:39.891489+0000","last_undegraded":"2023-11-16T02:29:39.891489+0000","last_fullsized":"2023-11-16T02:29:39.891489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:02:14.259774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879581+0000","last_change":"2023-11-16T02:29:37.929521+0000","last_active":"2023-11-16T02:29:38.879581+0000","last_peered":"2023-11-16T02:29:38.879581+0000","last_clean":"2023-11-16T02:29:38.879581+0000","last_became_active":"2023-11-16T02:29:37.924137+0000","last_became_peered":"2023-11-16T02:29:37.924137+0000","last_unstale":"2023-11-16T02:29:38.879581+0000","last_undegraded":"2023-11-16T02:29:38.879581+0000","last_fullsized":"2023-11-16T02:29:38.879581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:05:26.649663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892396+0000","last_change":"2023-11-16T02:29:37.935340+0000","last_active":"2023-11-16T02:29:39.892396+0000","last_peered":"2023-11-16T02:29:39.892396+0000","last_clean":"2023-11-16T02:29:39.892396+0000","last_became_active":"2023-11-16T02:29:37.934955+0000","last_became_peered":"2023-11-16T02:29:37.934955+0000","last_unstale":"2023-11-16T02:29:39.892396+0000","last_undegraded":"2023-11-16T02:29:39.892396+0000","last_fullsized":"2023-11-16T02:29:39.892396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:10:43.990221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881491+0000","last_change":"2023-11-16T02:29:37.929426+0000","last_active":"2023-11-16T02:29:38.881491+0000","last_peered":"2023-11-16T02:29:38.881491+0000","last_clean":"2023-11-16T02:29:38.881491+0000","last_became_active":"2023-11-16T02:29:37.928780+0000","last_became_peered":"2023-11-16T02:29:37.928780+0000","last_unstale":"2023-11-16T02:29:38.881491+0000","last_undegraded":"2023-11-16T02:29:38.881491+0000","last_fullsized":"2023-11-16T02:29:38.881491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:05:26.649663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878825+0000","last_change":"2023-11-16T02:29:37.893720+0000","last_active":"2023-11-16T02:29:38.878825+0000","last_peered":"2023-11-16T02:29:38.878825+0000","last_clean":"2023-11-16T02:29:38.878825+0000","last_became_active":"2023-11-16T02:29:37.893429+0000","last_became_peered":"2023-11-16T02:29:37.893429+0000","last_unstale":"2023-11-16T02:29:38.878825+0000","last_undegraded":"2023-11-16T02:29:38.878825+0000","last_fullsized":"2023-11-16T02:29:38.878825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T02:48:20.525493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892100+0000","last_change":"2023-11-16T02:29:37.935318+0000","last_active":"2023-11-16T02:29:39.892100+0000","last_peered":"2023-11-16T02:29:39.892100+0000","last_clean":"2023-11-16T02:29:39.892100+0000","last_became_active":"2023-11-16T02:29:37.934951+0000","last_became_peered":"2023-11-16T02:29:37.934951+0000","last_unstale":"2023-11-16T02:29:39.892100+0000","last_undegraded":"2023-11-16T02:29:39.892100+0000","last_fullsized":"2023-11-16T02:29:39.892100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:16:58.785873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891486+0000","last_change":"2023-11-16T02:29:37.894800+0000","last_active":"2023-11-16T02:29:39.891486+0000","last_peered":"2023-11-16T02:29:39.891486+0000","last_clean":"2023-11-16T02:29:39.891486+0000","last_became_active":"2023-11-16T02:29:37.894404+0000","last_became_peered":"2023-11-16T02:29:37.894404+0000","last_unstale":"2023-11-16T02:29:39.891486+0000","last_undegraded":"2023-11-16T02:29:39.891486+0000","last_fullsized":"2023-11-16T02:29:39.891486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:37:34.233429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880139+0000","last_change":"2023-11-16T02:29:37.920827+0000","last_active":"2023-11-16T02:29:38.880139+0000","last_peered":"2023-11-16T02:29:38.880139+0000","last_clean":"2023-11-16T02:29:38.880139+0000","last_became_active":"2023-11-16T02:29:37.911702+0000","last_became_peered":"2023-11-16T02:29:37.911702+0000","last_unstale":"2023-11-16T02:29:38.880139+0000","last_undegraded":"2023-11-16T02:29:38.880139+0000","last_fullsized":"2023-11-16T02:29:38.880139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:46:36.525784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930582+0000","last_change":"2023-11-16T02:29:37.912688+0000","last_active":"2023-11-16T02:29:38.930582+0000","last_peered":"2023-11-16T02:29:38.930582+0000","last_clean":"2023-11-16T02:29:38.930582+0000","last_became_active":"2023-11-16T02:29:37.912482+0000","last_became_peered":"2023-11-16T02:29:37.912482+0000","last_unstale":"2023-11-16T02:29:38.930582+0000","last_undegraded":"2023-11-16T02:29:38.930582+0000","last_fullsized":"2023-11-16T02:29:38.930582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:36:55.256000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880120+0000","last_change":"2023-11-16T02:29:37.897293+0000","last_active":"2023-11-16T02:29:38.880120+0000","last_peered":"2023-11-16T02:29:38.880120+0000","last_clean":"2023-11-16T02:29:38.880120+0000","last_became_active":"2023-11-16T02:29:37.895087+0000","last_became_peered":"2023-11-16T02:29:37.895087+0000","last_unstale":"2023-11-16T02:29:38.880120+0000","last_undegraded":"2023-11-16T02:29:38.880120+0000","last_fullsized":"2023-11-16T02:29:38.880120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T02:48:20.525493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892526+0000","last_change":"2023-11-16T02:29:37.886782+0000","last_active":"2023-11-16T02:29:39.892526+0000","last_peered":"2023-11-16T02:29:39.892526+0000","last_clean":"2023-11-16T02:29:39.892526+0000","last_became_active":"2023-11-16T02:29:37.885874+0000","last_became_peered":"2023-11-16T02:29:37.885874+0000","last_unstale":"2023-11-16T02:29:39.892526+0000","last_undegraded":"2023-11-16T02:29:39.892526+0000","last_fullsized":"2023-11-16T02:29:39.892526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:21:32.772781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891317+0000","last_change":"2023-11-16T02:29:37.538231+0000","last_active":"2023-11-16T02:29:39.891317+0000","last_peered":"2023-11-16T02:29:39.891317+0000","last_clean":"2023-11-16T02:29:39.891317+0000","last_became_active":"2023-11-16T02:29:37.537831+0000","last_became_peered":"2023-11-16T02:29:37.537831+0000","last_unstale":"2023-11-16T02:29:39.891317+0000","last_undegraded":"2023-11-16T02:29:39.891317+0000","last_fullsized":"2023-11-16T02:29:39.891317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:07:57.498670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891555+0000","last_change":"2023-11-16T02:29:37.928329+0000","last_active":"2023-11-16T02:29:39.891555+0000","last_peered":"2023-11-16T02:29:39.891555+0000","last_clean":"2023-11-16T02:29:39.891555+0000","last_became_active":"2023-11-16T02:29:37.927587+0000","last_became_peered":"2023-11-16T02:29:37.927587+0000","last_unstale":"2023-11-16T02:29:39.891555+0000","last_undegraded":"2023-11-16T02:29:39.891555+0000","last_fullsized":"2023-11-16T02:29:39.891555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:25:48.005968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880624+0000","last_change":"2023-11-16T02:29:37.540421+0000","last_active":"2023-11-16T02:29:38.880624+0000","last_peered":"2023-11-16T02:29:38.880624+0000","last_clean":"2023-11-16T02:29:38.880624+0000","last_became_active":"2023-11-16T02:29:37.539777+0000","last_became_peered":"2023-11-16T02:29:37.539777+0000","last_unstale":"2023-11-16T02:29:38.880624+0000","last_undegraded":"2023-11-16T02:29:38.880624+0000","last_fullsized":"2023-11-16T02:29:38.880624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:07:57.498670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891713+0000","last_change":"2023-11-16T02:29:37.524313+0000","last_active":"2023-11-16T02:29:39.891713+0000","last_peered":"2023-11-16T02:29:39.891713+0000","last_clean":"2023-11-16T02:29:39.891713+0000","last_became_active":"2023-11-16T02:29:37.523846+0000","last_became_peered":"2023-11-16T02:29:37.523846+0000","last_unstale":"2023-11-16T02:29:39.891713+0000","last_undegraded":"2023-11-16T02:29:39.891713+0000","last_fullsized":"2023-11-16T02:29:39.891713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:10:34.206728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892088+0000","last_change":"2023-11-16T02:29:37.885752+0000","last_active":"2023-11-16T02:29:39.892088+0000","last_peered":"2023-11-16T02:29:39.892088+0000","last_clean":"2023-11-16T02:29:39.892088+0000","last_became_active":"2023-11-16T02:29:37.885481+0000","last_became_peered":"2023-11-16T02:29:37.885481+0000","last_unstale":"2023-11-16T02:29:39.892088+0000","last_undegraded":"2023-11-16T02:29:39.892088+0000","last_fullsized":"2023-11-16T02:29:39.892088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:05:12.707357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879852+0000","last_change":"2023-11-16T02:29:37.528549+0000","last_active":"2023-11-16T02:29:38.879852+0000","last_peered":"2023-11-16T02:29:38.879852+0000","last_clean":"2023-11-16T02:29:38.879852+0000","last_became_active":"2023-11-16T02:29:37.527762+0000","last_became_peered":"2023-11-16T02:29:37.527762+0000","last_unstale":"2023-11-16T02:29:38.879852+0000","last_undegraded":"2023-11-16T02:29:38.879852+0000","last_fullsized":"2023-11-16T02:29:38.879852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:45:11.372719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878450+0000","last_change":"2023-11-16T02:29:37.892686+0000","last_active":"2023-11-16T02:29:38.878450+0000","last_peered":"2023-11-16T02:29:38.878450+0000","last_clean":"2023-11-16T02:29:38.878450+0000","last_became_active":"2023-11-16T02:29:37.892384+0000","last_became_peered":"2023-11-16T02:29:37.892384+0000","last_unstale":"2023-11-16T02:29:38.878450+0000","last_undegraded":"2023-11-16T02:29:38.878450+0000","last_fullsized":"2023-11-16T02:29:38.878450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:37:34.233429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880554+0000","last_change":"2023-11-16T02:29:37.545696+0000","last_active":"2023-11-16T02:29:38.880554+0000","last_peered":"2023-11-16T02:29:38.880554+0000","last_clean":"2023-11-16T02:29:38.880554+0000","last_became_active":"2023-11-16T02:29:37.545073+0000","last_became_peered":"2023-11-16T02:29:37.545073+0000","last_unstale":"2023-11-16T02:29:38.880554+0000","last_undegraded":"2023-11-16T02:29:38.880554+0000","last_fullsized":"2023-11-16T02:29:38.880554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:04:23.421210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881635+0000","last_change":"2023-11-16T02:29:37.929853+0000","last_active":"2023-11-16T02:29:38.881635+0000","last_peered":"2023-11-16T02:29:38.881635+0000","last_clean":"2023-11-16T02:29:38.881635+0000","last_became_active":"2023-11-16T02:29:37.929199+0000","last_became_peered":"2023-11-16T02:29:37.929199+0000","last_unstale":"2023-11-16T02:29:38.881635+0000","last_undegraded":"2023-11-16T02:29:38.881635+0000","last_fullsized":"2023-11-16T02:29:38.881635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:30:42.074843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881944+0000","last_change":"2023-11-16T02:29:37.537469+0000","last_active":"2023-11-16T02:29:38.881944+0000","last_peered":"2023-11-16T02:29:38.881944+0000","last_clean":"2023-11-16T02:29:38.881944+0000","last_became_active":"2023-11-16T02:29:37.536939+0000","last_became_peered":"2023-11-16T02:29:37.536939+0000","last_unstale":"2023-11-16T02:29:38.881944+0000","last_undegraded":"2023-11-16T02:29:38.881944+0000","last_fullsized":"2023-11-16T02:29:38.881944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:42:27.512040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891189+0000","last_change":"2023-11-16T02:29:37.928255+0000","last_active":"2023-11-16T02:29:39.891189+0000","last_peered":"2023-11-16T02:29:39.891189+0000","last_clean":"2023-11-16T02:29:39.891189+0000","last_became_active":"2023-11-16T02:29:37.927823+0000","last_became_peered":"2023-11-16T02:29:37.927823+0000","last_unstale":"2023-11-16T02:29:39.891189+0000","last_undegraded":"2023-11-16T02:29:39.891189+0000","last_fullsized":"2023-11-16T02:29:39.891189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:16:58.785873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878823+0000","last_change":"2023-11-16T02:29:37.538934+0000","last_active":"2023-11-16T02:29:38.878823+0000","last_peered":"2023-11-16T02:29:38.878823+0000","last_clean":"2023-11-16T02:29:38.878823+0000","last_became_active":"2023-11-16T02:29:37.538493+0000","last_became_peered":"2023-11-16T02:29:37.538493+0000","last_unstale":"2023-11-16T02:29:38.878823+0000","last_undegraded":"2023-11-16T02:29:38.878823+0000","last_fullsized":"2023-11-16T02:29:38.878823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:38:57.277934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893023+0000","last_change":"2023-11-16T02:29:37.919752+0000","last_active":"2023-11-16T02:29:39.893023+0000","last_peered":"2023-11-16T02:29:39.893023+0000","last_clean":"2023-11-16T02:29:39.893023+0000","last_became_active":"2023-11-16T02:29:37.919021+0000","last_became_peered":"2023-11-16T02:29:37.919021+0000","last_unstale":"2023-11-16T02:29:39.893023+0000","last_undegraded":"2023-11-16T02:29:39.893023+0000","last_fullsized":"2023-11-16T02:29:39.893023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:38:58.288279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881202+0000","last_change":"2023-11-16T02:29:37.512625+0000","last_active":"2023-11-16T02:29:38.881202+0000","last_peered":"2023-11-16T02:29:38.881202+0000","last_clean":"2023-11-16T02:29:38.881202+0000","last_became_active":"2023-11-16T02:29:37.511862+0000","last_became_peered":"2023-11-16T02:29:37.511862+0000","last_unstale":"2023-11-16T02:29:38.881202+0000","last_undegraded":"2023-11-16T02:29:38.881202+0000","last_fullsized":"2023-11-16T02:29:38.881202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:45:11.372719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893382+0000","last_change":"2023-11-16T02:29:37.907846+0000","last_active":"2023-11-16T02:29:39.893382+0000","last_peered":"2023-11-16T02:29:39.893382+0000","last_clean":"2023-11-16T02:29:39.893382+0000","last_became_active":"2023-11-16T02:29:37.906680+0000","last_became_peered":"2023-11-16T02:29:37.906680+0000","last_unstale":"2023-11-16T02:29:39.893382+0000","last_undegraded":"2023-11-16T02:29:39.893382+0000","last_fullsized":"2023-11-16T02:29:39.893382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:46:36.525784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891620+0000","last_change":"2023-11-16T02:29:37.516156+0000","last_active":"2023-11-16T02:29:39.891620+0000","last_peered":"2023-11-16T02:29:39.891620+0000","last_clean":"2023-11-16T02:29:39.891620+0000","last_became_active":"2023-11-16T02:29:37.508947+0000","last_became_peered":"2023-11-16T02:29:37.508947+0000","last_unstale":"2023-11-16T02:29:39.891620+0000","last_undegraded":"2023-11-16T02:29:39.891620+0000","last_fullsized":"2023-11-16T02:29:39.891620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:28:03.017758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892055+0000","last_change":"2023-11-16T02:29:37.917898+0000","last_active":"2023-11-16T02:29:39.892055+0000","last_peered":"2023-11-16T02:29:39.892055+0000","last_clean":"2023-11-16T02:29:39.892055+0000","last_became_active":"2023-11-16T02:29:37.917588+0000","last_became_peered":"2023-11-16T02:29:37.917588+0000","last_unstale":"2023-11-16T02:29:39.892055+0000","last_undegraded":"2023-11-16T02:29:39.892055+0000","last_fullsized":"2023-11-16T02:29:39.892055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:43:20.665096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880128+0000","last_change":"2023-11-16T02:29:37.535755+0000","last_active":"2023-11-16T02:29:38.880128+0000","last_peered":"2023-11-16T02:29:38.880128+0000","last_clean":"2023-11-16T02:29:38.880128+0000","last_became_active":"2023-11-16T02:29:37.535030+0000","last_became_peered":"2023-11-16T02:29:37.535030+0000","last_unstale":"2023-11-16T02:29:38.880128+0000","last_undegraded":"2023-11-16T02:29:38.880128+0000","last_fullsized":"2023-11-16T02:29:38.880128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:10:34.206728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893470+0000","last_change":"2023-11-16T02:29:37.943232+0000","last_active":"2023-11-16T02:29:39.893470+0000","last_peered":"2023-11-16T02:29:39.893470+0000","last_clean":"2023-11-16T02:29:39.893470+0000","last_became_active":"2023-11-16T02:29:37.942561+0000","last_became_peered":"2023-11-16T02:29:37.942561+0000","last_unstale":"2023-11-16T02:29:39.893470+0000","last_undegraded":"2023-11-16T02:29:39.893470+0000","last_fullsized":"2023-11-16T02:29:39.893470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:06:38.108558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880346+0000","last_change":"2023-11-16T02:29:37.540351+0000","last_active":"2023-11-16T02:29:38.880346+0000","last_peered":"2023-11-16T02:29:38.880346+0000","last_clean":"2023-11-16T02:29:38.880346+0000","last_became_active":"2023-11-16T02:29:37.539672+0000","last_became_peered":"2023-11-16T02:29:37.539672+0000","last_unstale":"2023-11-16T02:29:38.880346+0000","last_undegraded":"2023-11-16T02:29:38.880346+0000","last_fullsized":"2023-11-16T02:29:38.880346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:57:02.655084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880380+0000","last_change":"2023-11-16T02:29:37.898389+0000","last_active":"2023-11-16T02:29:38.880380+0000","last_peered":"2023-11-16T02:29:38.880380+0000","last_clean":"2023-11-16T02:29:38.880380+0000","last_became_active":"2023-11-16T02:29:37.896101+0000","last_became_peered":"2023-11-16T02:29:37.896101+0000","last_unstale":"2023-11-16T02:29:38.880380+0000","last_undegraded":"2023-11-16T02:29:38.880380+0000","last_fullsized":"2023-11-16T02:29:38.880380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:27:01.501132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930434+0000","last_change":"2023-11-16T02:29:37.507129+0000","last_active":"2023-11-16T02:29:38.930434+0000","last_peered":"2023-11-16T02:29:38.930434+0000","last_clean":"2023-11-16T02:29:38.930434+0000","last_became_active":"2023-11-16T02:29:37.506617+0000","last_became_peered":"2023-11-16T02:29:37.506617+0000","last_unstale":"2023-11-16T02:29:38.930434+0000","last_undegraded":"2023-11-16T02:29:38.930434+0000","last_fullsized":"2023-11-16T02:29:38.930434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T09:52:00.933962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892753+0000","last_change":"2023-11-16T02:29:37.936934+0000","last_active":"2023-11-16T02:29:39.892753+0000","last_peered":"2023-11-16T02:29:39.892753+0000","last_clean":"2023-11-16T02:29:39.892753+0000","last_became_active":"2023-11-16T02:29:37.936330+0000","last_became_peered":"2023-11-16T02:29:37.936330+0000","last_unstale":"2023-11-16T02:29:39.892753+0000","last_undegraded":"2023-11-16T02:29:39.892753+0000","last_fullsized":"2023-11-16T02:29:39.892753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:10:43.990221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893035+0000","last_change":"2023-11-16T02:29:37.522370+0000","last_active":"2023-11-16T02:29:39.893035+0000","last_peered":"2023-11-16T02:29:39.893035+0000","last_clean":"2023-11-16T02:29:39.893035+0000","last_became_active":"2023-11-16T02:29:37.521575+0000","last_became_peered":"2023-11-16T02:29:37.521575+0000","last_unstale":"2023-11-16T02:29:39.893035+0000","last_undegraded":"2023-11-16T02:29:39.893035+0000","last_fullsized":"2023-11-16T02:29:39.893035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:59:52.538150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.894051+0000","last_change":"2023-11-16T02:29:37.936845+0000","last_active":"2023-11-16T02:29:39.894051+0000","last_peered":"2023-11-16T02:29:39.894051+0000","last_clean":"2023-11-16T02:29:39.894051+0000","last_became_active":"2023-11-16T02:29:37.936190+0000","last_became_peered":"2023-11-16T02:29:37.936190+0000","last_unstale":"2023-11-16T02:29:39.894051+0000","last_undegraded":"2023-11-16T02:29:39.894051+0000","last_fullsized":"2023-11-16T02:29:39.894051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:02:14.259774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930772+0000","last_change":"2023-11-16T02:29:37.513345+0000","last_active":"2023-11-16T02:29:38.930772+0000","last_peered":"2023-11-16T02:29:38.930772+0000","last_clean":"2023-11-16T02:29:38.930772+0000","last_became_active":"2023-11-16T02:29:37.512642+0000","last_became_peered":"2023-11-16T02:29:37.512642+0000","last_unstale":"2023-11-16T02:29:38.930772+0000","last_undegraded":"2023-11-16T02:29:38.930772+0000","last_fullsized":"2023-11-16T02:29:38.930772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:03:19.516009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893760+0000","last_change":"2023-11-16T02:29:37.938095+0000","last_active":"2023-11-16T02:29:39.893760+0000","last_peered":"2023-11-16T02:29:39.893760+0000","last_clean":"2023-11-16T02:29:39.893760+0000","last_became_active":"2023-11-16T02:29:37.937531+0000","last_became_peered":"2023-11-16T02:29:37.937531+0000","last_unstale":"2023-11-16T02:29:39.893760+0000","last_undegraded":"2023-11-16T02:29:39.893760+0000","last_fullsized":"2023-11-16T02:29:39.893760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:53:52.129290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878918+0000","last_change":"2023-11-16T02:29:37.519277+0000","last_active":"2023-11-16T02:29:38.878918+0000","last_peered":"2023-11-16T02:29:38.878918+0000","last_clean":"2023-11-16T02:29:38.878918+0000","last_became_active":"2023-11-16T02:29:37.518833+0000","last_became_peered":"2023-11-16T02:29:37.518833+0000","last_unstale":"2023-11-16T02:29:38.878918+0000","last_undegraded":"2023-11-16T02:29:38.878918+0000","last_fullsized":"2023-11-16T02:29:38.878918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:04:23.421210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881516+0000","last_change":"2023-11-16T02:29:37.916444+0000","last_active":"2023-11-16T02:29:38.881516+0000","last_peered":"2023-11-16T02:29:38.881516+0000","last_clean":"2023-11-16T02:29:38.881516+0000","last_became_active":"2023-11-16T02:29:37.915697+0000","last_became_peered":"2023-11-16T02:29:37.915697+0000","last_unstale":"2023-11-16T02:29:38.881516+0000","last_undegraded":"2023-11-16T02:29:38.881516+0000","last_fullsized":"2023-11-16T02:29:38.881516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:02:14.259774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930777+0000","last_change":"2023-11-16T02:29:37.544475+0000","last_active":"2023-11-16T02:29:38.930777+0000","last_peered":"2023-11-16T02:29:38.930777+0000","last_clean":"2023-11-16T02:29:38.930777+0000","last_became_active":"2023-11-16T02:29:37.544180+0000","last_became_peered":"2023-11-16T02:29:37.544180+0000","last_unstale":"2023-11-16T02:29:38.930777+0000","last_undegraded":"2023-11-16T02:29:38.930777+0000","last_fullsized":"2023-11-16T02:29:38.930777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:24:09.474240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893476+0000","last_change":"2023-11-16T02:29:37.934969+0000","last_active":"2023-11-16T02:29:39.893476+0000","last_peered":"2023-11-16T02:29:39.893476+0000","last_clean":"2023-11-16T02:29:39.893476+0000","last_became_active":"2023-11-16T02:29:37.934382+0000","last_became_peered":"2023-11-16T02:29:37.934382+0000","last_unstale":"2023-11-16T02:29:39.893476+0000","last_undegraded":"2023-11-16T02:29:39.893476+0000","last_fullsized":"2023-11-16T02:29:39.893476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:57:50.326734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":164,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-16T02:29:37.908728+0000","last_change":"2023-11-16T02:29:27.538359+0000","last_active":"2023-11-16T02:29:37.908728+0000","last_peered":"2023-11-16T02:29:37.908728+0000","last_clean":"2023-11-16T02:29:37.908728+0000","last_became_active":"2023-11-16T02:29:27.536606+0000","last_became_peered":"2023-11-16T02:29:27.536606+0000","last_unstale":"2023-11-16T02:29:37.908728+0000","last_undegraded":"2023-11-16T02:29:37.908728+0000","last_fullsized":"2023-11-16T02:29:37.908728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:26.491990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:26.491990+0000","last_clean_scrub_stamp":"2023-11-16T02:29:26.491990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:29:40.434297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879779+0000","last_change":"2023-11-16T02:29:37.529226+0000","last_active":"2023-11-16T02:29:38.879779+0000","last_peered":"2023-11-16T02:29:38.879779+0000","last_clean":"2023-11-16T02:29:38.879779+0000","last_became_active":"2023-11-16T02:29:37.528419+0000","last_became_peered":"2023-11-16T02:29:37.528419+0000","last_unstale":"2023-11-16T02:29:38.879779+0000","last_undegraded":"2023-11-16T02:29:38.879779+0000","last_fullsized":"2023-11-16T02:29:38.879779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:57:02.655084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892100+0000","last_change":"2023-11-16T02:29:37.928597+0000","last_active":"2023-11-16T02:29:39.892100+0000","last_peered":"2023-11-16T02:29:39.892100+0000","last_clean":"2023-11-16T02:29:39.892100+0000","last_became_active":"2023-11-16T02:29:37.928277+0000","last_became_peered":"2023-11-16T02:29:37.928277+0000","last_unstale":"2023-11-16T02:29:39.892100+0000","last_undegraded":"2023-11-16T02:29:39.892100+0000","last_fullsized":"2023-11-16T02:29:39.892100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:46:36.525784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892334+0000","last_change":"2023-11-16T02:29:37.540168+0000","last_active":"2023-11-16T02:29:39.892334+0000","last_peered":"2023-11-16T02:29:39.892334+0000","last_clean":"2023-11-16T02:29:39.892334+0000","last_became_active":"2023-11-16T02:29:37.539604+0000","last_became_peered":"2023-11-16T02:29:37.539604+0000","last_unstale":"2023-11-16T02:29:39.892334+0000","last_undegraded":"2023-11-16T02:29:39.892334+0000","last_fullsized":"2023-11-16T02:29:39.892334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:45:11.372719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.890863+0000","last_change":"2023-11-16T02:29:37.928646+0000","last_active":"2023-11-16T02:29:39.890863+0000","last_peered":"2023-11-16T02:29:39.890863+0000","last_clean":"2023-11-16T02:29:39.890863+0000","last_became_active":"2023-11-16T02:29:37.927520+0000","last_became_peered":"2023-11-16T02:29:37.927520+0000","last_unstale":"2023-11-16T02:29:39.890863+0000","last_undegraded":"2023-11-16T02:29:39.890863+0000","last_fullsized":"2023-11-16T02:29:39.890863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:05:12.707357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930813+0000","last_change":"2023-11-16T02:29:37.508498+0000","last_active":"2023-11-16T02:29:38.930813+0000","last_peered":"2023-11-16T02:29:38.930813+0000","last_clean":"2023-11-16T02:29:38.930813+0000","last_became_active":"2023-11-16T02:29:37.508091+0000","last_became_peered":"2023-11-16T02:29:37.508091+0000","last_unstale":"2023-11-16T02:29:38.930813+0000","last_undegraded":"2023-11-16T02:29:38.930813+0000","last_fullsized":"2023-11-16T02:29:38.930813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:31:57.230585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878450+0000","last_change":"2023-11-16T02:29:37.889506+0000","last_active":"2023-11-16T02:29:38.878450+0000","last_peered":"2023-11-16T02:29:38.878450+0000","last_clean":"2023-11-16T02:29:38.878450+0000","last_became_active":"2023-11-16T02:29:37.884833+0000","last_became_peered":"2023-11-16T02:29:37.884833+0000","last_unstale":"2023-11-16T02:29:38.878450+0000","last_undegraded":"2023-11-16T02:29:38.878450+0000","last_fullsized":"2023-11-16T02:29:38.878450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:05:26.649663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880343+0000","last_change":"2023-11-16T02:29:37.535414+0000","last_active":"2023-11-16T02:29:38.880343+0000","last_peered":"2023-11-16T02:29:38.880343+0000","last_clean":"2023-11-16T02:29:38.880343+0000","last_became_active":"2023-11-16T02:29:37.530060+0000","last_became_peered":"2023-11-16T02:29:37.530060+0000","last_unstale":"2023-11-16T02:29:38.880343+0000","last_undegraded":"2023-11-16T02:29:38.880343+0000","last_fullsized":"2023-11-16T02:29:38.880343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:07:57.498670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.894166+0000","last_change":"2023-11-16T02:29:37.900850+0000","last_active":"2023-11-16T02:29:39.894166+0000","last_peered":"2023-11-16T02:29:39.894166+0000","last_clean":"2023-11-16T02:29:39.894166+0000","last_became_active":"2023-11-16T02:29:37.896204+0000","last_became_peered":"2023-11-16T02:29:37.896204+0000","last_unstale":"2023-11-16T02:29:39.894166+0000","last_undegraded":"2023-11-16T02:29:39.894166+0000","last_fullsized":"2023-11-16T02:29:39.894166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:04:24.431554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878831+0000","last_change":"2023-11-16T02:29:37.515012+0000","last_active":"2023-11-16T02:29:38.878831+0000","last_peered":"2023-11-16T02:29:38.878831+0000","last_clean":"2023-11-16T02:29:38.878831+0000","last_became_active":"2023-11-16T02:29:37.514528+0000","last_became_peered":"2023-11-16T02:29:37.514528+0000","last_unstale":"2023-11-16T02:29:38.878831+0000","last_undegraded":"2023-11-16T02:29:38.878831+0000","last_fullsized":"2023-11-16T02:29:38.878831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:07:57.498670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881961+0000","last_change":"2023-11-16T02:29:37.925316+0000","last_active":"2023-11-16T02:29:38.881961+0000","last_peered":"2023-11-16T02:29:38.881961+0000","last_clean":"2023-11-16T02:29:38.881961+0000","last_became_active":"2023-11-16T02:29:37.924267+0000","last_became_peered":"2023-11-16T02:29:37.924267+0000","last_unstale":"2023-11-16T02:29:38.881961+0000","last_undegraded":"2023-11-16T02:29:38.881961+0000","last_fullsized":"2023-11-16T02:29:38.881961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:06:38.108558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893826+0000","last_change":"2023-11-16T02:29:37.544869+0000","last_active":"2023-11-16T02:29:39.893826+0000","last_peered":"2023-11-16T02:29:39.893826+0000","last_clean":"2023-11-16T02:29:39.893826+0000","last_became_active":"2023-11-16T02:29:37.544275+0000","last_became_peered":"2023-11-16T02:29:37.544275+0000","last_unstale":"2023-11-16T02:29:39.893826+0000","last_undegraded":"2023-11-16T02:29:39.893826+0000","last_fullsized":"2023-11-16T02:29:39.893826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:38:57.277934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878700+0000","last_change":"2023-11-16T02:29:37.884651+0000","last_active":"2023-11-16T02:29:38.878700+0000","last_peered":"2023-11-16T02:29:38.878700+0000","last_clean":"2023-11-16T02:29:38.878700+0000","last_became_active":"2023-11-16T02:29:37.884251+0000","last_became_peered":"2023-11-16T02:29:37.884251+0000","last_unstale":"2023-11-16T02:29:38.878700+0000","last_undegraded":"2023-11-16T02:29:38.878700+0000","last_fullsized":"2023-11-16T02:29:38.878700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:09:55.065210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:40.440759+0000","last_change":"2023-11-16T02:29:37.518697+0000","last_active":"2023-11-16T02:29:40.440759+0000","last_peered":"2023-11-16T02:29:40.440759+0000","last_clean":"2023-11-16T02:29:40.440759+0000","last_became_active":"2023-11-16T02:29:37.518275+0000","last_became_peered":"2023-11-16T02:29:37.518275+0000","last_unstale":"2023-11-16T02:29:40.440759+0000","last_undegraded":"2023-11-16T02:29:40.440759+0000","last_fullsized":"2023-11-16T02:29:40.440759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:45:11.372719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892472+0000","last_change":"2023-11-16T02:29:37.928232+0000","last_active":"2023-11-16T02:29:39.892472+0000","last_peered":"2023-11-16T02:29:39.892472+0000","last_clean":"2023-11-16T02:29:39.892472+0000","last_became_active":"2023-11-16T02:29:37.927841+0000","last_became_peered":"2023-11-16T02:29:37.927841+0000","last_unstale":"2023-11-16T02:29:39.892472+0000","last_undegraded":"2023-11-16T02:29:39.892472+0000","last_fullsized":"2023-11-16T02:29:39.892472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:06:38.108558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880867+0000","last_change":"2023-11-16T02:29:37.533118+0000","last_active":"2023-11-16T02:29:38.880867+0000","last_peered":"2023-11-16T02:29:38.880867+0000","last_clean":"2023-11-16T02:29:38.880867+0000","last_became_active":"2023-11-16T02:29:37.532348+0000","last_became_peered":"2023-11-16T02:29:37.532348+0000","last_unstale":"2023-11-16T02:29:38.880867+0000","last_undegraded":"2023-11-16T02:29:38.880867+0000","last_fullsized":"2023-11-16T02:29:38.880867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:42:27.512040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891116+0000","last_change":"2023-11-16T02:29:37.892758+0000","last_active":"2023-11-16T02:29:39.891116+0000","last_peered":"2023-11-16T02:29:39.891116+0000","last_clean":"2023-11-16T02:29:39.891116+0000","last_became_active":"2023-11-16T02:29:37.892403+0000","last_became_peered":"2023-11-16T02:29:37.892403+0000","last_unstale":"2023-11-16T02:29:39.891116+0000","last_undegraded":"2023-11-16T02:29:39.891116+0000","last_fullsized":"2023-11-16T02:29:39.891116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T02:37:34.677034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892115+0000","last_change":"2023-11-16T02:29:37.539865+0000","last_active":"2023-11-16T02:29:39.892115+0000","last_peered":"2023-11-16T02:29:39.892115+0000","last_clean":"2023-11-16T02:29:39.892115+0000","last_became_active":"2023-11-16T02:29:37.538829+0000","last_became_peered":"2023-11-16T02:29:37.538829+0000","last_unstale":"2023-11-16T02:29:39.892115+0000","last_undegraded":"2023-11-16T02:29:39.892115+0000","last_fullsized":"2023-11-16T02:29:39.892115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:09:37.990889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892445+0000","last_change":"2023-11-16T02:29:37.924136+0000","last_active":"2023-11-16T02:29:39.892445+0000","last_peered":"2023-11-16T02:29:39.892445+0000","last_clean":"2023-11-16T02:29:39.892445+0000","last_became_active":"2023-11-16T02:29:37.922911+0000","last_became_peered":"2023-11-16T02:29:37.922911+0000","last_unstale":"2023-11-16T02:29:39.892445+0000","last_undegraded":"2023-11-16T02:29:39.892445+0000","last_fullsized":"2023-11-16T02:29:39.892445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:45:12.383063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878567+0000","last_change":"2023-11-16T02:29:37.530829+0000","last_active":"2023-11-16T02:29:38.878567+0000","last_peered":"2023-11-16T02:29:38.878567+0000","last_clean":"2023-11-16T02:29:38.878567+0000","last_became_active":"2023-11-16T02:29:37.530464+0000","last_became_peered":"2023-11-16T02:29:37.530464+0000","last_unstale":"2023-11-16T02:29:38.878567+0000","last_undegraded":"2023-11-16T02:29:38.878567+0000","last_fullsized":"2023-11-16T02:29:38.878567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:42:27.512040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892249+0000","last_change":"2023-11-16T02:29:37.886780+0000","last_active":"2023-11-16T02:29:39.892249+0000","last_peered":"2023-11-16T02:29:39.892249+0000","last_clean":"2023-11-16T02:29:39.892249+0000","last_became_active":"2023-11-16T02:29:37.885971+0000","last_became_peered":"2023-11-16T02:29:37.885971+0000","last_unstale":"2023-11-16T02:29:39.892249+0000","last_undegraded":"2023-11-16T02:29:39.892249+0000","last_fullsized":"2023-11-16T02:29:39.892249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:09:55.065210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878991+0000","last_change":"2023-11-16T02:29:37.518075+0000","last_active":"2023-11-16T02:29:38.878991+0000","last_peered":"2023-11-16T02:29:38.878991+0000","last_clean":"2023-11-16T02:29:38.878991+0000","last_became_active":"2023-11-16T02:29:37.517639+0000","last_became_peered":"2023-11-16T02:29:37.517639+0000","last_unstale":"2023-11-16T02:29:38.878991+0000","last_undegraded":"2023-11-16T02:29:38.878991+0000","last_fullsized":"2023-11-16T02:29:38.878991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:57:02.655084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891316+0000","last_change":"2023-11-16T02:29:37.895705+0000","last_active":"2023-11-16T02:29:39.891316+0000","last_peered":"2023-11-16T02:29:39.891316+0000","last_clean":"2023-11-16T02:29:39.891316+0000","last_became_active":"2023-11-16T02:29:37.895416+0000","last_became_peered":"2023-11-16T02:29:37.895416+0000","last_unstale":"2023-11-16T02:29:39.891316+0000","last_undegraded":"2023-11-16T02:29:39.891316+0000","last_fullsized":"2023-11-16T02:29:39.891316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:43:20.665096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893707+0000","last_change":"2023-11-16T02:29:37.544189+0000","last_active":"2023-11-16T02:29:39.893707+0000","last_peered":"2023-11-16T02:29:39.893707+0000","last_clean":"2023-11-16T02:29:39.893707+0000","last_became_active":"2023-11-16T02:29:37.543571+0000","last_became_peered":"2023-11-16T02:29:37.543571+0000","last_unstale":"2023-11-16T02:29:39.893707+0000","last_undegraded":"2023-11-16T02:29:39.893707+0000","last_fullsized":"2023-11-16T02:29:39.893707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:07:57.498670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880376+0000","last_change":"2023-11-16T02:29:37.928251+0000","last_active":"2023-11-16T02:29:38.880376+0000","last_peered":"2023-11-16T02:29:38.880376+0000","last_clean":"2023-11-16T02:29:38.880376+0000","last_became_active":"2023-11-16T02:29:37.927716+0000","last_became_peered":"2023-11-16T02:29:37.927716+0000","last_unstale":"2023-11-16T02:29:38.880376+0000","last_undegraded":"2023-11-16T02:29:38.880376+0000","last_fullsized":"2023-11-16T02:29:38.880376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:25:48.005968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881803+0000","last_change":"2023-11-16T02:29:37.939219+0000","last_active":"2023-11-16T02:29:38.881803+0000","last_peered":"2023-11-16T02:29:38.881803+0000","last_clean":"2023-11-16T02:29:38.881803+0000","last_became_active":"2023-11-16T02:29:37.938582+0000","last_became_peered":"2023-11-16T02:29:37.938582+0000","last_unstale":"2023-11-16T02:29:38.881803+0000","last_undegraded":"2023-11-16T02:29:38.881803+0000","last_fullsized":"2023-11-16T02:29:38.881803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:43:20.665096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893385+0000","last_change":"2023-11-16T02:29:37.549085+0000","last_active":"2023-11-16T02:29:39.893385+0000","last_peered":"2023-11-16T02:29:39.893385+0000","last_clean":"2023-11-16T02:29:39.893385+0000","last_became_active":"2023-11-16T02:29:37.548532+0000","last_became_peered":"2023-11-16T02:29:37.548532+0000","last_unstale":"2023-11-16T02:29:39.893385+0000","last_undegraded":"2023-11-16T02:29:39.893385+0000","last_fullsized":"2023-11-16T02:29:39.893385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:21:31.762437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881938+0000","last_change":"2023-11-16T02:29:37.936750+0000","last_active":"2023-11-16T02:29:38.881938+0000","last_peered":"2023-11-16T02:29:38.881938+0000","last_clean":"2023-11-16T02:29:38.881938+0000","last_became_active":"2023-11-16T02:29:37.936169+0000","last_became_peered":"2023-11-16T02:29:37.936169+0000","last_unstale":"2023-11-16T02:29:38.881938+0000","last_undegraded":"2023-11-16T02:29:38.881938+0000","last_fullsized":"2023-11-16T02:29:38.881938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:10:43.990221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893640+0000","last_change":"2023-11-16T02:29:37.543752+0000","last_active":"2023-11-16T02:29:39.893640+0000","last_peered":"2023-11-16T02:29:39.893640+0000","last_clean":"2023-11-16T02:29:39.893640+0000","last_became_active":"2023-11-16T02:29:37.543157+0000","last_became_peered":"2023-11-16T02:29:37.543157+0000","last_unstale":"2023-11-16T02:29:39.893640+0000","last_undegraded":"2023-11-16T02:29:39.893640+0000","last_fullsized":"2023-11-16T02:29:39.893640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:04:23.421210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891041+0000","last_change":"2023-11-16T02:29:37.928390+0000","last_active":"2023-11-16T02:29:39.891041+0000","last_peered":"2023-11-16T02:29:39.891041+0000","last_clean":"2023-11-16T02:29:39.891041+0000","last_became_active":"2023-11-16T02:29:37.928152+0000","last_became_peered":"2023-11-16T02:29:37.928152+0000","last_unstale":"2023-11-16T02:29:39.891041+0000","last_undegraded":"2023-11-16T02:29:39.891041+0000","last_fullsized":"2023-11-16T02:29:39.891041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:10:43.990221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891480+0000","last_change":"2023-11-16T02:29:37.516960+0000","last_active":"2023-11-16T02:29:39.891480+0000","last_peered":"2023-11-16T02:29:39.891480+0000","last_clean":"2023-11-16T02:29:39.891480+0000","last_became_active":"2023-11-16T02:29:37.516030+0000","last_became_peered":"2023-11-16T02:29:37.516030+0000","last_unstale":"2023-11-16T02:29:39.891480+0000","last_undegraded":"2023-11-16T02:29:39.891480+0000","last_fullsized":"2023-11-16T02:29:39.891480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:44:21.321181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891358+0000","last_change":"2023-11-16T02:29:37.909668+0000","last_active":"2023-11-16T02:29:39.891358+0000","last_peered":"2023-11-16T02:29:39.891358+0000","last_clean":"2023-11-16T02:29:39.891358+0000","last_became_active":"2023-11-16T02:29:37.909339+0000","last_became_peered":"2023-11-16T02:29:37.909339+0000","last_unstale":"2023-11-16T02:29:39.891358+0000","last_undegraded":"2023-11-16T02:29:39.891358+0000","last_fullsized":"2023-11-16T02:29:39.891358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:25:48.005968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891428+0000","last_change":"2023-11-16T02:29:37.537280+0000","last_active":"2023-11-16T02:29:39.891428+0000","last_peered":"2023-11-16T02:29:39.891428+0000","last_clean":"2023-11-16T02:29:39.891428+0000","last_became_active":"2023-11-16T02:29:37.536813+0000","last_became_peered":"2023-11-16T02:29:37.536813+0000","last_unstale":"2023-11-16T02:29:39.891428+0000","last_undegraded":"2023-11-16T02:29:39.891428+0000","last_fullsized":"2023-11-16T02:29:39.891428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:44:21.321181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":819200,"data_stored":667190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]}]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31276,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340564,"statfs":{"total":96636764160,"available":96604737536,"internally_reserved":0,"allocated":233472,"data_stored":77804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.929}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.502}]}]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31268,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340572,"statfs":{"total":96636764160,"available":96604745728,"internally_reserved":0,"allocated":225280,"data_stored":76330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]}]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31276,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340564,"statfs":{"total":96636764160,"available":96604737536,"internally_reserved":0,"allocated":233472,"data_stored":76366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9860000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9689999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31276,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340564,"statfs":{"total":96636764160,"available":96604737536,"internally_reserved":0,"allocated":233472,"data_stored":77804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31272,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340568,"statfs":{"total":96636764160,"available":96604741632,"internally_reserved":0,"allocated":229376,"data_stored":76400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":827392,"data_stored":667246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31264,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340576,"statfs":{"total":96636764160,"available":96604749824,"internally_reserved":0,"allocated":221184,"data_stored":76240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-16T02:29:50.630 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-16T02:29:50.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.785+0000 7f33af007640 1 Processor -- start 2023-11-16T02:29:50.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.785+0000 7f33af007640 1 -- start start 2023-11-16T02:29:50.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.789+0000 7f33af007640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f33a814bb00 0x7f33a806edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:50.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.789+0000 7f33af007640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f33a8141840 0x7f33a8141cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:50.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.789+0000 7f33af007640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a806f310 con 0x7f33a80b7cc0 2023-11-16T02:29:50.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.789+0000 7f33af007640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33a814b6e0 con 0x7f33a8141840 2023-11-16T02:29:50.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.789+0000 7f33af007640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a80b39d0 con 0x7f33a814bb00 2023-11-16T02:29:50.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.789+0000 7f33ad5a4640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f33a8141840 0x7f33a8141cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:50.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.789+0000 7f33ad5a4640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f33a8141840 0x7f33a8141cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47110/0 (socket says 172.21.15.28:47110) 2023-11-16T02:29:50.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.789+0000 7f33ad5a4640 1 -- 172.21.15.28:0/1535057586 learned_addr learned my addr 172.21.15.28:0/1535057586 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:50.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.789+0000 7f33acda3640 1 --1- 172.21.15.28:0/1535057586 >> v1:172.21.15.28:6789/0 conn(0x7f33a80b7cc0 0x7f33a8071160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55920/0 (socket says 172.21.15.28:55920) 2023-11-16T02:29:50.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.789+0000 7f33a7fff640 1 --2- 172.21.15.28:0/1535057586 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f33a814bb00 0x7f33a806edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:50.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.789+0000 7f33ad5a4640 1 -- 172.21.15.28:0/1535057586 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f33a814bb00 msgr2=0x7f33a806edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:50.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.789+0000 7f33ad5a4640 1 --2- 172.21.15.28:0/1535057586 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f33a814bb00 0x7f33a806edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.789+0000 7f33ad5a4640 1 -- 172.21.15.28:0/1535057586 >> v1:172.21.15.28:6789/0 conn(0x7f33a80b7cc0 legacy=0x7f33a8071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.789+0000 7f33a77fe640 1 -- 172.21.15.28:0/1535057586 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4110572011 0 0) 0x7f33a806f310 con 0x7f33a80b7cc0 2023-11-16T02:29:50.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.789+0000 7f33ad5a4640 1 -- 172.21.15.28:0/1535057586 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a8071bf0 con 0x7f33a8141840 2023-11-16T02:29:50.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.789+0000 7f33ad5a4640 1 --2- 172.21.15.28:0/1535057586 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33a8141840 0x7f33a8141cd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f33a0009e80 tx=0x7f33a001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a0ac8132b803cea server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:50.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.789+0000 7f33a77fe640 1 -- 172.21.15.28:0/1535057586 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a00a57f0 con 0x7f33a8141840 2023-11-16T02:29:50.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.789+0000 7f33a77fe640 1 -- 172.21.15.28:0/1535057586 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a00a5950 con 0x7f33a8141840 2023-11-16T02:29:50.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.789+0000 7f33a77fe640 1 -- 172.21.15.28:0/1535057586 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a00a5ce0 con 0x7f33a8141840 2023-11-16T02:29:50.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33af007640 1 -- 172.21.15.28:0/1535057586 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33a8141840 msgr2=0x7f33a8141cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33af007640 1 --2- 172.21.15.28:0/1535057586 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33a8141840 0x7f33a8141cd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f33a0009e80 tx=0x7f33a001c930 comp rx=0 tx=0).stop 2023-11-16T02:29:50.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33af007640 1 -- 172.21.15.28:0/1535057586 shutdown_connections 2023-11-16T02:29:50.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33af007640 1 --2- 172.21.15.28:0/1535057586 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33a8141840 0x7f33a8141cd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33af007640 1 --2- 172.21.15.28:0/1535057586 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f33a814bb00 0x7f33a806edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33af007640 1 -- 172.21.15.28:0/1535057586 >> 172.21.15.28:0/1535057586 conn(0x7f33a80b9050 msgr2=0x7f33a80bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:50.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33af007640 1 -- 172.21.15.28:0/1535057586 shutdown_connections 2023-11-16T02:29:50.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33af007640 1 -- 172.21.15.28:0/1535057586 wait complete. 2023-11-16T02:29:50.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33af007640 1 Processor -- start 2023-11-16T02:29:50.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33af007640 1 -- start start 2023-11-16T02:29:50.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33af007640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33a80b7cc0 0x7f33a80b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:50.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33af007640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f33a8141840 0x7f33a81390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:50.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33af007640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33a814bb00 0x7f33a813a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:50.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33af007640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a813ae60 con 0x7f33a814bb00 2023-11-16T02:29:50.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33af007640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a814aba0 con 0x7f33a80b7cc0 2023-11-16T02:29:50.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33af007640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a81407a0 con 0x7f33a8141840 2023-11-16T02:29:50.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33ad5a4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33a814bb00 0x7f33a813a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:50.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33acda3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33a80b7cc0 0x7f33a80b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:50.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33ad5a4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33a814bb00 0x7f33a813a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47118/0 (socket says 172.21.15.28:47118) 2023-11-16T02:29:50.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33ad5a4640 1 -- 172.21.15.28:0/695415326 learned_addr learned my addr 172.21.15.28:0/695415326 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:50.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33a7fff640 1 --2- 172.21.15.28:0/695415326 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f33a8141840 0x7f33a81390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:50.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33ad5a4640 1 -- 172.21.15.28:0/695415326 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f33a8141840 msgr2=0x7f33a81390c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33ad5a4640 1 --2- 172.21.15.28:0/695415326 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f33a8141840 0x7f33a81390c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33ad5a4640 1 -- 172.21.15.28:0/695415326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33a80b7cc0 msgr2=0x7f33a80b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33ad5a4640 1 --2- 172.21.15.28:0/695415326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33a80b7cc0 0x7f33a80b4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33ad5a4640 1 -- 172.21.15.28:0/695415326 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a0009b30 con 0x7f33a814bb00 2023-11-16T02:29:50.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33ad5a4640 1 --2- 172.21.15.28:0/695415326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33a814bb00 0x7f33a813a920 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f33a001a560 tx=0x7f33a00196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:50.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33a57fa640 1 -- 172.21.15.28:0/695415326 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a0003ba0 con 0x7f33a814bb00 2023-11-16T02:29:50.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33a57fa640 1 -- 172.21.15.28:0/695415326 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a0003d00 con 0x7f33a814bb00 2023-11-16T02:29:50.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33af007640 1 -- 172.21.15.28:0/695415326 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a8140d20 con 0x7f33a814bb00 2023-11-16T02:29:50.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33a57fa640 1 -- 172.21.15.28:0/695415326 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a0004230 con 0x7f33a814bb00 2023-11-16T02:29:50.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.793+0000 7f33af007640 1 -- 172.21.15.28:0/695415326 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a8140a40 con 0x7f33a814bb00 2023-11-16T02:29:50.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.797+0000 7f33af007640 1 -- 172.21.15.28:0/695415326 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a804e8a0 con 0x7f33a814bb00 2023-11-16T02:29:50.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.797+0000 7f33a57fa640 1 -- 172.21.15.28:0/695415326 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f33a0004390 con 0x7f33a814bb00 2023-11-16T02:29:50.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.797+0000 7f33a57fa640 1 --2- 172.21.15.28:0/695415326 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3394065a60 0x7f3394067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:50.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.797+0000 7f33a57fa640 1 -- 172.21.15.28:0/695415326 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33a011e260 con 0x7f33a814bb00 2023-11-16T02:29:50.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.797+0000 7f33acda3640 1 --2- 172.21.15.28:0/695415326 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3394065a60 0x7f3394067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:50.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.797+0000 7f33acda3640 1 --2- 172.21.15.28:0/695415326 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3394065a60 0x7f3394067f20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3398007fd0 tx=0x7f3398007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:50.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.801+0000 7f33a57fa640 1 -- 172.21.15.28:0/695415326 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f33a00ebd60 con 0x7f33a814bb00 2023-11-16T02:29:50.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.949+0000 7f33af007640 1 -- 172.21.15.28:0/695415326 --> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f33a8071870 con 0x7f3394065a60 2023-11-16T02:29:50.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.961+0000 7f33a57fa640 1 -- 172.21.15.28:0/695415326 <== mgr.4104 v2:172.21.15.28:6832/38651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264410 (secure 0 0 0) 0x7f3398004c80 con 0x7f3394065a60 2023-11-16T02:29:50.967 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:50.969 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-11-16T02:29:50.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.965+0000 7f33af007640 1 -- 172.21.15.28:0/695415326 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3394065a60 msgr2=0x7f3394067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.965+0000 7f33af007640 1 --2- 172.21.15.28:0/695415326 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3394065a60 0x7f3394067f20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3398007fd0 tx=0x7f3398007d60 comp rx=0 tx=0).stop 2023-11-16T02:29:50.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.965+0000 7f33af007640 1 -- 172.21.15.28:0/695415326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33a814bb00 msgr2=0x7f33a813a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:50.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.965+0000 7f33af007640 1 --2- 172.21.15.28:0/695415326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33a814bb00 0x7f33a813a920 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f33a001a560 tx=0x7f33a00196d0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.965+0000 7f33af007640 1 -- 172.21.15.28:0/695415326 shutdown_connections 2023-11-16T02:29:50.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.965+0000 7f33af007640 1 --2- 172.21.15.28:0/695415326 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3394065a60 0x7f3394067f20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.965+0000 7f33af007640 1 --2- 172.21.15.28:0/695415326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33a814bb00 0x7f33a813a920 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.965+0000 7f33af007640 1 --2- 172.21.15.28:0/695415326 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f33a8141840 0x7f33a81390c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.965+0000 7f33af007640 1 --2- 172.21.15.28:0/695415326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33a80b7cc0 0x7f33a80b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:50.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.965+0000 7f33af007640 1 -- 172.21.15.28:0/695415326 >> 172.21.15.28:0/695415326 conn(0x7f33a80b9050 msgr2=0x7f33a8150680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:50.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.965+0000 7f33af007640 1 -- 172.21.15.28:0/695415326 shutdown_connections 2023-11-16T02:29:50.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:50.965+0000 7f33af007640 1 -- 172.21.15.28:0/695415326 wait complete. 2023-11-16T02:29:50.984 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-11-16T02:29:50.419711+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":251336,"kb_used_data":2952,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754723384,"statfs":{"total":773094113280,"available":772836745216,"internally_reserved":0,"allocated":3022848,"data_stored":1795380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.544320"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893446+0000","last_change":"2023-11-16T02:29:37.934110+0000","last_active":"2023-11-16T02:29:39.893446+0000","last_peered":"2023-11-16T02:29:39.893446+0000","last_clean":"2023-11-16T02:29:39.893446+0000","last_became_active":"2023-11-16T02:29:37.933578+0000","last_became_peered":"2023-11-16T02:29:37.933578+0000","last_unstale":"2023-11-16T02:29:39.893446+0000","last_undegraded":"2023-11-16T02:29:39.893446+0000","last_fullsized":"2023-11-16T02:29:39.893446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:40:54.967365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879002+0000","last_change":"2023-11-16T02:29:37.889075+0000","last_active":"2023-11-16T02:29:38.879002+0000","last_peered":"2023-11-16T02:29:38.879002+0000","last_clean":"2023-11-16T02:29:38.879002+0000","last_became_active":"2023-11-16T02:29:37.888736+0000","last_became_peered":"2023-11-16T02:29:37.888736+0000","last_unstale":"2023-11-16T02:29:38.879002+0000","last_undegraded":"2023-11-16T02:29:38.879002+0000","last_fullsized":"2023-11-16T02:29:38.879002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:25:48.005968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892513+0000","last_change":"2023-11-16T02:29:37.888531+0000","last_active":"2023-11-16T02:29:39.892513+0000","last_peered":"2023-11-16T02:29:39.892513+0000","last_clean":"2023-11-16T02:29:39.892513+0000","last_became_active":"2023-11-16T02:29:37.888011+0000","last_became_peered":"2023-11-16T02:29:37.888011+0000","last_unstale":"2023-11-16T02:29:39.892513+0000","last_undegraded":"2023-11-16T02:29:39.892513+0000","last_fullsized":"2023-11-16T02:29:39.892513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:27:01.501132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879881+0000","last_change":"2023-11-16T02:29:37.933231+0000","last_active":"2023-11-16T02:29:38.879881+0000","last_peered":"2023-11-16T02:29:38.879881+0000","last_clean":"2023-11-16T02:29:38.879881+0000","last_became_active":"2023-11-16T02:29:37.932560+0000","last_became_peered":"2023-11-16T02:29:37.932560+0000","last_unstale":"2023-11-16T02:29:38.879881+0000","last_undegraded":"2023-11-16T02:29:38.879881+0000","last_fullsized":"2023-11-16T02:29:38.879881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:40:54.967365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893326+0000","last_change":"2023-11-16T02:29:37.924836+0000","last_active":"2023-11-16T02:29:39.893326+0000","last_peered":"2023-11-16T02:29:39.893326+0000","last_clean":"2023-11-16T02:29:39.893326+0000","last_became_active":"2023-11-16T02:29:37.923955+0000","last_became_peered":"2023-11-16T02:29:37.923955+0000","last_unstale":"2023-11-16T02:29:39.893326+0000","last_undegraded":"2023-11-16T02:29:39.893326+0000","last_fullsized":"2023-11-16T02:29:39.893326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:16:52.591980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879892+0000","last_change":"2023-11-16T02:29:37.927564+0000","last_active":"2023-11-16T02:29:38.879892+0000","last_peered":"2023-11-16T02:29:38.879892+0000","last_clean":"2023-11-16T02:29:38.879892+0000","last_became_active":"2023-11-16T02:29:37.925508+0000","last_became_peered":"2023-11-16T02:29:37.925508+0000","last_unstale":"2023-11-16T02:29:38.879892+0000","last_undegraded":"2023-11-16T02:29:38.879892+0000","last_fullsized":"2023-11-16T02:29:38.879892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:53:52.129290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892495+0000","last_change":"2023-11-16T02:29:37.908302+0000","last_active":"2023-11-16T02:29:39.892495+0000","last_peered":"2023-11-16T02:29:39.892495+0000","last_clean":"2023-11-16T02:29:39.892495+0000","last_became_active":"2023-11-16T02:29:37.907469+0000","last_became_peered":"2023-11-16T02:29:37.907469+0000","last_unstale":"2023-11-16T02:29:39.892495+0000","last_undegraded":"2023-11-16T02:29:39.892495+0000","last_fullsized":"2023-11-16T02:29:39.892495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:30:42.074843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891934+0000","last_change":"2023-11-16T02:29:37.936720+0000","last_active":"2023-11-16T02:29:39.891934+0000","last_peered":"2023-11-16T02:29:39.891934+0000","last_clean":"2023-11-16T02:29:39.891934+0000","last_became_active":"2023-11-16T02:29:37.936424+0000","last_became_peered":"2023-11-16T02:29:37.936424+0000","last_unstale":"2023-11-16T02:29:39.891934+0000","last_undegraded":"2023-11-16T02:29:39.891934+0000","last_fullsized":"2023-11-16T02:29:39.891934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:53:52.129290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893619+0000","last_change":"2023-11-16T02:29:37.941366+0000","last_active":"2023-11-16T02:29:39.893619+0000","last_peered":"2023-11-16T02:29:39.893619+0000","last_clean":"2023-11-16T02:29:39.893619+0000","last_became_active":"2023-11-16T02:29:37.940672+0000","last_became_peered":"2023-11-16T02:29:37.940672+0000","last_unstale":"2023-11-16T02:29:39.893619+0000","last_undegraded":"2023-11-16T02:29:39.893619+0000","last_fullsized":"2023-11-16T02:29:39.893619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:45:26.924071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881259+0000","last_change":"2023-11-16T02:29:37.925689+0000","last_active":"2023-11-16T02:29:38.881259+0000","last_peered":"2023-11-16T02:29:38.881259+0000","last_clean":"2023-11-16T02:29:38.881259+0000","last_became_active":"2023-11-16T02:29:37.925132+0000","last_became_peered":"2023-11-16T02:29:37.925132+0000","last_unstale":"2023-11-16T02:29:38.881259+0000","last_undegraded":"2023-11-16T02:29:38.881259+0000","last_fullsized":"2023-11-16T02:29:38.881259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:16:58.785873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880724+0000","last_change":"2023-11-16T02:29:37.927099+0000","last_active":"2023-11-16T02:29:38.880724+0000","last_peered":"2023-11-16T02:29:38.880724+0000","last_clean":"2023-11-16T02:29:38.880724+0000","last_became_active":"2023-11-16T02:29:37.926533+0000","last_became_peered":"2023-11-16T02:29:37.926533+0000","last_unstale":"2023-11-16T02:29:38.880724+0000","last_undegraded":"2023-11-16T02:29:38.880724+0000","last_fullsized":"2023-11-16T02:29:38.880724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:43:20.665096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893022+0000","last_change":"2023-11-16T02:29:37.902388+0000","last_active":"2023-11-16T02:29:39.893022+0000","last_peered":"2023-11-16T02:29:39.893022+0000","last_clean":"2023-11-16T02:29:39.893022+0000","last_became_active":"2023-11-16T02:29:37.901626+0000","last_became_peered":"2023-11-16T02:29:37.901626+0000","last_unstale":"2023-11-16T02:29:39.893022+0000","last_undegraded":"2023-11-16T02:29:39.893022+0000","last_fullsized":"2023-11-16T02:29:39.893022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:09:39.001233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891187+0000","last_change":"2023-11-16T02:29:37.907449+0000","last_active":"2023-11-16T02:29:39.891187+0000","last_peered":"2023-11-16T02:29:39.891187+0000","last_clean":"2023-11-16T02:29:39.891187+0000","last_became_active":"2023-11-16T02:29:37.907166+0000","last_became_peered":"2023-11-16T02:29:37.907166+0000","last_unstale":"2023-11-16T02:29:39.891187+0000","last_undegraded":"2023-11-16T02:29:39.891187+0000","last_fullsized":"2023-11-16T02:29:39.891187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:37:34.233429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891915+0000","last_change":"2023-11-16T02:29:37.892022+0000","last_active":"2023-11-16T02:29:39.891915+0000","last_peered":"2023-11-16T02:29:39.891915+0000","last_clean":"2023-11-16T02:29:39.891915+0000","last_became_active":"2023-11-16T02:29:37.891566+0000","last_became_peered":"2023-11-16T02:29:37.891566+0000","last_unstale":"2023-11-16T02:29:39.891915+0000","last_undegraded":"2023-11-16T02:29:39.891915+0000","last_fullsized":"2023-11-16T02:29:39.891915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:06:12.705211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878687+0000","last_change":"2023-11-16T02:29:37.924750+0000","last_active":"2023-11-16T02:29:38.878687+0000","last_peered":"2023-11-16T02:29:38.878687+0000","last_clean":"2023-11-16T02:29:38.878687+0000","last_became_active":"2023-11-16T02:29:37.924471+0000","last_became_peered":"2023-11-16T02:29:37.924471+0000","last_unstale":"2023-11-16T02:29:38.878687+0000","last_undegraded":"2023-11-16T02:29:38.878687+0000","last_fullsized":"2023-11-16T02:29:38.878687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:43:20.665096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879402+0000","last_change":"2023-11-16T02:29:37.912953+0000","last_active":"2023-11-16T02:29:38.879402+0000","last_peered":"2023-11-16T02:29:38.879402+0000","last_clean":"2023-11-16T02:29:38.879402+0000","last_became_active":"2023-11-16T02:29:37.912132+0000","last_became_peered":"2023-11-16T02:29:37.912132+0000","last_unstale":"2023-11-16T02:29:38.879402+0000","last_undegraded":"2023-11-16T02:29:38.879402+0000","last_fullsized":"2023-11-16T02:29:38.879402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:52:41.161159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.882380+0000","last_change":"2023-11-16T02:29:37.933833+0000","last_active":"2023-11-16T02:29:38.882380+0000","last_peered":"2023-11-16T02:29:38.882380+0000","last_clean":"2023-11-16T02:29:38.882380+0000","last_became_active":"2023-11-16T02:29:37.933117+0000","last_became_peered":"2023-11-16T02:29:37.933117+0000","last_unstale":"2023-11-16T02:29:38.882380+0000","last_undegraded":"2023-11-16T02:29:38.882380+0000","last_fullsized":"2023-11-16T02:29:38.882380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:16:52.591980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930738+0000","last_change":"2023-11-16T02:29:37.890129+0000","last_active":"2023-11-16T02:29:38.930738+0000","last_peered":"2023-11-16T02:29:38.930738+0000","last_clean":"2023-11-16T02:29:38.930738+0000","last_became_active":"2023-11-16T02:29:37.889784+0000","last_became_peered":"2023-11-16T02:29:37.889784+0000","last_unstale":"2023-11-16T02:29:38.930738+0000","last_undegraded":"2023-11-16T02:29:38.930738+0000","last_fullsized":"2023-11-16T02:29:38.930738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:57:07.831898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893749+0000","last_change":"2023-11-16T02:29:37.916610+0000","last_active":"2023-11-16T02:29:39.893749+0000","last_peered":"2023-11-16T02:29:39.893749+0000","last_clean":"2023-11-16T02:29:39.893749+0000","last_became_active":"2023-11-16T02:29:37.915744+0000","last_became_peered":"2023-11-16T02:29:37.915744+0000","last_unstale":"2023-11-16T02:29:39.893749+0000","last_undegraded":"2023-11-16T02:29:39.893749+0000","last_fullsized":"2023-11-16T02:29:39.893749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:39:21.513129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880946+0000","last_change":"2023-11-16T02:29:37.928237+0000","last_active":"2023-11-16T02:29:38.880946+0000","last_peered":"2023-11-16T02:29:38.880946+0000","last_clean":"2023-11-16T02:29:38.880946+0000","last_became_active":"2023-11-16T02:29:37.927434+0000","last_became_peered":"2023-11-16T02:29:37.927434+0000","last_unstale":"2023-11-16T02:29:38.880946+0000","last_undegraded":"2023-11-16T02:29:38.880946+0000","last_fullsized":"2023-11-16T02:29:38.880946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:37:34.233429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891411+0000","last_change":"2023-11-16T02:29:37.919211+0000","last_active":"2023-11-16T02:29:39.891411+0000","last_peered":"2023-11-16T02:29:39.891411+0000","last_clean":"2023-11-16T02:29:39.891411+0000","last_became_active":"2023-11-16T02:29:37.918942+0000","last_became_peered":"2023-11-16T02:29:37.918942+0000","last_unstale":"2023-11-16T02:29:39.891411+0000","last_undegraded":"2023-11-16T02:29:39.891411+0000","last_fullsized":"2023-11-16T02:29:39.891411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:02:14.259774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879910+0000","last_change":"2023-11-16T02:29:37.926517+0000","last_active":"2023-11-16T02:29:38.879910+0000","last_peered":"2023-11-16T02:29:38.879910+0000","last_clean":"2023-11-16T02:29:38.879910+0000","last_became_active":"2023-11-16T02:29:37.924700+0000","last_became_peered":"2023-11-16T02:29:37.924700+0000","last_unstale":"2023-11-16T02:29:38.879910+0000","last_undegraded":"2023-11-16T02:29:38.879910+0000","last_fullsized":"2023-11-16T02:29:38.879910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:39:21.513129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891489+0000","last_change":"2023-11-16T02:29:37.936251+0000","last_active":"2023-11-16T02:29:39.891489+0000","last_peered":"2023-11-16T02:29:39.891489+0000","last_clean":"2023-11-16T02:29:39.891489+0000","last_became_active":"2023-11-16T02:29:37.935980+0000","last_became_peered":"2023-11-16T02:29:37.935980+0000","last_unstale":"2023-11-16T02:29:39.891489+0000","last_undegraded":"2023-11-16T02:29:39.891489+0000","last_fullsized":"2023-11-16T02:29:39.891489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:02:14.259774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879581+0000","last_change":"2023-11-16T02:29:37.929521+0000","last_active":"2023-11-16T02:29:38.879581+0000","last_peered":"2023-11-16T02:29:38.879581+0000","last_clean":"2023-11-16T02:29:38.879581+0000","last_became_active":"2023-11-16T02:29:37.924137+0000","last_became_peered":"2023-11-16T02:29:37.924137+0000","last_unstale":"2023-11-16T02:29:38.879581+0000","last_undegraded":"2023-11-16T02:29:38.879581+0000","last_fullsized":"2023-11-16T02:29:38.879581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:05:26.649663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892396+0000","last_change":"2023-11-16T02:29:37.935340+0000","last_active":"2023-11-16T02:29:39.892396+0000","last_peered":"2023-11-16T02:29:39.892396+0000","last_clean":"2023-11-16T02:29:39.892396+0000","last_became_active":"2023-11-16T02:29:37.934955+0000","last_became_peered":"2023-11-16T02:29:37.934955+0000","last_unstale":"2023-11-16T02:29:39.892396+0000","last_undegraded":"2023-11-16T02:29:39.892396+0000","last_fullsized":"2023-11-16T02:29:39.892396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:10:43.990221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881491+0000","last_change":"2023-11-16T02:29:37.929426+0000","last_active":"2023-11-16T02:29:38.881491+0000","last_peered":"2023-11-16T02:29:38.881491+0000","last_clean":"2023-11-16T02:29:38.881491+0000","last_became_active":"2023-11-16T02:29:37.928780+0000","last_became_peered":"2023-11-16T02:29:37.928780+0000","last_unstale":"2023-11-16T02:29:38.881491+0000","last_undegraded":"2023-11-16T02:29:38.881491+0000","last_fullsized":"2023-11-16T02:29:38.881491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:05:26.649663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878825+0000","last_change":"2023-11-16T02:29:37.893720+0000","last_active":"2023-11-16T02:29:38.878825+0000","last_peered":"2023-11-16T02:29:38.878825+0000","last_clean":"2023-11-16T02:29:38.878825+0000","last_became_active":"2023-11-16T02:29:37.893429+0000","last_became_peered":"2023-11-16T02:29:37.893429+0000","last_unstale":"2023-11-16T02:29:38.878825+0000","last_undegraded":"2023-11-16T02:29:38.878825+0000","last_fullsized":"2023-11-16T02:29:38.878825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T02:48:20.525493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892100+0000","last_change":"2023-11-16T02:29:37.935318+0000","last_active":"2023-11-16T02:29:39.892100+0000","last_peered":"2023-11-16T02:29:39.892100+0000","last_clean":"2023-11-16T02:29:39.892100+0000","last_became_active":"2023-11-16T02:29:37.934951+0000","last_became_peered":"2023-11-16T02:29:37.934951+0000","last_unstale":"2023-11-16T02:29:39.892100+0000","last_undegraded":"2023-11-16T02:29:39.892100+0000","last_fullsized":"2023-11-16T02:29:39.892100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:16:58.785873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891486+0000","last_change":"2023-11-16T02:29:37.894800+0000","last_active":"2023-11-16T02:29:39.891486+0000","last_peered":"2023-11-16T02:29:39.891486+0000","last_clean":"2023-11-16T02:29:39.891486+0000","last_became_active":"2023-11-16T02:29:37.894404+0000","last_became_peered":"2023-11-16T02:29:37.894404+0000","last_unstale":"2023-11-16T02:29:39.891486+0000","last_undegraded":"2023-11-16T02:29:39.891486+0000","last_fullsized":"2023-11-16T02:29:39.891486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:37:34.233429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880139+0000","last_change":"2023-11-16T02:29:37.920827+0000","last_active":"2023-11-16T02:29:38.880139+0000","last_peered":"2023-11-16T02:29:38.880139+0000","last_clean":"2023-11-16T02:29:38.880139+0000","last_became_active":"2023-11-16T02:29:37.911702+0000","last_became_peered":"2023-11-16T02:29:37.911702+0000","last_unstale":"2023-11-16T02:29:38.880139+0000","last_undegraded":"2023-11-16T02:29:38.880139+0000","last_fullsized":"2023-11-16T02:29:38.880139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:46:36.525784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930582+0000","last_change":"2023-11-16T02:29:37.912688+0000","last_active":"2023-11-16T02:29:38.930582+0000","last_peered":"2023-11-16T02:29:38.930582+0000","last_clean":"2023-11-16T02:29:38.930582+0000","last_became_active":"2023-11-16T02:29:37.912482+0000","last_became_peered":"2023-11-16T02:29:37.912482+0000","last_unstale":"2023-11-16T02:29:38.930582+0000","last_undegraded":"2023-11-16T02:29:38.930582+0000","last_fullsized":"2023-11-16T02:29:38.930582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:36:55.256000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880120+0000","last_change":"2023-11-16T02:29:37.897293+0000","last_active":"2023-11-16T02:29:38.880120+0000","last_peered":"2023-11-16T02:29:38.880120+0000","last_clean":"2023-11-16T02:29:38.880120+0000","last_became_active":"2023-11-16T02:29:37.895087+0000","last_became_peered":"2023-11-16T02:29:37.895087+0000","last_unstale":"2023-11-16T02:29:38.880120+0000","last_undegraded":"2023-11-16T02:29:38.880120+0000","last_fullsized":"2023-11-16T02:29:38.880120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T02:48:20.525493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892526+0000","last_change":"2023-11-16T02:29:37.886782+0000","last_active":"2023-11-16T02:29:39.892526+0000","last_peered":"2023-11-16T02:29:39.892526+0000","last_clean":"2023-11-16T02:29:39.892526+0000","last_became_active":"2023-11-16T02:29:37.885874+0000","last_became_peered":"2023-11-16T02:29:37.885874+0000","last_unstale":"2023-11-16T02:29:39.892526+0000","last_undegraded":"2023-11-16T02:29:39.892526+0000","last_fullsized":"2023-11-16T02:29:39.892526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:21:32.772781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891317+0000","last_change":"2023-11-16T02:29:37.538231+0000","last_active":"2023-11-16T02:29:39.891317+0000","last_peered":"2023-11-16T02:29:39.891317+0000","last_clean":"2023-11-16T02:29:39.891317+0000","last_became_active":"2023-11-16T02:29:37.537831+0000","last_became_peered":"2023-11-16T02:29:37.537831+0000","last_unstale":"2023-11-16T02:29:39.891317+0000","last_undegraded":"2023-11-16T02:29:39.891317+0000","last_fullsized":"2023-11-16T02:29:39.891317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:07:57.498670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891555+0000","last_change":"2023-11-16T02:29:37.928329+0000","last_active":"2023-11-16T02:29:39.891555+0000","last_peered":"2023-11-16T02:29:39.891555+0000","last_clean":"2023-11-16T02:29:39.891555+0000","last_became_active":"2023-11-16T02:29:37.927587+0000","last_became_peered":"2023-11-16T02:29:37.927587+0000","last_unstale":"2023-11-16T02:29:39.891555+0000","last_undegraded":"2023-11-16T02:29:39.891555+0000","last_fullsized":"2023-11-16T02:29:39.891555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:25:48.005968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880624+0000","last_change":"2023-11-16T02:29:37.540421+0000","last_active":"2023-11-16T02:29:38.880624+0000","last_peered":"2023-11-16T02:29:38.880624+0000","last_clean":"2023-11-16T02:29:38.880624+0000","last_became_active":"2023-11-16T02:29:37.539777+0000","last_became_peered":"2023-11-16T02:29:37.539777+0000","last_unstale":"2023-11-16T02:29:38.880624+0000","last_undegraded":"2023-11-16T02:29:38.880624+0000","last_fullsized":"2023-11-16T02:29:38.880624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:07:57.498670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891713+0000","last_change":"2023-11-16T02:29:37.524313+0000","last_active":"2023-11-16T02:29:39.891713+0000","last_peered":"2023-11-16T02:29:39.891713+0000","last_clean":"2023-11-16T02:29:39.891713+0000","last_became_active":"2023-11-16T02:29:37.523846+0000","last_became_peered":"2023-11-16T02:29:37.523846+0000","last_unstale":"2023-11-16T02:29:39.891713+0000","last_undegraded":"2023-11-16T02:29:39.891713+0000","last_fullsized":"2023-11-16T02:29:39.891713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:10:34.206728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892088+0000","last_change":"2023-11-16T02:29:37.885752+0000","last_active":"2023-11-16T02:29:39.892088+0000","last_peered":"2023-11-16T02:29:39.892088+0000","last_clean":"2023-11-16T02:29:39.892088+0000","last_became_active":"2023-11-16T02:29:37.885481+0000","last_became_peered":"2023-11-16T02:29:37.885481+0000","last_unstale":"2023-11-16T02:29:39.892088+0000","last_undegraded":"2023-11-16T02:29:39.892088+0000","last_fullsized":"2023-11-16T02:29:39.892088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:05:12.707357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879852+0000","last_change":"2023-11-16T02:29:37.528549+0000","last_active":"2023-11-16T02:29:38.879852+0000","last_peered":"2023-11-16T02:29:38.879852+0000","last_clean":"2023-11-16T02:29:38.879852+0000","last_became_active":"2023-11-16T02:29:37.527762+0000","last_became_peered":"2023-11-16T02:29:37.527762+0000","last_unstale":"2023-11-16T02:29:38.879852+0000","last_undegraded":"2023-11-16T02:29:38.879852+0000","last_fullsized":"2023-11-16T02:29:38.879852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:45:11.372719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878450+0000","last_change":"2023-11-16T02:29:37.892686+0000","last_active":"2023-11-16T02:29:38.878450+0000","last_peered":"2023-11-16T02:29:38.878450+0000","last_clean":"2023-11-16T02:29:38.878450+0000","last_became_active":"2023-11-16T02:29:37.892384+0000","last_became_peered":"2023-11-16T02:29:37.892384+0000","last_unstale":"2023-11-16T02:29:38.878450+0000","last_undegraded":"2023-11-16T02:29:38.878450+0000","last_fullsized":"2023-11-16T02:29:38.878450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:37:34.233429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880554+0000","last_change":"2023-11-16T02:29:37.545696+0000","last_active":"2023-11-16T02:29:38.880554+0000","last_peered":"2023-11-16T02:29:38.880554+0000","last_clean":"2023-11-16T02:29:38.880554+0000","last_became_active":"2023-11-16T02:29:37.545073+0000","last_became_peered":"2023-11-16T02:29:37.545073+0000","last_unstale":"2023-11-16T02:29:38.880554+0000","last_undegraded":"2023-11-16T02:29:38.880554+0000","last_fullsized":"2023-11-16T02:29:38.880554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:04:23.421210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881635+0000","last_change":"2023-11-16T02:29:37.929853+0000","last_active":"2023-11-16T02:29:38.881635+0000","last_peered":"2023-11-16T02:29:38.881635+0000","last_clean":"2023-11-16T02:29:38.881635+0000","last_became_active":"2023-11-16T02:29:37.929199+0000","last_became_peered":"2023-11-16T02:29:37.929199+0000","last_unstale":"2023-11-16T02:29:38.881635+0000","last_undegraded":"2023-11-16T02:29:38.881635+0000","last_fullsized":"2023-11-16T02:29:38.881635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:30:42.074843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881944+0000","last_change":"2023-11-16T02:29:37.537469+0000","last_active":"2023-11-16T02:29:38.881944+0000","last_peered":"2023-11-16T02:29:38.881944+0000","last_clean":"2023-11-16T02:29:38.881944+0000","last_became_active":"2023-11-16T02:29:37.536939+0000","last_became_peered":"2023-11-16T02:29:37.536939+0000","last_unstale":"2023-11-16T02:29:38.881944+0000","last_undegraded":"2023-11-16T02:29:38.881944+0000","last_fullsized":"2023-11-16T02:29:38.881944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:42:27.512040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891189+0000","last_change":"2023-11-16T02:29:37.928255+0000","last_active":"2023-11-16T02:29:39.891189+0000","last_peered":"2023-11-16T02:29:39.891189+0000","last_clean":"2023-11-16T02:29:39.891189+0000","last_became_active":"2023-11-16T02:29:37.927823+0000","last_became_peered":"2023-11-16T02:29:37.927823+0000","last_unstale":"2023-11-16T02:29:39.891189+0000","last_undegraded":"2023-11-16T02:29:39.891189+0000","last_fullsized":"2023-11-16T02:29:39.891189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:16:58.785873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878823+0000","last_change":"2023-11-16T02:29:37.538934+0000","last_active":"2023-11-16T02:29:38.878823+0000","last_peered":"2023-11-16T02:29:38.878823+0000","last_clean":"2023-11-16T02:29:38.878823+0000","last_became_active":"2023-11-16T02:29:37.538493+0000","last_became_peered":"2023-11-16T02:29:37.538493+0000","last_unstale":"2023-11-16T02:29:38.878823+0000","last_undegraded":"2023-11-16T02:29:38.878823+0000","last_fullsized":"2023-11-16T02:29:38.878823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:38:57.277934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893023+0000","last_change":"2023-11-16T02:29:37.919752+0000","last_active":"2023-11-16T02:29:39.893023+0000","last_peered":"2023-11-16T02:29:39.893023+0000","last_clean":"2023-11-16T02:29:39.893023+0000","last_became_active":"2023-11-16T02:29:37.919021+0000","last_became_peered":"2023-11-16T02:29:37.919021+0000","last_unstale":"2023-11-16T02:29:39.893023+0000","last_undegraded":"2023-11-16T02:29:39.893023+0000","last_fullsized":"2023-11-16T02:29:39.893023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:38:58.288279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881202+0000","last_change":"2023-11-16T02:29:37.512625+0000","last_active":"2023-11-16T02:29:38.881202+0000","last_peered":"2023-11-16T02:29:38.881202+0000","last_clean":"2023-11-16T02:29:38.881202+0000","last_became_active":"2023-11-16T02:29:37.511862+0000","last_became_peered":"2023-11-16T02:29:37.511862+0000","last_unstale":"2023-11-16T02:29:38.881202+0000","last_undegraded":"2023-11-16T02:29:38.881202+0000","last_fullsized":"2023-11-16T02:29:38.881202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:45:11.372719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893382+0000","last_change":"2023-11-16T02:29:37.907846+0000","last_active":"2023-11-16T02:29:39.893382+0000","last_peered":"2023-11-16T02:29:39.893382+0000","last_clean":"2023-11-16T02:29:39.893382+0000","last_became_active":"2023-11-16T02:29:37.906680+0000","last_became_peered":"2023-11-16T02:29:37.906680+0000","last_unstale":"2023-11-16T02:29:39.893382+0000","last_undegraded":"2023-11-16T02:29:39.893382+0000","last_fullsized":"2023-11-16T02:29:39.893382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:46:36.525784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891620+0000","last_change":"2023-11-16T02:29:37.516156+0000","last_active":"2023-11-16T02:29:39.891620+0000","last_peered":"2023-11-16T02:29:39.891620+0000","last_clean":"2023-11-16T02:29:39.891620+0000","last_became_active":"2023-11-16T02:29:37.508947+0000","last_became_peered":"2023-11-16T02:29:37.508947+0000","last_unstale":"2023-11-16T02:29:39.891620+0000","last_undegraded":"2023-11-16T02:29:39.891620+0000","last_fullsized":"2023-11-16T02:29:39.891620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:28:03.017758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892055+0000","last_change":"2023-11-16T02:29:37.917898+0000","last_active":"2023-11-16T02:29:39.892055+0000","last_peered":"2023-11-16T02:29:39.892055+0000","last_clean":"2023-11-16T02:29:39.892055+0000","last_became_active":"2023-11-16T02:29:37.917588+0000","last_became_peered":"2023-11-16T02:29:37.917588+0000","last_unstale":"2023-11-16T02:29:39.892055+0000","last_undegraded":"2023-11-16T02:29:39.892055+0000","last_fullsized":"2023-11-16T02:29:39.892055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:43:20.665096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880128+0000","last_change":"2023-11-16T02:29:37.535755+0000","last_active":"2023-11-16T02:29:38.880128+0000","last_peered":"2023-11-16T02:29:38.880128+0000","last_clean":"2023-11-16T02:29:38.880128+0000","last_became_active":"2023-11-16T02:29:37.535030+0000","last_became_peered":"2023-11-16T02:29:37.535030+0000","last_unstale":"2023-11-16T02:29:38.880128+0000","last_undegraded":"2023-11-16T02:29:38.880128+0000","last_fullsized":"2023-11-16T02:29:38.880128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:10:34.206728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893470+0000","last_change":"2023-11-16T02:29:37.943232+0000","last_active":"2023-11-16T02:29:39.893470+0000","last_peered":"2023-11-16T02:29:39.893470+0000","last_clean":"2023-11-16T02:29:39.893470+0000","last_became_active":"2023-11-16T02:29:37.942561+0000","last_became_peered":"2023-11-16T02:29:37.942561+0000","last_unstale":"2023-11-16T02:29:39.893470+0000","last_undegraded":"2023-11-16T02:29:39.893470+0000","last_fullsized":"2023-11-16T02:29:39.893470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:06:38.108558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880346+0000","last_change":"2023-11-16T02:29:37.540351+0000","last_active":"2023-11-16T02:29:38.880346+0000","last_peered":"2023-11-16T02:29:38.880346+0000","last_clean":"2023-11-16T02:29:38.880346+0000","last_became_active":"2023-11-16T02:29:37.539672+0000","last_became_peered":"2023-11-16T02:29:37.539672+0000","last_unstale":"2023-11-16T02:29:38.880346+0000","last_undegraded":"2023-11-16T02:29:38.880346+0000","last_fullsized":"2023-11-16T02:29:38.880346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:57:02.655084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880380+0000","last_change":"2023-11-16T02:29:37.898389+0000","last_active":"2023-11-16T02:29:38.880380+0000","last_peered":"2023-11-16T02:29:38.880380+0000","last_clean":"2023-11-16T02:29:38.880380+0000","last_became_active":"2023-11-16T02:29:37.896101+0000","last_became_peered":"2023-11-16T02:29:37.896101+0000","last_unstale":"2023-11-16T02:29:38.880380+0000","last_undegraded":"2023-11-16T02:29:38.880380+0000","last_fullsized":"2023-11-16T02:29:38.880380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:27:01.501132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930434+0000","last_change":"2023-11-16T02:29:37.507129+0000","last_active":"2023-11-16T02:29:38.930434+0000","last_peered":"2023-11-16T02:29:38.930434+0000","last_clean":"2023-11-16T02:29:38.930434+0000","last_became_active":"2023-11-16T02:29:37.506617+0000","last_became_peered":"2023-11-16T02:29:37.506617+0000","last_unstale":"2023-11-16T02:29:38.930434+0000","last_undegraded":"2023-11-16T02:29:38.930434+0000","last_fullsized":"2023-11-16T02:29:38.930434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T09:52:00.933962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892753+0000","last_change":"2023-11-16T02:29:37.936934+0000","last_active":"2023-11-16T02:29:39.892753+0000","last_peered":"2023-11-16T02:29:39.892753+0000","last_clean":"2023-11-16T02:29:39.892753+0000","last_became_active":"2023-11-16T02:29:37.936330+0000","last_became_peered":"2023-11-16T02:29:37.936330+0000","last_unstale":"2023-11-16T02:29:39.892753+0000","last_undegraded":"2023-11-16T02:29:39.892753+0000","last_fullsized":"2023-11-16T02:29:39.892753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:10:43.990221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893035+0000","last_change":"2023-11-16T02:29:37.522370+0000","last_active":"2023-11-16T02:29:39.893035+0000","last_peered":"2023-11-16T02:29:39.893035+0000","last_clean":"2023-11-16T02:29:39.893035+0000","last_became_active":"2023-11-16T02:29:37.521575+0000","last_became_peered":"2023-11-16T02:29:37.521575+0000","last_unstale":"2023-11-16T02:29:39.893035+0000","last_undegraded":"2023-11-16T02:29:39.893035+0000","last_fullsized":"2023-11-16T02:29:39.893035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:59:52.538150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.894051+0000","last_change":"2023-11-16T02:29:37.936845+0000","last_active":"2023-11-16T02:29:39.894051+0000","last_peered":"2023-11-16T02:29:39.894051+0000","last_clean":"2023-11-16T02:29:39.894051+0000","last_became_active":"2023-11-16T02:29:37.936190+0000","last_became_peered":"2023-11-16T02:29:37.936190+0000","last_unstale":"2023-11-16T02:29:39.894051+0000","last_undegraded":"2023-11-16T02:29:39.894051+0000","last_fullsized":"2023-11-16T02:29:39.894051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:02:14.259774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930772+0000","last_change":"2023-11-16T02:29:37.513345+0000","last_active":"2023-11-16T02:29:38.930772+0000","last_peered":"2023-11-16T02:29:38.930772+0000","last_clean":"2023-11-16T02:29:38.930772+0000","last_became_active":"2023-11-16T02:29:37.512642+0000","last_became_peered":"2023-11-16T02:29:37.512642+0000","last_unstale":"2023-11-16T02:29:38.930772+0000","last_undegraded":"2023-11-16T02:29:38.930772+0000","last_fullsized":"2023-11-16T02:29:38.930772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:03:19.516009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893760+0000","last_change":"2023-11-16T02:29:37.938095+0000","last_active":"2023-11-16T02:29:39.893760+0000","last_peered":"2023-11-16T02:29:39.893760+0000","last_clean":"2023-11-16T02:29:39.893760+0000","last_became_active":"2023-11-16T02:29:37.937531+0000","last_became_peered":"2023-11-16T02:29:37.937531+0000","last_unstale":"2023-11-16T02:29:39.893760+0000","last_undegraded":"2023-11-16T02:29:39.893760+0000","last_fullsized":"2023-11-16T02:29:39.893760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:53:52.129290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878918+0000","last_change":"2023-11-16T02:29:37.519277+0000","last_active":"2023-11-16T02:29:38.878918+0000","last_peered":"2023-11-16T02:29:38.878918+0000","last_clean":"2023-11-16T02:29:38.878918+0000","last_became_active":"2023-11-16T02:29:37.518833+0000","last_became_peered":"2023-11-16T02:29:37.518833+0000","last_unstale":"2023-11-16T02:29:38.878918+0000","last_undegraded":"2023-11-16T02:29:38.878918+0000","last_fullsized":"2023-11-16T02:29:38.878918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:04:23.421210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881516+0000","last_change":"2023-11-16T02:29:37.916444+0000","last_active":"2023-11-16T02:29:38.881516+0000","last_peered":"2023-11-16T02:29:38.881516+0000","last_clean":"2023-11-16T02:29:38.881516+0000","last_became_active":"2023-11-16T02:29:37.915697+0000","last_became_peered":"2023-11-16T02:29:37.915697+0000","last_unstale":"2023-11-16T02:29:38.881516+0000","last_undegraded":"2023-11-16T02:29:38.881516+0000","last_fullsized":"2023-11-16T02:29:38.881516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:02:14.259774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930777+0000","last_change":"2023-11-16T02:29:37.544475+0000","last_active":"2023-11-16T02:29:38.930777+0000","last_peered":"2023-11-16T02:29:38.930777+0000","last_clean":"2023-11-16T02:29:38.930777+0000","last_became_active":"2023-11-16T02:29:37.544180+0000","last_became_peered":"2023-11-16T02:29:37.544180+0000","last_unstale":"2023-11-16T02:29:38.930777+0000","last_undegraded":"2023-11-16T02:29:38.930777+0000","last_fullsized":"2023-11-16T02:29:38.930777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:24:09.474240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893476+0000","last_change":"2023-11-16T02:29:37.934969+0000","last_active":"2023-11-16T02:29:39.893476+0000","last_peered":"2023-11-16T02:29:39.893476+0000","last_clean":"2023-11-16T02:29:39.893476+0000","last_became_active":"2023-11-16T02:29:37.934382+0000","last_became_peered":"2023-11-16T02:29:37.934382+0000","last_unstale":"2023-11-16T02:29:39.893476+0000","last_undegraded":"2023-11-16T02:29:39.893476+0000","last_fullsized":"2023-11-16T02:29:39.893476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:57:50.326734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":164,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-16T02:29:37.908728+0000","last_change":"2023-11-16T02:29:27.538359+0000","last_active":"2023-11-16T02:29:37.908728+0000","last_peered":"2023-11-16T02:29:37.908728+0000","last_clean":"2023-11-16T02:29:37.908728+0000","last_became_active":"2023-11-16T02:29:27.536606+0000","last_became_peered":"2023-11-16T02:29:27.536606+0000","last_unstale":"2023-11-16T02:29:37.908728+0000","last_undegraded":"2023-11-16T02:29:37.908728+0000","last_fullsized":"2023-11-16T02:29:37.908728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:26.491990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:26.491990+0000","last_clean_scrub_stamp":"2023-11-16T02:29:26.491990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:29:40.434297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.879779+0000","last_change":"2023-11-16T02:29:37.529226+0000","last_active":"2023-11-16T02:29:38.879779+0000","last_peered":"2023-11-16T02:29:38.879779+0000","last_clean":"2023-11-16T02:29:38.879779+0000","last_became_active":"2023-11-16T02:29:37.528419+0000","last_became_peered":"2023-11-16T02:29:37.528419+0000","last_unstale":"2023-11-16T02:29:38.879779+0000","last_undegraded":"2023-11-16T02:29:38.879779+0000","last_fullsized":"2023-11-16T02:29:38.879779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:57:02.655084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892100+0000","last_change":"2023-11-16T02:29:37.928597+0000","last_active":"2023-11-16T02:29:39.892100+0000","last_peered":"2023-11-16T02:29:39.892100+0000","last_clean":"2023-11-16T02:29:39.892100+0000","last_became_active":"2023-11-16T02:29:37.928277+0000","last_became_peered":"2023-11-16T02:29:37.928277+0000","last_unstale":"2023-11-16T02:29:39.892100+0000","last_undegraded":"2023-11-16T02:29:39.892100+0000","last_fullsized":"2023-11-16T02:29:39.892100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:46:36.525784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892334+0000","last_change":"2023-11-16T02:29:37.540168+0000","last_active":"2023-11-16T02:29:39.892334+0000","last_peered":"2023-11-16T02:29:39.892334+0000","last_clean":"2023-11-16T02:29:39.892334+0000","last_became_active":"2023-11-16T02:29:37.539604+0000","last_became_peered":"2023-11-16T02:29:37.539604+0000","last_unstale":"2023-11-16T02:29:39.892334+0000","last_undegraded":"2023-11-16T02:29:39.892334+0000","last_fullsized":"2023-11-16T02:29:39.892334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:45:11.372719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.890863+0000","last_change":"2023-11-16T02:29:37.928646+0000","last_active":"2023-11-16T02:29:39.890863+0000","last_peered":"2023-11-16T02:29:39.890863+0000","last_clean":"2023-11-16T02:29:39.890863+0000","last_became_active":"2023-11-16T02:29:37.927520+0000","last_became_peered":"2023-11-16T02:29:37.927520+0000","last_unstale":"2023-11-16T02:29:39.890863+0000","last_undegraded":"2023-11-16T02:29:39.890863+0000","last_fullsized":"2023-11-16T02:29:39.890863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:05:12.707357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.930813+0000","last_change":"2023-11-16T02:29:37.508498+0000","last_active":"2023-11-16T02:29:38.930813+0000","last_peered":"2023-11-16T02:29:38.930813+0000","last_clean":"2023-11-16T02:29:38.930813+0000","last_became_active":"2023-11-16T02:29:37.508091+0000","last_became_peered":"2023-11-16T02:29:37.508091+0000","last_unstale":"2023-11-16T02:29:38.930813+0000","last_undegraded":"2023-11-16T02:29:38.930813+0000","last_fullsized":"2023-11-16T02:29:38.930813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:31:57.230585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878450+0000","last_change":"2023-11-16T02:29:37.889506+0000","last_active":"2023-11-16T02:29:38.878450+0000","last_peered":"2023-11-16T02:29:38.878450+0000","last_clean":"2023-11-16T02:29:38.878450+0000","last_became_active":"2023-11-16T02:29:37.884833+0000","last_became_peered":"2023-11-16T02:29:37.884833+0000","last_unstale":"2023-11-16T02:29:38.878450+0000","last_undegraded":"2023-11-16T02:29:38.878450+0000","last_fullsized":"2023-11-16T02:29:38.878450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:05:26.649663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880343+0000","last_change":"2023-11-16T02:29:37.535414+0000","last_active":"2023-11-16T02:29:38.880343+0000","last_peered":"2023-11-16T02:29:38.880343+0000","last_clean":"2023-11-16T02:29:38.880343+0000","last_became_active":"2023-11-16T02:29:37.530060+0000","last_became_peered":"2023-11-16T02:29:37.530060+0000","last_unstale":"2023-11-16T02:29:38.880343+0000","last_undegraded":"2023-11-16T02:29:38.880343+0000","last_fullsized":"2023-11-16T02:29:38.880343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:07:57.498670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.894166+0000","last_change":"2023-11-16T02:29:37.900850+0000","last_active":"2023-11-16T02:29:39.894166+0000","last_peered":"2023-11-16T02:29:39.894166+0000","last_clean":"2023-11-16T02:29:39.894166+0000","last_became_active":"2023-11-16T02:29:37.896204+0000","last_became_peered":"2023-11-16T02:29:37.896204+0000","last_unstale":"2023-11-16T02:29:39.894166+0000","last_undegraded":"2023-11-16T02:29:39.894166+0000","last_fullsized":"2023-11-16T02:29:39.894166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:04:24.431554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878831+0000","last_change":"2023-11-16T02:29:37.515012+0000","last_active":"2023-11-16T02:29:38.878831+0000","last_peered":"2023-11-16T02:29:38.878831+0000","last_clean":"2023-11-16T02:29:38.878831+0000","last_became_active":"2023-11-16T02:29:37.514528+0000","last_became_peered":"2023-11-16T02:29:37.514528+0000","last_unstale":"2023-11-16T02:29:38.878831+0000","last_undegraded":"2023-11-16T02:29:38.878831+0000","last_fullsized":"2023-11-16T02:29:38.878831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:07:57.498670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881961+0000","last_change":"2023-11-16T02:29:37.925316+0000","last_active":"2023-11-16T02:29:38.881961+0000","last_peered":"2023-11-16T02:29:38.881961+0000","last_clean":"2023-11-16T02:29:38.881961+0000","last_became_active":"2023-11-16T02:29:37.924267+0000","last_became_peered":"2023-11-16T02:29:37.924267+0000","last_unstale":"2023-11-16T02:29:38.881961+0000","last_undegraded":"2023-11-16T02:29:38.881961+0000","last_fullsized":"2023-11-16T02:29:38.881961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:06:38.108558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893826+0000","last_change":"2023-11-16T02:29:37.544869+0000","last_active":"2023-11-16T02:29:39.893826+0000","last_peered":"2023-11-16T02:29:39.893826+0000","last_clean":"2023-11-16T02:29:39.893826+0000","last_became_active":"2023-11-16T02:29:37.544275+0000","last_became_peered":"2023-11-16T02:29:37.544275+0000","last_unstale":"2023-11-16T02:29:39.893826+0000","last_undegraded":"2023-11-16T02:29:39.893826+0000","last_fullsized":"2023-11-16T02:29:39.893826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:38:57.277934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878700+0000","last_change":"2023-11-16T02:29:37.884651+0000","last_active":"2023-11-16T02:29:38.878700+0000","last_peered":"2023-11-16T02:29:38.878700+0000","last_clean":"2023-11-16T02:29:38.878700+0000","last_became_active":"2023-11-16T02:29:37.884251+0000","last_became_peered":"2023-11-16T02:29:37.884251+0000","last_unstale":"2023-11-16T02:29:38.878700+0000","last_undegraded":"2023-11-16T02:29:38.878700+0000","last_fullsized":"2023-11-16T02:29:38.878700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:09:55.065210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:40.440759+0000","last_change":"2023-11-16T02:29:37.518697+0000","last_active":"2023-11-16T02:29:40.440759+0000","last_peered":"2023-11-16T02:29:40.440759+0000","last_clean":"2023-11-16T02:29:40.440759+0000","last_became_active":"2023-11-16T02:29:37.518275+0000","last_became_peered":"2023-11-16T02:29:37.518275+0000","last_unstale":"2023-11-16T02:29:40.440759+0000","last_undegraded":"2023-11-16T02:29:40.440759+0000","last_fullsized":"2023-11-16T02:29:40.440759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:45:11.372719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892472+0000","last_change":"2023-11-16T02:29:37.928232+0000","last_active":"2023-11-16T02:29:39.892472+0000","last_peered":"2023-11-16T02:29:39.892472+0000","last_clean":"2023-11-16T02:29:39.892472+0000","last_became_active":"2023-11-16T02:29:37.927841+0000","last_became_peered":"2023-11-16T02:29:37.927841+0000","last_unstale":"2023-11-16T02:29:39.892472+0000","last_undegraded":"2023-11-16T02:29:39.892472+0000","last_fullsized":"2023-11-16T02:29:39.892472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:06:38.108558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880867+0000","last_change":"2023-11-16T02:29:37.533118+0000","last_active":"2023-11-16T02:29:38.880867+0000","last_peered":"2023-11-16T02:29:38.880867+0000","last_clean":"2023-11-16T02:29:38.880867+0000","last_became_active":"2023-11-16T02:29:37.532348+0000","last_became_peered":"2023-11-16T02:29:37.532348+0000","last_unstale":"2023-11-16T02:29:38.880867+0000","last_undegraded":"2023-11-16T02:29:38.880867+0000","last_fullsized":"2023-11-16T02:29:38.880867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:42:27.512040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891116+0000","last_change":"2023-11-16T02:29:37.892758+0000","last_active":"2023-11-16T02:29:39.891116+0000","last_peered":"2023-11-16T02:29:39.891116+0000","last_clean":"2023-11-16T02:29:39.891116+0000","last_became_active":"2023-11-16T02:29:37.892403+0000","last_became_peered":"2023-11-16T02:29:37.892403+0000","last_unstale":"2023-11-16T02:29:39.891116+0000","last_undegraded":"2023-11-16T02:29:39.891116+0000","last_fullsized":"2023-11-16T02:29:39.891116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T02:37:34.677034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892115+0000","last_change":"2023-11-16T02:29:37.539865+0000","last_active":"2023-11-16T02:29:39.892115+0000","last_peered":"2023-11-16T02:29:39.892115+0000","last_clean":"2023-11-16T02:29:39.892115+0000","last_became_active":"2023-11-16T02:29:37.538829+0000","last_became_peered":"2023-11-16T02:29:37.538829+0000","last_unstale":"2023-11-16T02:29:39.892115+0000","last_undegraded":"2023-11-16T02:29:39.892115+0000","last_fullsized":"2023-11-16T02:29:39.892115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:09:37.990889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892445+0000","last_change":"2023-11-16T02:29:37.924136+0000","last_active":"2023-11-16T02:29:39.892445+0000","last_peered":"2023-11-16T02:29:39.892445+0000","last_clean":"2023-11-16T02:29:39.892445+0000","last_became_active":"2023-11-16T02:29:37.922911+0000","last_became_peered":"2023-11-16T02:29:37.922911+0000","last_unstale":"2023-11-16T02:29:39.892445+0000","last_undegraded":"2023-11-16T02:29:39.892445+0000","last_fullsized":"2023-11-16T02:29:39.892445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:45:12.383063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878567+0000","last_change":"2023-11-16T02:29:37.530829+0000","last_active":"2023-11-16T02:29:38.878567+0000","last_peered":"2023-11-16T02:29:38.878567+0000","last_clean":"2023-11-16T02:29:38.878567+0000","last_became_active":"2023-11-16T02:29:37.530464+0000","last_became_peered":"2023-11-16T02:29:37.530464+0000","last_unstale":"2023-11-16T02:29:38.878567+0000","last_undegraded":"2023-11-16T02:29:38.878567+0000","last_fullsized":"2023-11-16T02:29:38.878567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:42:27.512040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.892249+0000","last_change":"2023-11-16T02:29:37.886780+0000","last_active":"2023-11-16T02:29:39.892249+0000","last_peered":"2023-11-16T02:29:39.892249+0000","last_clean":"2023-11-16T02:29:39.892249+0000","last_became_active":"2023-11-16T02:29:37.885971+0000","last_became_peered":"2023-11-16T02:29:37.885971+0000","last_unstale":"2023-11-16T02:29:39.892249+0000","last_undegraded":"2023-11-16T02:29:39.892249+0000","last_fullsized":"2023-11-16T02:29:39.892249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:09:55.065210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.878991+0000","last_change":"2023-11-16T02:29:37.518075+0000","last_active":"2023-11-16T02:29:38.878991+0000","last_peered":"2023-11-16T02:29:38.878991+0000","last_clean":"2023-11-16T02:29:38.878991+0000","last_became_active":"2023-11-16T02:29:37.517639+0000","last_became_peered":"2023-11-16T02:29:37.517639+0000","last_unstale":"2023-11-16T02:29:38.878991+0000","last_undegraded":"2023-11-16T02:29:38.878991+0000","last_fullsized":"2023-11-16T02:29:38.878991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:57:02.655084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891316+0000","last_change":"2023-11-16T02:29:37.895705+0000","last_active":"2023-11-16T02:29:39.891316+0000","last_peered":"2023-11-16T02:29:39.891316+0000","last_clean":"2023-11-16T02:29:39.891316+0000","last_became_active":"2023-11-16T02:29:37.895416+0000","last_became_peered":"2023-11-16T02:29:37.895416+0000","last_unstale":"2023-11-16T02:29:39.891316+0000","last_undegraded":"2023-11-16T02:29:39.891316+0000","last_fullsized":"2023-11-16T02:29:39.891316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:43:20.665096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893707+0000","last_change":"2023-11-16T02:29:37.544189+0000","last_active":"2023-11-16T02:29:39.893707+0000","last_peered":"2023-11-16T02:29:39.893707+0000","last_clean":"2023-11-16T02:29:39.893707+0000","last_became_active":"2023-11-16T02:29:37.543571+0000","last_became_peered":"2023-11-16T02:29:37.543571+0000","last_unstale":"2023-11-16T02:29:39.893707+0000","last_undegraded":"2023-11-16T02:29:39.893707+0000","last_fullsized":"2023-11-16T02:29:39.893707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:07:57.498670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.880376+0000","last_change":"2023-11-16T02:29:37.928251+0000","last_active":"2023-11-16T02:29:38.880376+0000","last_peered":"2023-11-16T02:29:38.880376+0000","last_clean":"2023-11-16T02:29:38.880376+0000","last_became_active":"2023-11-16T02:29:37.927716+0000","last_became_peered":"2023-11-16T02:29:37.927716+0000","last_unstale":"2023-11-16T02:29:38.880376+0000","last_undegraded":"2023-11-16T02:29:38.880376+0000","last_fullsized":"2023-11-16T02:29:38.880376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:25:48.005968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881803+0000","last_change":"2023-11-16T02:29:37.939219+0000","last_active":"2023-11-16T02:29:38.881803+0000","last_peered":"2023-11-16T02:29:38.881803+0000","last_clean":"2023-11-16T02:29:38.881803+0000","last_became_active":"2023-11-16T02:29:37.938582+0000","last_became_peered":"2023-11-16T02:29:37.938582+0000","last_unstale":"2023-11-16T02:29:38.881803+0000","last_undegraded":"2023-11-16T02:29:38.881803+0000","last_fullsized":"2023-11-16T02:29:38.881803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:43:20.665096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893385+0000","last_change":"2023-11-16T02:29:37.549085+0000","last_active":"2023-11-16T02:29:39.893385+0000","last_peered":"2023-11-16T02:29:39.893385+0000","last_clean":"2023-11-16T02:29:39.893385+0000","last_became_active":"2023-11-16T02:29:37.548532+0000","last_became_peered":"2023-11-16T02:29:37.548532+0000","last_unstale":"2023-11-16T02:29:39.893385+0000","last_undegraded":"2023-11-16T02:29:39.893385+0000","last_fullsized":"2023-11-16T02:29:39.893385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:21:31.762437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:38.881938+0000","last_change":"2023-11-16T02:29:37.936750+0000","last_active":"2023-11-16T02:29:38.881938+0000","last_peered":"2023-11-16T02:29:38.881938+0000","last_clean":"2023-11-16T02:29:38.881938+0000","last_became_active":"2023-11-16T02:29:37.936169+0000","last_became_peered":"2023-11-16T02:29:37.936169+0000","last_unstale":"2023-11-16T02:29:38.881938+0000","last_undegraded":"2023-11-16T02:29:38.881938+0000","last_fullsized":"2023-11-16T02:29:38.881938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:10:43.990221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.893640+0000","last_change":"2023-11-16T02:29:37.543752+0000","last_active":"2023-11-16T02:29:39.893640+0000","last_peered":"2023-11-16T02:29:39.893640+0000","last_clean":"2023-11-16T02:29:39.893640+0000","last_became_active":"2023-11-16T02:29:37.543157+0000","last_became_peered":"2023-11-16T02:29:37.543157+0000","last_unstale":"2023-11-16T02:29:39.893640+0000","last_undegraded":"2023-11-16T02:29:39.893640+0000","last_fullsized":"2023-11-16T02:29:39.893640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:04:23.421210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891041+0000","last_change":"2023-11-16T02:29:37.928390+0000","last_active":"2023-11-16T02:29:39.891041+0000","last_peered":"2023-11-16T02:29:39.891041+0000","last_clean":"2023-11-16T02:29:39.891041+0000","last_became_active":"2023-11-16T02:29:37.928152+0000","last_became_peered":"2023-11-16T02:29:37.928152+0000","last_unstale":"2023-11-16T02:29:39.891041+0000","last_undegraded":"2023-11-16T02:29:39.891041+0000","last_fullsized":"2023-11-16T02:29:39.891041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:10:43.990221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891480+0000","last_change":"2023-11-16T02:29:37.516960+0000","last_active":"2023-11-16T02:29:39.891480+0000","last_peered":"2023-11-16T02:29:39.891480+0000","last_clean":"2023-11-16T02:29:39.891480+0000","last_became_active":"2023-11-16T02:29:37.516030+0000","last_became_peered":"2023-11-16T02:29:37.516030+0000","last_unstale":"2023-11-16T02:29:39.891480+0000","last_undegraded":"2023-11-16T02:29:39.891480+0000","last_fullsized":"2023-11-16T02:29:39.891480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:44:21.321181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891358+0000","last_change":"2023-11-16T02:29:37.909668+0000","last_active":"2023-11-16T02:29:39.891358+0000","last_peered":"2023-11-16T02:29:39.891358+0000","last_clean":"2023-11-16T02:29:39.891358+0000","last_became_active":"2023-11-16T02:29:37.909339+0000","last_became_peered":"2023-11-16T02:29:37.909339+0000","last_unstale":"2023-11-16T02:29:39.891358+0000","last_undegraded":"2023-11-16T02:29:39.891358+0000","last_fullsized":"2023-11-16T02:29:39.891358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:37.482318+0000","last_clean_scrub_stamp":"2023-11-16T02:29:37.482318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:25:48.005968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-16T02:29:39.891428+0000","last_change":"2023-11-16T02:29:37.537280+0000","last_active":"2023-11-16T02:29:39.891428+0000","last_peered":"2023-11-16T02:29:39.891428+0000","last_clean":"2023-11-16T02:29:39.891428+0000","last_became_active":"2023-11-16T02:29:37.536813+0000","last_became_peered":"2023-11-16T02:29:37.536813+0000","last_unstale":"2023-11-16T02:29:39.891428+0000","last_undegraded":"2023-11-16T02:29:39.891428+0000","last_fullsized":"2023-11-16T02:29:39.891428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:36.471974+0000","last_clean_scrub_stamp":"2023-11-16T02:29:36.471974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:44:21.321181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":819200,"data_stored":667190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]}]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31276,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340564,"statfs":{"total":96636764160,"available":96604737536,"internally_reserved":0,"allocated":233472,"data_stored":77804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.929}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.502}]}]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31268,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340572,"statfs":{"total":96636764160,"available":96604745728,"internally_reserved":0,"allocated":225280,"data_stored":76330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]}]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31276,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340564,"statfs":{"total":96636764160,"available":96604737536,"internally_reserved":0,"allocated":233472,"data_stored":76366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9860000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9689999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31276,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340564,"statfs":{"total":96636764160,"available":96604737536,"internally_reserved":0,"allocated":233472,"data_stored":77804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31272,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340568,"statfs":{"total":96636764160,"available":96604741632,"internally_reserved":0,"allocated":229376,"data_stored":76400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":827392,"data_stored":667246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31264,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340576,"statfs":{"total":96636764160,"available":96604749824,"internally_reserved":0,"allocated":221184,"data_stored":76240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-16T02:29:50.992 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-16T02:29:50.993 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-16T02:29:50.993 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-16T02:29:50.993 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-16T02:29:51.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.141+0000 7f6620db7640 1 Processor -- start 2023-11-16T02:29:51.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.141+0000 7f6620db7640 1 -- start start 2023-11-16T02:29:51.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f6620db7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f661c09bdb0 0x7f661c0700e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:51.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f6620db7640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f661c06fc50 con 0x7f661c06cc40 2023-11-16T02:29:51.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f6620db7640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f661c071ad0 con 0x7f661c148a00 2023-11-16T02:29:51.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f6620db7640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f661c09c1c0 con 0x7f661c09bdb0 2023-11-16T02:29:51.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f661a59c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f661c06cc40 0x7f661c145c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55922/0 (socket says 172.21.15.28:55922) 2023-11-16T02:29:51.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f661a59c640 1 -- 172.21.15.28:0/1206594514 learned_addr learned my addr 172.21.15.28:0/1206594514 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:51.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f6619d9b640 1 -- 172.21.15.28:0/1206594514 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518533684 0 0) 0x7f661c06fc50 con 0x7f661c06cc40 2023-11-16T02:29:51.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f6619d9b640 1 -- 172.21.15.28:0/1206594514 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6608003530 con 0x7f661c06cc40 2023-11-16T02:29:51.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f661ad9d640 1 --2- 172.21.15.28:0/1206594514 >> v2:172.21.15.70:3300/0 conn(0x7f661c09bdb0 0x7f661c0700e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:51.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f6619d9b640 1 -- 172.21.15.28:0/1206594514 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1868905688 0 0) 0x7f6608003530 con 0x7f661c06cc40 2023-11-16T02:29:51.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f6619d9b640 1 -- 172.21.15.28:0/1206594514 >> v2:172.21.15.70:3300/0 conn(0x7f661c09bdb0 msgr2=0x7f661c0700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:51.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f6619d9b640 1 --2- 172.21.15.28:0/1206594514 >> v2:172.21.15.70:3300/0 conn(0x7f661c09bdb0 0x7f661c0700e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f6619d9b640 1 -- 172.21.15.28:0/1206594514 >> v1:172.21.15.70:6789/0 conn(0x7f661c148a00 legacy=0x7f661c151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:51.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f6619d9b640 1 -- 172.21.15.28:0/1206594514 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661c071d50 con 0x7f661c06cc40 2023-11-16T02:29:51.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f6619d9b640 1 -- 172.21.15.28:0/1206594514 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7f6604001680 con 0x7f661c06cc40 2023-11-16T02:29:51.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f6619d9b640 1 -- 172.21.15.28:0/1206594514 >> v1:172.21.15.28:6789/0 conn(0x7f661c06cc40 legacy=0x7f661c145c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:51.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f6619d9b640 1 --2- 172.21.15.28:0/1206594514 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6608003980 0x7f6608003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:51.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f6619d9b640 1 --2- 172.21.15.28:0/1206594514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66080047d0 0x7f6608004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:51.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f6619d9b640 1 --2- 172.21.15.28:0/1206594514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6608005190 0x7f660800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:51.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f6619d9b640 1 -- 172.21.15.28:0/1206594514 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660800c070 con 0x7f6608005190 2023-11-16T02:29:51.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f6619d9b640 1 -- 172.21.15.28:0/1206594514 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660800c1e0 con 0x7f66080047d0 2023-11-16T02:29:51.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f6619d9b640 1 -- 172.21.15.28:0/1206594514 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660800c3a0 con 0x7f6608003980 2023-11-16T02:29:51.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f661ad9d640 1 --2- 172.21.15.28:0/1206594514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6608005190 0x7f660800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:51.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f661a59c640 1 --2- 172.21.15.28:0/1206594514 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6608003980 0x7f6608003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:51.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f661ad9d640 1 -- 172.21.15.28:0/1206594514 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6608003980 msgr2=0x7f6608003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:51.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f661ad9d640 1 --2- 172.21.15.28:0/1206594514 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f6608003980 0x7f6608003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f661ad9d640 1 -- 172.21.15.28:0/1206594514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66080047d0 msgr2=0x7f6608004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:51.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f6613fff640 1 --2- 172.21.15.28:0/1206594514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66080047d0 0x7f6608004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:51.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f661ad9d640 1 --2- 172.21.15.28:0/1206594514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66080047d0 0x7f6608004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f661ad9d640 1 -- 172.21.15.28:0/1206594514 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6608003530 con 0x7f6608005190 2023-11-16T02:29:51.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f661ad9d640 1 -- 172.21.15.28:0/1206594514 reap_dead start 2023-11-16T02:29:51.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f661ad9d640 1 --2- 172.21.15.28:0/1206594514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6608005190 0x7f660800b990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6614007360 tx=0x7f661401ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b33b91c74aecdf2 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:51.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f6619d9b640 1 -- 172.21.15.28:0/1206594514 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66140a5d60 con 0x7f6608005190 2023-11-16T02:29:51.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f6619d9b640 1 -- 172.21.15.28:0/1206594514 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66140039a0 con 0x7f6608005190 2023-11-16T02:29:51.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.145+0000 7f6619d9b640 1 -- 172.21.15.28:0/1206594514 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6614003d50 con 0x7f6608005190 2023-11-16T02:29:51.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f6620db7640 1 -- 172.21.15.28:0/1206594514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6608005190 msgr2=0x7f660800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:51.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f6620db7640 1 --2- 172.21.15.28:0/1206594514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6608005190 0x7f660800b990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6614007360 tx=0x7f661401ce60 comp rx=0 tx=0).stop 2023-11-16T02:29:51.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f6620db7640 1 -- 172.21.15.28:0/1206594514 shutdown_connections 2023-11-16T02:29:51.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f6620db7640 1 --2- 172.21.15.28:0/1206594514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6608005190 0x7f660800b990 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f6620db7640 1 -- 172.21.15.28:0/1206594514 >> 172.21.15.28:0/1206594514 conn(0x7f661c06bec0 msgr2=0x7f661c06c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:51.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f6620db7640 1 -- 172.21.15.28:0/1206594514 shutdown_connections 2023-11-16T02:29:51.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f6620db7640 1 -- 172.21.15.28:0/1206594514 wait complete. 2023-11-16T02:29:51.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f6620db7640 1 Processor -- start 2023-11-16T02:29:51.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f6620db7640 1 -- start start 2023-11-16T02:29:51.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f6620db7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6608005190 0x7f661c0b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:51.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f6620db7640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f661c0b4520 0x7f661c142eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:51.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f6620db7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f661c1433f0 0x7f661c1dfb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:51.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f6620db7640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661c1438a0 con 0x7f661c1433f0 2023-11-16T02:29:51.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f6620db7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661c0b6a10 con 0x7f6608005190 2023-11-16T02:29:51.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f6620db7640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661c0b59c0 con 0x7f661c0b4520 2023-11-16T02:29:51.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f661ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f661c1433f0 0x7f661c1dfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:51.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f661ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f661c1433f0 0x7f661c1dfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47130/0 (socket says 172.21.15.28:47130) 2023-11-16T02:29:51.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f661ad9d640 1 -- 172.21.15.28:0/3940470287 learned_addr learned my addr 172.21.15.28:0/3940470287 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:51.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f661a59c640 1 --2- 172.21.15.28:0/3940470287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6608005190 0x7f661c0b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:51.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f6613fff640 1 --2- 172.21.15.28:0/3940470287 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f661c0b4520 0x7f661c142eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:51.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f661ad9d640 1 -- 172.21.15.28:0/3940470287 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f661c0b4520 msgr2=0x7f661c142eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:51.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f661ad9d640 1 --2- 172.21.15.28:0/3940470287 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f661c0b4520 0x7f661c142eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f661ad9d640 1 -- 172.21.15.28:0/3940470287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6608005190 msgr2=0x7f661c0b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:51.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f661ad9d640 1 --2- 172.21.15.28:0/3940470287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6608005190 0x7f661c0b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f661ad9d640 1 -- 172.21.15.28:0/3940470287 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661c0b5ca0 con 0x7f661c1433f0 2023-11-16T02:29:51.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f661ad9d640 1 --2- 172.21.15.28:0/3940470287 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f661c1433f0 0x7f661c1dfb40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f661401d700 tx=0x7f6614019c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:51.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f6612ffd640 1 -- 172.21.15.28:0/3940470287 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66140b5600 con 0x7f661c1433f0 2023-11-16T02:29:51.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f6612ffd640 1 -- 172.21.15.28:0/3940470287 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66140b5780 con 0x7f661c1433f0 2023-11-16T02:29:51.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f6620db7640 1 -- 172.21.15.28:0/3940470287 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f661c0b5f80 con 0x7f661c1433f0 2023-11-16T02:29:51.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f6612ffd640 1 -- 172.21.15.28:0/3940470287 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66140b5b30 con 0x7f661c1433f0 2023-11-16T02:29:51.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f6620db7640 1 -- 172.21.15.28:0/3940470287 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f661c09fa50 con 0x7f661c1433f0 2023-11-16T02:29:51.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.149+0000 7f6620db7640 1 -- 172.21.15.28:0/3940470287 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f661c04e8a0 con 0x7f661c1433f0 2023-11-16T02:29:51.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.153+0000 7f6612ffd640 1 -- 172.21.15.28:0/3940470287 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f66140b5c90 con 0x7f661c1433f0 2023-11-16T02:29:51.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.153+0000 7f6612ffd640 1 --2- 172.21.15.28:0/3940470287 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f65fc065a90 0x7f65fc067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:51.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.153+0000 7f6612ffd640 1 -- 172.21.15.28:0/3940470287 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f661411d970 con 0x7f661c1433f0 2023-11-16T02:29:51.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.153+0000 7f661a59c640 1 --2- 172.21.15.28:0/3940470287 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f65fc065a90 0x7f65fc067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:51.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.153+0000 7f661a59c640 1 --2- 172.21.15.28:0/3940470287 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f65fc065a90 0x7f65fc067f50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6604000c10 tx=0x7f6604009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:51.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.157+0000 7f6612ffd640 1 -- 172.21.15.28:0/3940470287 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f66140eb380 con 0x7f661c1433f0 2023-11-16T02:29:51.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.337+0000 7f6620db7640 1 -- 172.21.15.28:0/3940470287 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f661c0b6170 con 0x7f661c1433f0 2023-11-16T02:29:51.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.337+0000 7f6612ffd640 1 -- 172.21.15.28:0/3940470287 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f66140ee9a0 con 0x7f661c1433f0 2023-11-16T02:29:51.343 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:51.343 INFO:teuthology.orchestra.run.smithi028.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-16T02:29:51.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.341+0000 7f6620db7640 1 -- 172.21.15.28:0/3940470287 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f65fc065a90 msgr2=0x7f65fc067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:51.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.341+0000 7f6620db7640 1 --2- 172.21.15.28:0/3940470287 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f65fc065a90 0x7f65fc067f50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6604000c10 tx=0x7f6604009040 comp rx=0 tx=0).stop 2023-11-16T02:29:51.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.341+0000 7f6620db7640 1 -- 172.21.15.28:0/3940470287 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f661c1433f0 msgr2=0x7f661c1dfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:51.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.341+0000 7f6620db7640 1 --2- 172.21.15.28:0/3940470287 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f661c1433f0 0x7f661c1dfb40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f661401d700 tx=0x7f6614019c00 comp rx=0 tx=0).stop 2023-11-16T02:29:51.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.341+0000 7f6620db7640 1 -- 172.21.15.28:0/3940470287 shutdown_connections 2023-11-16T02:29:51.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.341+0000 7f6620db7640 1 --2- 172.21.15.28:0/3940470287 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f65fc065a90 0x7f65fc067f50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.341+0000 7f6620db7640 1 --2- 172.21.15.28:0/3940470287 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f661c1433f0 0x7f661c1dfb40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.341+0000 7f6620db7640 1 --2- 172.21.15.28:0/3940470287 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f661c0b4520 0x7f661c142eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.341+0000 7f6620db7640 1 --2- 172.21.15.28:0/3940470287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6608005190 0x7f661c0b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.341+0000 7f6620db7640 1 -- 172.21.15.28:0/3940470287 >> 172.21.15.28:0/3940470287 conn(0x7f661c06bec0 msgr2=0x7f661c0b2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:51.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.341+0000 7f6620db7640 1 -- 172.21.15.28:0/3940470287 shutdown_connections 2023-11-16T02:29:51.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.341+0000 7f6620db7640 1 -- 172.21.15.28:0/3940470287 wait complete. 2023-11-16T02:29:51.360 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-16T02:29:51.360 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-16T02:29:51.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.477+0000 7fc1e6de6640 1 Processor -- start 2023-11-16T02:29:51.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.477+0000 7fc1e6de6640 1 -- start start 2023-11-16T02:29:51.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.477+0000 7fc1e6de6640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc1e0148960 0x7fc1e00b3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:51.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.477+0000 7fc1e6de6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc1e0148df0 0x7fc1e00b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:51.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.477+0000 7fc1e6de6640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e00b52b0 con 0x7fc1e00b8240 2023-11-16T02:29:51.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.477+0000 7fc1e6de6640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e00bcdb0 con 0x7fc1e0148df0 2023-11-16T02:29:51.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.477+0000 7fc1e6de6640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e00b6220 con 0x7fc1e0148960 2023-11-16T02:29:51.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.477+0000 7fc1e5383640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc1e0148df0 0x7fc1e00b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:51.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.477+0000 7fc1e4b82640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc1e00b8240 0x7fc1e00bc6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55924/0 (socket says 172.21.15.28:55924) 2023-11-16T02:29:51.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.477+0000 7fc1e4b82640 1 -- 172.21.15.28:0/1234595477 learned_addr learned my addr 172.21.15.28:0/1234595477 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:51.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.477+0000 7fc1dffff640 1 --2- 172.21.15.28:0/1234595477 >> v2:172.21.15.70:3300/0 conn(0x7fc1e0148960 0x7fc1e00b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:51.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.477+0000 7fc1e5383640 1 -- 172.21.15.28:0/1234595477 >> v2:172.21.15.70:3300/0 conn(0x7fc1e0148960 msgr2=0x7fc1e00b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:51.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.477+0000 7fc1e5383640 1 --2- 172.21.15.28:0/1234595477 >> v2:172.21.15.70:3300/0 conn(0x7fc1e0148960 0x7fc1e00b3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.477+0000 7fc1e5383640 1 -- 172.21.15.28:0/1234595477 >> v1:172.21.15.28:6789/0 conn(0x7fc1e00b8240 legacy=0x7fc1e00bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:51.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.477+0000 7fc1e5383640 1 -- 172.21.15.28:0/1234595477 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e00b4040 con 0x7fc1e0148df0 2023-11-16T02:29:51.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.477+0000 7fc1df7fe640 1 -- 172.21.15.28:0/1234595477 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755362799 0 0) 0x7fc1e00b52b0 con 0x7fc1e00b8240 2023-11-16T02:29:51.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.477+0000 7fc1e5383640 1 --2- 172.21.15.28:0/1234595477 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc1e0148df0 0x7fc1e00b3990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00bd040 tx=0x7fc1d801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0d4511122e68c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:51.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1df7fe640 1 -- 172.21.15.28:0/1234595477 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d80a59a0 con 0x7fc1e0148df0 2023-11-16T02:29:51.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1df7fe640 1 -- 172.21.15.28:0/1234595477 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d80a5b00 con 0x7fc1e0148df0 2023-11-16T02:29:51.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1df7fe640 1 -- 172.21.15.28:0/1234595477 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d80a5e90 con 0x7fc1e0148df0 2023-11-16T02:29:51.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e6de6640 1 -- 172.21.15.28:0/1234595477 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc1e0148df0 msgr2=0x7fc1e00b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:51.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e6de6640 1 --2- 172.21.15.28:0/1234595477 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc1e0148df0 0x7fc1e00b3990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00bd040 tx=0x7fc1d801c8e0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e6de6640 1 -- 172.21.15.28:0/1234595477 shutdown_connections 2023-11-16T02:29:51.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e6de6640 1 --2- 172.21.15.28:0/1234595477 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc1e0148df0 0x7fc1e00b3990 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e6de6640 1 --2- 172.21.15.28:0/1234595477 >> v2:172.21.15.70:3300/0 conn(0x7fc1e0148960 0x7fc1e00b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e6de6640 1 -- 172.21.15.28:0/1234595477 >> 172.21.15.28:0/1234595477 conn(0x7fc1e00b9050 msgr2=0x7fc1e00bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:51.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e6de6640 1 -- 172.21.15.28:0/1234595477 shutdown_connections 2023-11-16T02:29:51.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e6de6640 1 -- 172.21.15.28:0/1234595477 wait complete. 2023-11-16T02:29:51.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e6de6640 1 Processor -- start 2023-11-16T02:29:51.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e6de6640 1 -- start start 2023-11-16T02:29:51.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e6de6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc1e00b8240 0x7fc1e00b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:51.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e6de6640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc1e0148960 0x7fc1e01e4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:51.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e6de6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1e0148df0 0x7fc1e01e4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:51.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e6de6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e00b7250 con 0x7fc1e00b8240 2023-11-16T02:29:51.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e6de6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e0142590 con 0x7fc1e0148df0 2023-11-16T02:29:51.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e6de6640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e0143370 con 0x7fc1e0148960 2023-11-16T02:29:51.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e4b82640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc1e00b8240 0x7fc1e00b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:51.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e4b82640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc1e00b8240 0x7fc1e00b6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47136/0 (socket says 172.21.15.28:47136) 2023-11-16T02:29:51.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e4b82640 1 -- 172.21.15.28:0/4058483144 learned_addr learned my addr 172.21.15.28:0/4058483144 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:51.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e5383640 1 --2- 172.21.15.28:0/4058483144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1e0148df0 0x7fc1e01e4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:51.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1dffff640 1 --2- 172.21.15.28:0/4058483144 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc1e0148960 0x7fc1e01e4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:51.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e4b82640 1 -- 172.21.15.28:0/4058483144 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc1e0148960 msgr2=0x7fc1e01e4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:51.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e4b82640 1 --2- 172.21.15.28:0/4058483144 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc1e0148960 0x7fc1e01e4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e4b82640 1 -- 172.21.15.28:0/4058483144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1e0148df0 msgr2=0x7fc1e01e4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:51.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e4b82640 1 --2- 172.21.15.28:0/4058483144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1e0148df0 0x7fc1e01e4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e4b82640 1 -- 172.21.15.28:0/4058483144 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d8009a70 con 0x7fc1e00b8240 2023-11-16T02:29:51.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e5383640 1 --2- 172.21.15.28:0/4058483144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1e0148df0 0x7fc1e01e4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:29:51.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e4b82640 1 --2- 172.21.15.28:0/4058483144 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc1e00b8240 0x7fc1e00b6d10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40011f0 tx=0x7fc1d400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:51.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1dd7fa640 1 -- 172.21.15.28:0/4058483144 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d40074e0 con 0x7fc1e00b8240 2023-11-16T02:29:51.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1dd7fa640 1 -- 172.21.15.28:0/4058483144 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d4007640 con 0x7fc1e00b8240 2023-11-16T02:29:51.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e6de6640 1 -- 172.21.15.28:0/4058483144 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e0142010 con 0x7fc1e00b8240 2023-11-16T02:29:51.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1dd7fa640 1 -- 172.21.15.28:0/4058483144 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4004a10 con 0x7fc1e00b8240 2023-11-16T02:29:51.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.481+0000 7fc1e6de6640 1 -- 172.21.15.28:0/4058483144 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e0144590 con 0x7fc1e00b8240 2023-11-16T02:29:51.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.485+0000 7fc1e6de6640 1 -- 172.21.15.28:0/4058483144 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e0143530 con 0x7fc1e00b8240 2023-11-16T02:29:51.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.485+0000 7fc1dd7fa640 1 -- 172.21.15.28:0/4058483144 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc1d4004b70 con 0x7fc1e00b8240 2023-11-16T02:29:51.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.485+0000 7fc1dd7fa640 1 --2- 172.21.15.28:0/4058483144 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc1c4065a60 0x7fc1c4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:51.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.485+0000 7fc1dd7fa640 1 -- 172.21.15.28:0/4058483144 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1d4082280 con 0x7fc1e00b8240 2023-11-16T02:29:51.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.485+0000 7fc1dffff640 1 --2- 172.21.15.28:0/4058483144 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc1c4065a60 0x7fc1c4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:51.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.485+0000 7fc1dffff640 1 --2- 172.21.15.28:0/4058483144 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc1c4065a60 0x7fc1c4067f20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00b7ef0 tx=0x7fc1cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:51.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.489+0000 7fc1dd7fa640 1 -- 172.21.15.28:0/4058483144 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fc1d404fcd0 con 0x7fc1e00b8240 2023-11-16T02:29:51.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.637+0000 7fc1e6de6640 1 -- 172.21.15.28:0/4058483144 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1e004e8a0 con 0x7fc1e00b8240 2023-11-16T02:29:51.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.641+0000 7fc1dd7fa640 1 -- 172.21.15.28:0/4058483144 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15989 (secure 0 0 0) 0x7fc1d40532f0 con 0x7fc1e00b8240 2023-11-16T02:29:51.645 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:51.645 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":22,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","created":"2023-11-16T02:29:13.710567+0000","modified":"2023-11-16T02:29:38.871066+0000","last_up_change":"2023-11-16T02:29:24.841087+0000","last_in_change":"2023-11-16T02:29:16.024490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-16T02:29:26.490910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-16T02:29:36.133224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-16T02:29:36.866156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dfa8b58d-3481-4e68-86e8-21873d31d0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":38722},{"type":"v1","addr":"172.21.15.28:6809","nonce":38722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":38722},{"type":"v1","addr":"172.21.15.28:6811","nonce":38722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":38722},{"type":"v1","addr":"172.21.15.28:6815","nonce":38722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":38722},{"type":"v1","addr":"172.21.15.28:6813","nonce":38722}]},"public_addr":"172.21.15.28:6809/38722","cluster_addr":"172.21.15.28:6811/38722","heartbeat_back_addr":"172.21.15.28:6815/38722","heartbeat_front_addr":"172.21.15.28:6813/38722","state":["exists","up"]},{"osd":1,"uuid":"1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":38724},{"type":"v1","addr":"172.21.15.28:6824","nonce":38724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":38724},{"type":"v1","addr":"172.21.15.28:6827","nonce":38724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":38724},{"type":"v1","addr":"172.21.15.28:6831","nonce":38724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":38724},{"type":"v1","addr":"172.21.15.28:6829","nonce":38724}]},"public_addr":"172.21.15.28:6824/38724","cluster_addr":"172.21.15.28:6827/38724","heartbeat_back_addr":"172.21.15.28:6831/38724","heartbeat_front_addr":"172.21.15.28:6829/38724","state":["exists","up"]},{"osd":2,"uuid":"e18f39cd-6a35-4d36-9eed-3877794bf2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":38723},{"type":"v1","addr":"172.21.15.28:6801","nonce":38723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":38723},{"type":"v1","addr":"172.21.15.28:6803","nonce":38723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":38723},{"type":"v1","addr":"172.21.15.28:6807","nonce":38723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":38723},{"type":"v1","addr":"172.21.15.28:6805","nonce":38723}]},"public_addr":"172.21.15.28:6801/38723","cluster_addr":"172.21.15.28:6803/38723","heartbeat_back_addr":"172.21.15.28:6807/38723","heartbeat_front_addr":"172.21.15.28:6805/38723","state":["exists","up"]},{"osd":3,"uuid":"303d0728-409d-47d7-b7a6-6eb273f602fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":38725},{"type":"v1","addr":"172.21.15.28:6817","nonce":38725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":38725},{"type":"v1","addr":"172.21.15.28:6819","nonce":38725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":38725},{"type":"v1","addr":"172.21.15.28:6825","nonce":38725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":38725},{"type":"v1","addr":"172.21.15.28:6821","nonce":38725}]},"public_addr":"172.21.15.28:6817/38725","cluster_addr":"172.21.15.28:6819/38725","heartbeat_back_addr":"172.21.15.28:6825/38725","heartbeat_front_addr":"172.21.15.28:6821/38725","state":["exists","up"]},{"osd":4,"uuid":"df0bf0ac-6efe-4964-ad27-7c1771a70c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":38828},{"type":"v1","addr":"172.21.15.70:6801","nonce":38828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":38828},{"type":"v1","addr":"172.21.15.70:6803","nonce":38828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":38828},{"type":"v1","addr":"172.21.15.70:6807","nonce":38828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":38828},{"type":"v1","addr":"172.21.15.70:6805","nonce":38828}]},"public_addr":"172.21.15.70:6801/38828","cluster_addr":"172.21.15.70:6803/38828","heartbeat_back_addr":"172.21.15.70:6807/38828","heartbeat_front_addr":"172.21.15.70:6805/38828","state":["exists","up"]},{"osd":5,"uuid":"84921219-65cb-4c4e-b9ed-a773db639034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":38830},{"type":"v1","addr":"172.21.15.70:6810","nonce":38830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6813","nonce":38830},{"type":"v1","addr":"172.21.15.70:6814","nonce":38830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":38830},{"type":"v1","addr":"172.21.15.70:6824","nonce":38830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":38830},{"type":"v1","addr":"172.21.15.70:6819","nonce":38830}]},"public_addr":"172.21.15.70:6810/38830","cluster_addr":"172.21.15.70:6814/38830","heartbeat_back_addr":"172.21.15.70:6824/38830","heartbeat_front_addr":"172.21.15.70:6819/38830","state":["exists","up"]},{"osd":6,"uuid":"c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":38829},{"type":"v1","addr":"172.21.15.70:6812","nonce":38829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":38829},{"type":"v1","addr":"172.21.15.70:6820","nonce":38829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":38829},{"type":"v1","addr":"172.21.15.70:6828","nonce":38829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":38829},{"type":"v1","addr":"172.21.15.70:6825","nonce":38829}]},"public_addr":"172.21.15.70:6812/38829","cluster_addr":"172.21.15.70:6820/38829","heartbeat_back_addr":"172.21.15.70:6828/38829","heartbeat_front_addr":"172.21.15.70:6825/38829","state":["exists","up"]},{"osd":7,"uuid":"e2cdd418-12ce-4eea-9b22-efdad83eb76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":38839},{"type":"v1","addr":"172.21.15.70:6815","nonce":38839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":38839},{"type":"v1","addr":"172.21.15.70:6823","nonce":38839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":38839},{"type":"v1","addr":"172.21.15.70:6831","nonce":38839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6827","nonce":38839},{"type":"v1","addr":"172.21.15.70:6829","nonce":38839}]},"public_addr":"172.21.15.70:6815/38839","cluster_addr":"172.21.15.70:6823/38839","heartbeat_back_addr":"172.21.15.70:6831/38839","heartbeat_front_addr":"172.21.15.70:6829/38839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.544240+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.637637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.352115+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.652916+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.624477+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.570247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.706468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.696574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-16T02:29:51.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.645+0000 7fc1e6de6640 1 -- 172.21.15.28:0/4058483144 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc1c4065a60 msgr2=0x7fc1c4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:51.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.645+0000 7fc1e6de6640 1 --2- 172.21.15.28:0/4058483144 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc1c4065a60 0x7fc1c4067f20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00b7ef0 tx=0x7fc1cc008040 comp rx=0 tx=0).stop 2023-11-16T02:29:51.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.645+0000 7fc1e6de6640 1 -- 172.21.15.28:0/4058483144 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc1e00b8240 msgr2=0x7fc1e00b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:51.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.645+0000 7fc1e6de6640 1 --2- 172.21.15.28:0/4058483144 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc1e00b8240 0x7fc1e00b6d10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40011f0 tx=0x7fc1d400c9b0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.645+0000 7fc1e6de6640 1 -- 172.21.15.28:0/4058483144 shutdown_connections 2023-11-16T02:29:51.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.645+0000 7fc1e6de6640 1 --2- 172.21.15.28:0/4058483144 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc1c4065a60 0x7fc1c4067f20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.645+0000 7fc1e6de6640 1 --2- 172.21.15.28:0/4058483144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1e0148df0 0x7fc1e01e4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.645+0000 7fc1e6de6640 1 --2- 172.21.15.28:0/4058483144 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc1e0148960 0x7fc1e01e4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.645+0000 7fc1e6de6640 1 --2- 172.21.15.28:0/4058483144 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc1e00b8240 0x7fc1e00b6d10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.645+0000 7fc1e6de6640 1 -- 172.21.15.28:0/4058483144 >> 172.21.15.28:0/4058483144 conn(0x7fc1e00b9050 msgr2=0x7fc1e00bc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:51.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.645+0000 7fc1e6de6640 1 -- 172.21.15.28:0/4058483144 shutdown_connections 2023-11-16T02:29:51.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.645+0000 7fc1e6de6640 1 -- 172.21.15.28:0/4058483144 wait complete. 2023-11-16T02:29:51.663 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-16T02:29:26.490910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-16T02:29:36.133224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-16T02:29:36.866156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-16T02:29:51.664 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-16T02:29:51.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f403e35d640 1 Processor -- start 2023-11-16T02:29:51.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f403e35d640 1 -- start start 2023-11-16T02:29:51.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f403e35d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f403806a550 0x7f40380b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:51.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f403e35d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4038071800 con 0x7f403806a170 2023-11-16T02:29:51.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f403e35d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40380b5ec0 con 0x7f40380b7c60 2023-11-16T02:29:51.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f403e35d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40380b6350 con 0x7f403806a550 2023-11-16T02:29:51.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f4037fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f403806a170 0x7f4038148a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55936/0 (socket says 172.21.15.28:55936) 2023-11-16T02:29:51.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f4037fff640 1 -- 172.21.15.28:0/595995171 learned_addr learned my addr 172.21.15.28:0/595995171 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:51.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f4036ffd640 1 -- 172.21.15.28:0/595995171 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2138915193 0 0) 0x7f4028001120 con 0x7f403806a170 2023-11-16T02:29:51.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f4036ffd640 1 -- 172.21.15.28:0/595995171 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4020003530 con 0x7f403806a170 2023-11-16T02:29:51.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f40377fe640 1 --2- 172.21.15.28:0/595995171 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f403806a550 0x7f40380b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:51.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f4036ffd640 1 -- 172.21.15.28:0/595995171 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1032906157 0 0) 0x7f4020003530 con 0x7f403806a170 2023-11-16T02:29:51.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f4036ffd640 1 -- 172.21.15.28:0/595995171 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f403806a550 msgr2=0x7f40380b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:51.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f4036ffd640 1 --2- 172.21.15.28:0/595995171 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f403806a550 0x7f40380b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f4036ffd640 1 -- 172.21.15.28:0/595995171 >> v1:172.21.15.70:6789/0 conn(0x7f40380b7c60 legacy=0x7f4038153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:51.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f4036ffd640 1 -- 172.21.15.28:0/595995171 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40380b5870 con 0x7f403806a170 2023-11-16T02:29:51.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f4036ffd640 1 -- 172.21.15.28:0/595995171 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7f4028001810 con 0x7f403806a170 2023-11-16T02:29:51.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f4036ffd640 1 -- 172.21.15.28:0/595995171 >> v1:172.21.15.28:6789/0 conn(0x7f403806a170 legacy=0x7f4038148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:51.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f4036ffd640 1 --2- 172.21.15.28:0/595995171 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f40200039b0 0x7f4020003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:51.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f4036ffd640 1 --2- 172.21.15.28:0/595995171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40200047d0 0x7f4020004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:51.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f4036ffd640 1 --2- 172.21.15.28:0/595995171 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f403806a550 0x7f402000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:51.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f4036ffd640 1 -- 172.21.15.28:0/595995171 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40380b6350 con 0x7f40200039b0 2023-11-16T02:29:51.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f4036ffd640 1 -- 172.21.15.28:0/595995171 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40200054f0 con 0x7f40200047d0 2023-11-16T02:29:51.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f4036ffd640 1 -- 172.21.15.28:0/595995171 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402000bed0 con 0x7f403806a550 2023-11-16T02:29:51.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f4037fff640 1 --2- 172.21.15.28:0/595995171 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f40200039b0 0x7f4020003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:51.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f40377fe640 1 --2- 172.21.15.28:0/595995171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40200047d0 0x7f4020004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:51.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f4037fff640 1 -- 172.21.15.28:0/595995171 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f403806a550 msgr2=0x7f402000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:51.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f403c8fa640 1 --2- 172.21.15.28:0/595995171 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f403806a550 0x7f402000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:51.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f4037fff640 1 --2- 172.21.15.28:0/595995171 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f403806a550 0x7f402000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f4037fff640 1 -- 172.21.15.28:0/595995171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40200047d0 msgr2=0x7f4020004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:51.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f4037fff640 1 --2- 172.21.15.28:0/595995171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40200047d0 0x7f4020004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f4037fff640 1 -- 172.21.15.28:0/595995171 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4020003530 con 0x7f40200039b0 2023-11-16T02:29:51.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f40377fe640 1 --2- 172.21.15.28:0/595995171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40200047d0 0x7f4020004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:51.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.785+0000 7f403c8fa640 1 --2- 172.21.15.28:0/595995171 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f403806a550 0x7f402000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:51.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f4037fff640 1 --2- 172.21.15.28:0/595995171 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f40200039b0 0x7f4020003dd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f402800c190 tx=0x7f402801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e074c6d2a39e9ac server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:51.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f4036ffd640 1 -- 172.21.15.28:0/595995171 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4028005ae0 con 0x7f40200039b0 2023-11-16T02:29:51.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f4036ffd640 1 -- 172.21.15.28:0/595995171 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4028005c60 con 0x7f40200039b0 2023-11-16T02:29:51.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f4036ffd640 1 -- 172.21.15.28:0/595995171 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280a5810 con 0x7f40200039b0 2023-11-16T02:29:51.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f403e35d640 1 -- 172.21.15.28:0/595995171 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f40200039b0 msgr2=0x7f4020003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:51.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f403e35d640 1 --2- 172.21.15.28:0/595995171 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f40200039b0 0x7f4020003dd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f402800c190 tx=0x7f402801cc20 comp rx=0 tx=0).stop 2023-11-16T02:29:51.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f403c8fa640 1 -- 172.21.15.28:0/595995171 reap_dead start 2023-11-16T02:29:51.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f403e35d640 1 -- 172.21.15.28:0/595995171 shutdown_connections 2023-11-16T02:29:51.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f403e35d640 1 -- 172.21.15.28:0/595995171 >> 172.21.15.28:0/595995171 conn(0x7f40380bc5a0 msgr2=0x7f40380bc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:51.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f403e35d640 1 -- 172.21.15.28:0/595995171 shutdown_connections 2023-11-16T02:29:51.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f403e35d640 1 -- 172.21.15.28:0/595995171 wait complete. 2023-11-16T02:29:51.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f403e35d640 1 Processor -- start 2023-11-16T02:29:51.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f403e35d640 1 -- start start 2023-11-16T02:29:51.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f403e35d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f403813cf00 0x7f403806fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:51.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f403e35d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4038148070 0x7f40380700a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:51.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f403e35d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f403813db80 0x7f403813e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:51.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f403e35d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40381472b0 con 0x7f403813cf00 2023-11-16T02:29:51.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f403e35d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4038146ca0 con 0x7f4038148070 2023-11-16T02:29:51.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f403e35d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4038146f40 con 0x7f403813db80 2023-11-16T02:29:51.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f4037fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f403813cf00 0x7f403806fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:51.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f4037fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f403813cf00 0x7f403806fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47150/0 (socket says 172.21.15.28:47150) 2023-11-16T02:29:51.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f4037fff640 1 -- 172.21.15.28:0/2935247190 learned_addr learned my addr 172.21.15.28:0/2935247190 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:51.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f40377fe640 1 --2- 172.21.15.28:0/2935247190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4038148070 0x7f40380700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:51.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f4037fff640 1 -- 172.21.15.28:0/2935247190 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f403813db80 msgr2=0x7f403813e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:51.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f403c8fa640 1 --2- 172.21.15.28:0/2935247190 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f403813db80 0x7f403813e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:51.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f4037fff640 1 --2- 172.21.15.28:0/2935247190 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f403813db80 0x7f403813e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f4037fff640 1 -- 172.21.15.28:0/2935247190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4038148070 msgr2=0x7f40380700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:51.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f4037fff640 1 --2- 172.21.15.28:0/2935247190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4038148070 0x7f40380700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f4037fff640 1 -- 172.21.15.28:0/2935247190 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4038070d40 con 0x7f403813cf00 2023-11-16T02:29:51.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f40377fe640 1 --2- 172.21.15.28:0/2935247190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4038148070 0x7f40380700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:51.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f4037fff640 1 --2- 172.21.15.28:0/2935247190 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f403813cf00 0x7f403806fb60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f402801ca50 tx=0x7f4020005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:51.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f4034ff9640 1 -- 172.21.15.28:0/2935247190 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280b4070 con 0x7f403813cf00 2023-11-16T02:29:51.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f4034ff9640 1 -- 172.21.15.28:0/2935247190 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40280a5e70 con 0x7f403813cf00 2023-11-16T02:29:51.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f403e35d640 1 -- 172.21.15.28:0/2935247190 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f403813d2e0 con 0x7f403813cf00 2023-11-16T02:29:51.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f4034ff9640 1 -- 172.21.15.28:0/2935247190 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4028000ee0 con 0x7f403813cf00 2023-11-16T02:29:51.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.789+0000 7f403e35d640 1 -- 172.21.15.28:0/2935247190 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40381541d0 con 0x7f403813cf00 2023-11-16T02:29:51.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.793+0000 7f403e35d640 1 -- 172.21.15.28:0/2935247190 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f403804e8a0 con 0x7f403813cf00 2023-11-16T02:29:51.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.793+0000 7f4034ff9640 1 -- 172.21.15.28:0/2935247190 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f40280015d0 con 0x7f403813cf00 2023-11-16T02:29:51.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.793+0000 7f4034ff9640 1 --2- 172.21.15.28:0/2935247190 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4024065a90 0x7f4024067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:51.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.793+0000 7f4034ff9640 1 -- 172.21.15.28:0/2935247190 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f402811c5f0 con 0x7f403813cf00 2023-11-16T02:29:51.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.793+0000 7f40377fe640 1 --2- 172.21.15.28:0/2935247190 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4024065a90 0x7f4024067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:51.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.793+0000 7f40377fe640 1 --2- 172.21.15.28:0/2935247190 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4024065a90 0x7f4024067f50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f40380709a0 tx=0x7f402c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:51.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.797+0000 7f4034ff9640 1 -- 172.21.15.28:0/2935247190 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f40280e9fb0 con 0x7f403813cf00 2023-11-16T02:29:51.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.953+0000 7f403e35d640 1 -- 172.21.15.28:0/2935247190 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4038071800 con 0x7f403813cf00 2023-11-16T02:29:51.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.953+0000 7f4034ff9640 1 -- 172.21.15.28:0/2935247190 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4038071800 con 0x7f403813cf00 2023-11-16T02:29:51.956 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-11-16T02:29:51.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.953+0000 7f403e35d640 1 -- 172.21.15.28:0/2935247190 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4024065a90 msgr2=0x7f4024067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:51.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.953+0000 7f403e35d640 1 --2- 172.21.15.28:0/2935247190 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4024065a90 0x7f4024067f50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f40380709a0 tx=0x7f402c008040 comp rx=0 tx=0).stop 2023-11-16T02:29:51.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.953+0000 7f403e35d640 1 -- 172.21.15.28:0/2935247190 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f403813cf00 msgr2=0x7f403806fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:51.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.953+0000 7f403e35d640 1 --2- 172.21.15.28:0/2935247190 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f403813cf00 0x7f403806fb60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f402801ca50 tx=0x7f4020005800 comp rx=0 tx=0).stop 2023-11-16T02:29:51.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.953+0000 7f403e35d640 1 -- 172.21.15.28:0/2935247190 shutdown_connections 2023-11-16T02:29:51.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.953+0000 7f403e35d640 1 --2- 172.21.15.28:0/2935247190 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4024065a90 0x7f4024067f50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.953+0000 7f403e35d640 1 --2- 172.21.15.28:0/2935247190 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f403813db80 0x7f403813e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.953+0000 7f403e35d640 1 --2- 172.21.15.28:0/2935247190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4038148070 0x7f40380700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.953+0000 7f403e35d640 1 --2- 172.21.15.28:0/2935247190 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f403813cf00 0x7f403806fb60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:51.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.953+0000 7f403e35d640 1 -- 172.21.15.28:0/2935247190 >> 172.21.15.28:0/2935247190 conn(0x7f40380bc5a0 msgr2=0x7f40380b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:51.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.953+0000 7f403e35d640 1 -- 172.21.15.28:0/2935247190 shutdown_connections 2023-11-16T02:29:51.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:51.953+0000 7f403e35d640 1 -- 172.21.15.28:0/2935247190 wait complete. 2023-11-16T02:29:51.976 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-16T02:29:52.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.101+0000 7f4d7bcf9640 1 Processor -- start 2023-11-16T02:29:52.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.101+0000 7f4d7bcf9640 1 -- start start 2023-11-16T02:29:52.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.101+0000 7f4d7bcf9640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4d7406a170 0x7f4d740b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:52.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.101+0000 7f4d7bcf9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4d7406a550 0x7f4d74148a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:52.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.101+0000 7f4d7bcf9640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d74071800 con 0x7f4d74148fa0 2023-11-16T02:29:52.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.101+0000 7f4d7bcf9640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d740b5ec0 con 0x7f4d7406a550 2023-11-16T02:29:52.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.101+0000 7f4d7bcf9640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d740b6350 con 0x7f4d7406a170 2023-11-16T02:29:52.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.105+0000 7f4d79294640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4d7406a550 0x7f4d74148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:52.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.105+0000 7f4d7a296640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f4d74148fa0 0x7f4d740b7c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55942/0 (socket says 172.21.15.28:55942) 2023-11-16T02:29:52.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.105+0000 7f4d7a296640 1 -- 172.21.15.28:0/39540716 learned_addr learned my addr 172.21.15.28:0/39540716 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:52.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.105+0000 7f4d79a95640 1 --2- 172.21.15.28:0/39540716 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4d7406a170 0x7f4d740b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:52.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.105+0000 7f4d79294640 1 -- 172.21.15.28:0/39540716 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4d7406a170 msgr2=0x7f4d740b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:52.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.105+0000 7f4d79294640 1 --2- 172.21.15.28:0/39540716 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4d7406a170 0x7f4d740b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.105+0000 7f4d79294640 1 -- 172.21.15.28:0/39540716 >> v1:172.21.15.28:6789/0 conn(0x7f4d74148fa0 legacy=0x7f4d740b7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:52.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.105+0000 7f4d79294640 1 -- 172.21.15.28:0/39540716 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d740b5870 con 0x7f4d7406a550 2023-11-16T02:29:52.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.105+0000 7f4d79a95640 1 --2- 172.21.15.28:0/39540716 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4d7406a170 0x7f4d740b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:52.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.105+0000 7f4d79294640 1 --2- 172.21.15.28:0/39540716 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d7406a550 0x7f4d74148a60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4d700097c0 tx=0x7f4d7001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e723f93e3b74da server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:52.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.105+0000 7f4d78a93640 1 -- 172.21.15.28:0/39540716 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d700ad640 con 0x7f4d7406a550 2023-11-16T02:29:52.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.105+0000 7f4d78a93640 1 -- 172.21.15.28:0/39540716 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d700ad7a0 con 0x7f4d7406a550 2023-11-16T02:29:52.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.105+0000 7f4d78a93640 1 -- 172.21.15.28:0/39540716 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d700adb30 con 0x7f4d7406a550 2023-11-16T02:29:52.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.105+0000 7f4d7bcf9640 1 -- 172.21.15.28:0/39540716 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d7406a550 msgr2=0x7f4d74148a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:52.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.105+0000 7f4d7bcf9640 1 --2- 172.21.15.28:0/39540716 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d7406a550 0x7f4d74148a60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4d700097c0 tx=0x7f4d7001c3f0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.105+0000 7f4d7bcf9640 1 -- 172.21.15.28:0/39540716 shutdown_connections 2023-11-16T02:29:52.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.105+0000 7f4d7bcf9640 1 --2- 172.21.15.28:0/39540716 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d7406a550 0x7f4d74148a60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.105+0000 7f4d7bcf9640 1 --2- 172.21.15.28:0/39540716 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4d7406a170 0x7f4d740b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.105+0000 7f4d7bcf9640 1 -- 172.21.15.28:0/39540716 >> 172.21.15.28:0/39540716 conn(0x7f4d740bc5a0 msgr2=0x7f4d740bc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:52.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.105+0000 7f4d7bcf9640 1 -- 172.21.15.28:0/39540716 shutdown_connections 2023-11-16T02:29:52.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.105+0000 7f4d7bcf9640 1 -- 172.21.15.28:0/39540716 wait complete. 2023-11-16T02:29:52.113 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.109+0000 7f4d7bcf9640 1 Processor -- start 2023-11-16T02:29:52.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.109+0000 7f4d7bcf9640 1 -- start start 2023-11-16T02:29:52.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.109+0000 7f4d7bcf9640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4d7406a170 0x7f4d74149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:52.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.109+0000 7f4d7bcf9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d7406a550 0x7f4d741e4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:52.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.109+0000 7f4d7bcf9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d74148fa0 0x7f4d741360e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:52.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.109+0000 7f4d7bcf9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7413ab30 con 0x7f4d7406a550 2023-11-16T02:29:52.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.109+0000 7f4d7bcf9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d741e4eb0 con 0x7f4d74148fa0 2023-11-16T02:29:52.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.109+0000 7f4d7bcf9640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7413bc90 con 0x7f4d7406a170 2023-11-16T02:29:52.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.109+0000 7f4d79294640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d7406a550 0x7f4d741e4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:52.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.109+0000 7f4d79294640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d7406a550 0x7f4d741e4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47172/0 (socket says 172.21.15.28:47172) 2023-11-16T02:29:52.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.109+0000 7f4d79294640 1 -- 172.21.15.28:0/303533426 learned_addr learned my addr 172.21.15.28:0/303533426 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:52.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.109+0000 7f4d79a95640 1 --2- 172.21.15.28:0/303533426 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4d7406a170 0x7f4d74149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:52.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.109+0000 7f4d7a296640 1 --2- 172.21.15.28:0/303533426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d74148fa0 0x7f4d741360e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:52.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.109+0000 7f4d79294640 1 -- 172.21.15.28:0/303533426 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4d7406a170 msgr2=0x7f4d74149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:52.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.109+0000 7f4d79294640 1 --2- 172.21.15.28:0/303533426 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4d7406a170 0x7f4d74149df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.109+0000 7f4d79294640 1 -- 172.21.15.28:0/303533426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d74148fa0 msgr2=0x7f4d741360e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:52.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.109+0000 7f4d79294640 1 --2- 172.21.15.28:0/303533426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d74148fa0 0x7f4d741360e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.109+0000 7f4d79294640 1 -- 172.21.15.28:0/303533426 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d70009420 con 0x7f4d7406a550 2023-11-16T02:29:52.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.109+0000 7f4d79294640 1 --2- 172.21.15.28:0/303533426 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d7406a550 0x7f4d741e4540 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4d7001a020 tx=0x7f4d70019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:52.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.109+0000 7f4d6a7fc640 1 -- 172.21.15.28:0/303533426 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d700b6820 con 0x7f4d7406a550 2023-11-16T02:29:52.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.109+0000 7f4d6a7fc640 1 -- 172.21.15.28:0/303533426 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d700a6040 con 0x7f4d7406a550 2023-11-16T02:29:52.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.109+0000 7f4d7bcf9640 1 -- 172.21.15.28:0/303533426 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7414a330 con 0x7f4d7406a550 2023-11-16T02:29:52.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.109+0000 7f4d6a7fc640 1 -- 172.21.15.28:0/303533426 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d700b6be0 con 0x7f4d7406a550 2023-11-16T02:29:52.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.109+0000 7f4d7bcf9640 1 -- 172.21.15.28:0/303533426 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7414c480 con 0x7f4d7406a550 2023-11-16T02:29:52.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.109+0000 7f4d7bcf9640 1 -- 172.21.15.28:0/303533426 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d740b2670 con 0x7f4d7406a550 2023-11-16T02:29:52.116 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.109+0000 7f4d6a7fc640 1 -- 172.21.15.28:0/303533426 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4d700b4040 con 0x7f4d7406a550 2023-11-16T02:29:52.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.113+0000 7f4d6a7fc640 1 --2- 172.21.15.28:0/303533426 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4d58065a60 0x7f4d58067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:52.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.113+0000 7f4d79a95640 1 --2- 172.21.15.28:0/303533426 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4d58065a60 0x7f4d58067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:52.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.113+0000 7f4d6a7fc640 1 -- 172.21.15.28:0/303533426 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d7011d4a0 con 0x7f4d7406a550 2023-11-16T02:29:52.117 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.113+0000 7f4d79a95640 1 --2- 172.21.15.28:0/303533426 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4d58065a60 0x7f4d58067f20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4d64006fd0 tx=0x7f4d64008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:52.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.117+0000 7f4d6a7fc640 1 -- 172.21.15.28:0/303533426 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f4d700eaef0 con 0x7f4d7406a550 2023-11-16T02:29:52.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.269+0000 7f4d7bcf9640 1 -- 172.21.15.28:0/303533426 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4d7404e8a0 con 0x7f4d7406a550 2023-11-16T02:29:52.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.269+0000 7f4d6a7fc640 1 -- 172.21.15.28:0/303533426 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4d700ee510 con 0x7f4d7406a550 2023-11-16T02:29:52.274 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-11-16T02:29:52.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.269+0000 7f4d7bcf9640 1 -- 172.21.15.28:0/303533426 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4d58065a60 msgr2=0x7f4d58067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:52.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.269+0000 7f4d7bcf9640 1 --2- 172.21.15.28:0/303533426 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4d58065a60 0x7f4d58067f20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4d64006fd0 tx=0x7f4d64008040 comp rx=0 tx=0).stop 2023-11-16T02:29:52.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.269+0000 7f4d7bcf9640 1 -- 172.21.15.28:0/303533426 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d7406a550 msgr2=0x7f4d741e4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:52.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.269+0000 7f4d7bcf9640 1 --2- 172.21.15.28:0/303533426 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d7406a550 0x7f4d741e4540 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4d7001a020 tx=0x7f4d70019190 comp rx=0 tx=0).stop 2023-11-16T02:29:52.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.269+0000 7f4d7bcf9640 1 -- 172.21.15.28:0/303533426 shutdown_connections 2023-11-16T02:29:52.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.269+0000 7f4d7bcf9640 1 --2- 172.21.15.28:0/303533426 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4d58065a60 0x7f4d58067f20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.269+0000 7f4d7bcf9640 1 --2- 172.21.15.28:0/303533426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d74148fa0 0x7f4d741360e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.269+0000 7f4d7bcf9640 1 --2- 172.21.15.28:0/303533426 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d7406a550 0x7f4d741e4540 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.269+0000 7f4d7bcf9640 1 --2- 172.21.15.28:0/303533426 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4d7406a170 0x7f4d74149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.269+0000 7f4d7bcf9640 1 -- 172.21.15.28:0/303533426 >> 172.21.15.28:0/303533426 conn(0x7f4d740bc5a0 msgr2=0x7f4d740b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:52.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.273+0000 7f4d7bcf9640 1 -- 172.21.15.28:0/303533426 shutdown_connections 2023-11-16T02:29:52.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.273+0000 7f4d7bcf9640 1 -- 172.21.15.28:0/303533426 wait complete. 2023-11-16T02:29:52.290 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-16T02:29:52.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.405+0000 7fe1a7c51640 1 Processor -- start 2023-11-16T02:29:52.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.405+0000 7fe1a7c51640 1 -- start start 2023-11-16T02:29:52.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.405+0000 7fe1a7c51640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe1a01448a0 0x7fe1a0144d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:52.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.405+0000 7fe1a7c51640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe1a014e490 0x7fe1a014e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:52.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.405+0000 7fe1a7c51640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a0071060 con 0x7fe1a0065b90 2023-11-16T02:29:52.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.405+0000 7fe1a7c51640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a006b680 con 0x7fe1a014e490 2023-11-16T02:29:52.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.405+0000 7fe1a7c51640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a00705c0 con 0x7fe1a01448a0 2023-11-16T02:29:52.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.405+0000 7fe1a61ee640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe1a014e490 0x7fe1a014e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:52.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.405+0000 7fe1a61ee640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe1a014e490 0x7fe1a014e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47180/0 (socket says 172.21.15.28:47180) 2023-11-16T02:29:52.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.405+0000 7fe1a61ee640 1 -- 172.21.15.28:0/476604057 learned_addr learned my addr 172.21.15.28:0/476604057 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:52.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.405+0000 7fe1a59ed640 1 --1- 172.21.15.28:0/476604057 >> v1:172.21.15.28:6789/0 conn(0x7fe1a0065b90 0x7fe1a006af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55950/0 (socket says 172.21.15.28:55950) 2023-11-16T02:29:52.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.405+0000 7fe1a51ec640 1 --2- 172.21.15.28:0/476604057 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe1a01448a0 0x7fe1a0144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:52.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.405+0000 7fe1a61ee640 1 -- 172.21.15.28:0/476604057 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe1a01448a0 msgr2=0x7fe1a0144d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:52.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.405+0000 7fe1a61ee640 1 --2- 172.21.15.28:0/476604057 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe1a01448a0 0x7fe1a0144d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.405+0000 7fe1a61ee640 1 -- 172.21.15.28:0/476604057 >> v1:172.21.15.28:6789/0 conn(0x7fe1a0065b90 legacy=0x7fe1a006af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:52.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.405+0000 7fe1a61ee640 1 -- 172.21.15.28:0/476604057 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a014ee20 con 0x7fe1a014e490 2023-11-16T02:29:52.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.405+0000 7fe1a61ee640 1 --2- 172.21.15.28:0/476604057 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1a014e490 0x7fe1a014e8e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe198009e50 tx=0x7fe19801f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e98da6d104697 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:52.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.405+0000 7fe1a49eb640 1 -- 172.21.15.28:0/476604057 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1980af400 con 0x7fe1a014e490 2023-11-16T02:29:52.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.405+0000 7fe1a49eb640 1 -- 172.21.15.28:0/476604057 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1980ab050 con 0x7fe1a014e490 2023-11-16T02:29:52.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.405+0000 7fe1a49eb640 1 -- 172.21.15.28:0/476604057 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1980af780 con 0x7fe1a014e490 2023-11-16T02:29:52.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a7c51640 1 -- 172.21.15.28:0/476604057 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1a014e490 msgr2=0x7fe1a014e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:52.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a7c51640 1 --2- 172.21.15.28:0/476604057 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1a014e490 0x7fe1a014e8e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe198009e50 tx=0x7fe19801f1f0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a7c51640 1 -- 172.21.15.28:0/476604057 shutdown_connections 2023-11-16T02:29:52.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a7c51640 1 --2- 172.21.15.28:0/476604057 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1a014e490 0x7fe1a014e8e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a7c51640 1 --2- 172.21.15.28:0/476604057 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe1a01448a0 0x7fe1a0144d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a7c51640 1 -- 172.21.15.28:0/476604057 >> 172.21.15.28:0/476604057 conn(0x7fe1a0069d70 msgr2=0x7fe1a006a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:52.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a7c51640 1 -- 172.21.15.28:0/476604057 shutdown_connections 2023-11-16T02:29:52.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a7c51640 1 -- 172.21.15.28:0/476604057 wait complete. 2023-11-16T02:29:52.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a7c51640 1 Processor -- start 2023-11-16T02:29:52.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a7c51640 1 -- start start 2023-11-16T02:29:52.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a7c51640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1a0065b90 0x7fe1a01e34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:52.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a7c51640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe1a01448a0 0x7fe1a01d76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:52.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a7c51640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1a014e490 0x7fe1a0146e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:52.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a7c51640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a01d7c00 con 0x7fe1a014e490 2023-11-16T02:29:52.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a7c51640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a0146670 con 0x7fe1a0065b90 2023-11-16T02:29:52.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a7c51640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a01e3ae0 con 0x7fe1a01448a0 2023-11-16T02:29:52.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a61ee640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1a014e490 0x7fe1a0146e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:52.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a61ee640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1a014e490 0x7fe1a0146e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47192/0 (socket says 172.21.15.28:47192) 2023-11-16T02:29:52.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a61ee640 1 -- 172.21.15.28:0/546652272 learned_addr learned my addr 172.21.15.28:0/546652272 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:52.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a59ed640 1 --2- 172.21.15.28:0/546652272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1a0065b90 0x7fe1a01e34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:52.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a51ec640 1 --2- 172.21.15.28:0/546652272 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe1a01448a0 0x7fe1a01d76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:52.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a61ee640 1 -- 172.21.15.28:0/546652272 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe1a01448a0 msgr2=0x7fe1a01d76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:52.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a61ee640 1 --2- 172.21.15.28:0/546652272 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe1a01448a0 0x7fe1a01d76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a61ee640 1 -- 172.21.15.28:0/546652272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1a0065b90 msgr2=0x7fe1a01e34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:52.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a61ee640 1 --2- 172.21.15.28:0/546652272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1a0065b90 0x7fe1a01e34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a61ee640 1 -- 172.21.15.28:0/546652272 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe198009b30 con 0x7fe1a014e490 2023-11-16T02:29:52.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a59ed640 1 --2- 172.21.15.28:0/546652272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1a0065b90 0x7fe1a01e34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:52.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a61ee640 1 --2- 172.21.15.28:0/546652272 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1a014e490 0x7fe1a0146e50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe19801ce20 tx=0x7fe19801bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:52.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1967fc640 1 -- 172.21.15.28:0/546652272 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1980afde0 con 0x7fe1a014e490 2023-11-16T02:29:52.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1967fc640 1 -- 172.21.15.28:0/546652272 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe198009510 con 0x7fe1a014e490 2023-11-16T02:29:52.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a7c51640 1 -- 172.21.15.28:0/546652272 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a01e3dc0 con 0x7fe1a014e490 2023-11-16T02:29:52.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1967fc640 1 -- 172.21.15.28:0/546652272 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1980ba660 con 0x7fe1a014e490 2023-11-16T02:29:52.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a7c51640 1 -- 172.21.15.28:0/546652272 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a013b850 con 0x7fe1a014e490 2023-11-16T02:29:52.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.409+0000 7fe1a7c51640 1 -- 172.21.15.28:0/546652272 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a01e3f50 con 0x7fe1a014e490 2023-11-16T02:29:52.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.413+0000 7fe1967fc640 1 -- 172.21.15.28:0/546652272 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe1980b6040 con 0x7fe1a014e490 2023-11-16T02:29:52.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.413+0000 7fe1967fc640 1 --2- 172.21.15.28:0/546652272 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe184065a60 0x7fe184067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:52.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.413+0000 7fe1967fc640 1 -- 172.21.15.28:0/546652272 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe198121d20 con 0x7fe1a014e490 2023-11-16T02:29:52.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.413+0000 7fe1a59ed640 1 --2- 172.21.15.28:0/546652272 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe184065a60 0x7fe184067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:52.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.413+0000 7fe1a59ed640 1 --2- 172.21.15.28:0/546652272 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe184065a60 0x7fe184067f20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe19c007fd0 tx=0x7fe19c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:52.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.417+0000 7fe1967fc640 1 -- 172.21.15.28:0/546652272 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fe1980efa30 con 0x7fe1a014e490 2023-11-16T02:29:52.574 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.569+0000 7fe1a7c51640 1 -- 172.21.15.28:0/546652272 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe1a004e8a0 con 0x7fe1a014e490 2023-11-16T02:29:52.574 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.569+0000 7fe1967fc640 1 -- 172.21.15.28:0/546652272 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe1980f3050 con 0x7fe1a014e490 2023-11-16T02:29:52.574 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-11-16T02:29:52.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.573+0000 7fe1a7c51640 1 -- 172.21.15.28:0/546652272 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe184065a60 msgr2=0x7fe184067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:52.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.573+0000 7fe1a7c51640 1 --2- 172.21.15.28:0/546652272 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe184065a60 0x7fe184067f20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe19c007fd0 tx=0x7fe19c009040 comp rx=0 tx=0).stop 2023-11-16T02:29:52.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.573+0000 7fe1a7c51640 1 -- 172.21.15.28:0/546652272 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1a014e490 msgr2=0x7fe1a0146e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:52.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.573+0000 7fe1a7c51640 1 --2- 172.21.15.28:0/546652272 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1a014e490 0x7fe1a0146e50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe19801ce20 tx=0x7fe19801bf90 comp rx=0 tx=0).stop 2023-11-16T02:29:52.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.573+0000 7fe1a7c51640 1 -- 172.21.15.28:0/546652272 shutdown_connections 2023-11-16T02:29:52.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.573+0000 7fe1a7c51640 1 --2- 172.21.15.28:0/546652272 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe184065a60 0x7fe184067f20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.573+0000 7fe1a7c51640 1 --2- 172.21.15.28:0/546652272 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1a014e490 0x7fe1a0146e50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.573+0000 7fe1a7c51640 1 --2- 172.21.15.28:0/546652272 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe1a01448a0 0x7fe1a01d76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.573+0000 7fe1a7c51640 1 --2- 172.21.15.28:0/546652272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1a0065b90 0x7fe1a01e34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.573+0000 7fe1a7c51640 1 -- 172.21.15.28:0/546652272 >> 172.21.15.28:0/546652272 conn(0x7fe1a0069d70 msgr2=0x7fe1a013f020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:52.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.573+0000 7fe1a7c51640 1 -- 172.21.15.28:0/546652272 shutdown_connections 2023-11-16T02:29:52.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.573+0000 7fe1a7c51640 1 -- 172.21.15.28:0/546652272 wait complete. 2023-11-16T02:29:52.593 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-16T02:29:52.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.701+0000 7fd6b891b640 1 Processor -- start 2023-11-16T02:29:52.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.701+0000 7fd6b891b640 1 -- start start 2023-11-16T02:29:52.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.705+0000 7fd6b891b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd6b40b8c90 0x7fd6b406d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:52.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.705+0000 7fd6b891b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6b40b2180 0x7fd6b41418d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:52.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.705+0000 7fd6b891b640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b406cbf0 con 0x7fd6b4141e10 2023-11-16T02:29:52.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.705+0000 7fd6b891b640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b4148840 con 0x7fd6b40b8c90 2023-11-16T02:29:52.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.705+0000 7fd6b891b640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b4148560 con 0x7fd6b40b2180 2023-11-16T02:29:52.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.705+0000 7fd6b259c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd6b40b8c90 0x7fd6b406d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:52.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.705+0000 7fd6b259c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd6b40b8c90 0x7fd6b406d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47198/0 (socket says 172.21.15.28:47198) 2023-11-16T02:29:52.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.705+0000 7fd6b259c640 1 -- 172.21.15.28:0/3398109514 learned_addr learned my addr 172.21.15.28:0/3398109514 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:52.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.705+0000 7fd6abfff640 1 --2- 172.21.15.28:0/3398109514 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6b40b2180 0x7fd6b41418d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:52.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.705+0000 7fd6b259c640 1 -- 172.21.15.28:0/3398109514 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6b40b2180 msgr2=0x7fd6b41418d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:52.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.705+0000 7fd6b259c640 1 --2- 172.21.15.28:0/3398109514 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6b40b2180 0x7fd6b41418d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.705+0000 7fd6b259c640 1 -- 172.21.15.28:0/3398109514 >> v1:172.21.15.70:6789/0 conn(0x7fd6b4141e10 legacy=0x7fd6b4147910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:52.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.705+0000 7fd6b259c640 1 -- 172.21.15.28:0/3398109514 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b406c880 con 0x7fd6b40b8c90 2023-11-16T02:29:52.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.709+0000 7fd6b259c640 1 --2- 172.21.15.28:0/3398109514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6b40b8c90 0x7fd6b406d080 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009870 tx=0x7fd6a401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e3e1c776687be7e server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:52.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.709+0000 7fd6b1d9b640 1 -- 172.21.15.28:0/3398109514 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b406d7d0 con 0x7fd6b40b8c90 2023-11-16T02:29:52.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.709+0000 7fd6b1d9b640 1 -- 172.21.15.28:0/3398109514 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a40aa640 con 0x7fd6b40b8c90 2023-11-16T02:29:52.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.709+0000 7fd6b1d9b640 1 -- 172.21.15.28:0/3398109514 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a40aa9d0 con 0x7fd6b40b8c90 2023-11-16T02:29:52.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.709+0000 7fd6b891b640 1 -- 172.21.15.28:0/3398109514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6b40b8c90 msgr2=0x7fd6b406d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:52.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.709+0000 7fd6b891b640 1 --2- 172.21.15.28:0/3398109514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6b40b8c90 0x7fd6b406d080 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009870 tx=0x7fd6a401c500 comp rx=0 tx=0).stop 2023-11-16T02:29:52.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.709+0000 7fd6b891b640 1 -- 172.21.15.28:0/3398109514 shutdown_connections 2023-11-16T02:29:52.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.709+0000 7fd6b891b640 1 --2- 172.21.15.28:0/3398109514 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6b40b2180 0x7fd6b41418d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.709+0000 7fd6b891b640 1 --2- 172.21.15.28:0/3398109514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6b40b8c90 0x7fd6b406d080 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.709+0000 7fd6b891b640 1 -- 172.21.15.28:0/3398109514 >> 172.21.15.28:0/3398109514 conn(0x7fd6b40b9b20 msgr2=0x7fd6b40b9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:52.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.709+0000 7fd6b891b640 1 -- 172.21.15.28:0/3398109514 shutdown_connections 2023-11-16T02:29:52.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.709+0000 7fd6b891b640 1 -- 172.21.15.28:0/3398109514 wait complete. 2023-11-16T02:29:52.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.709+0000 7fd6b891b640 1 Processor -- start 2023-11-16T02:29:52.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.709+0000 7fd6b891b640 1 -- start start 2023-11-16T02:29:52.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.713+0000 7fd6b891b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6b40b2180 0x7fd6b409ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:52.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.713+0000 7fd6b891b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6b40b8c90 0x7fd6b4139410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:52.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.713+0000 7fd6b891b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6b4141e10 0x7fd6b41e6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:52.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.713+0000 7fd6b891b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b409d7d0 con 0x7fd6b40b8c90 2023-11-16T02:29:52.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.713+0000 7fd6b891b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b40bcbd0 con 0x7fd6b40b2180 2023-11-16T02:29:52.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.713+0000 7fd6b891b640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b409d3a0 con 0x7fd6b4141e10 2023-11-16T02:29:52.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.713+0000 7fd6abfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6b40b8c90 0x7fd6b4139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:52.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.713+0000 7fd6abfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6b40b8c90 0x7fd6b4139410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47210/0 (socket says 172.21.15.28:47210) 2023-11-16T02:29:52.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.713+0000 7fd6abfff640 1 -- 172.21.15.28:0/290200631 learned_addr learned my addr 172.21.15.28:0/290200631 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:52.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.713+0000 7fd6abfff640 1 -- 172.21.15.28:0/290200631 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6b4141e10 msgr2=0x7fd6b41e6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:52.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.713+0000 7fd6abfff640 1 --2- 172.21.15.28:0/290200631 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6b4141e10 0x7fd6b41e6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.713+0000 7fd6abfff640 1 -- 172.21.15.28:0/290200631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6b40b2180 msgr2=0x7fd6b409ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:52.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.713+0000 7fd6abfff640 1 --2- 172.21.15.28:0/290200631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6b40b2180 0x7fd6b409ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.713+0000 7fd6abfff640 1 -- 172.21.15.28:0/290200631 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a40094d0 con 0x7fd6b40b8c90 2023-11-16T02:29:52.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.713+0000 7fd6abfff640 1 --2- 172.21.15.28:0/290200631 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6b40b8c90 0x7fd6b4139410 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00c7f0 tx=0x7fd69c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:52.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.713+0000 7fd6aaffd640 1 -- 172.21.15.28:0/290200631 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c004220 con 0x7fd6b40b8c90 2023-11-16T02:29:52.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.713+0000 7fd6aaffd640 1 -- 172.21.15.28:0/290200631 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69c0043a0 con 0x7fd6b40b8c90 2023-11-16T02:29:52.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.713+0000 7fd6aaffd640 1 -- 172.21.15.28:0/290200631 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c004510 con 0x7fd6b40b8c90 2023-11-16T02:29:52.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.713+0000 7fd6b891b640 1 -- 172.21.15.28:0/290200631 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b40a2090 con 0x7fd6b40b8c90 2023-11-16T02:29:52.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.713+0000 7fd6b891b640 1 -- 172.21.15.28:0/290200631 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b409e4a0 con 0x7fd6b40b8c90 2023-11-16T02:29:52.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.713+0000 7fd6b891b640 1 -- 172.21.15.28:0/290200631 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b4066f00 con 0x7fd6b40b8c90 2023-11-16T02:29:52.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.713+0000 7fd6aaffd640 1 -- 172.21.15.28:0/290200631 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd69c003a70 con 0x7fd6b40b8c90 2023-11-16T02:29:52.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.713+0000 7fd6aaffd640 1 --2- 172.21.15.28:0/290200631 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fd694065a90 0x7fd694067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:52.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.713+0000 7fd6b259c640 1 --2- 172.21.15.28:0/290200631 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fd694065a90 0x7fd694067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:52.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.713+0000 7fd6aaffd640 1 -- 172.21.15.28:0/290200631 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd69c083150 con 0x7fd6b40b8c90 2023-11-16T02:29:52.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.713+0000 7fd6b259c640 1 --2- 172.21.15.28:0/290200631 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fd694065a90 0x7fd694067f50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd6a40ae000 tx=0x7fd6a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:52.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.717+0000 7fd6aaffd640 1 -- 172.21.15.28:0/290200631 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fd69c050a70 con 0x7fd6b40b8c90 2023-11-16T02:29:52.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.901+0000 7fd6b891b640 1 -- 172.21.15.28:0/290200631 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6b40a1ef0 con 0x7fd6b40b8c90 2023-11-16T02:29:52.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.901+0000 7fd6aaffd640 1 -- 172.21.15.28:0/290200631 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3883 (secure 0 0 0) 0x7fd6b40a1ef0 con 0x7fd6b40b8c90 2023-11-16T02:29:52.904 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:52.904 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/4054669002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":4054669002},{"type":"v1","addr":"172.21.15.28:6836","nonce":4054669002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/903740631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":903740631},{"type":"v1","addr":"172.21.15.70:6833","nonce":903740631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-16T02:29:37.868031+0000","modified":"2023-11-16T02:29:40.877544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6837/1025130674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1025130674},{"type":"v1","addr":"172.21.15.28:6837","nonce":1025130674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-16T02:29:52.905 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 7 2023-11-16T02:29:52.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.901+0000 7fd6b891b640 1 -- 172.21.15.28:0/290200631 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fd694065a90 msgr2=0x7fd694067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:52.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.901+0000 7fd6b891b640 1 --2- 172.21.15.28:0/290200631 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fd694065a90 0x7fd694067f50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd6a40ae000 tx=0x7fd6a4008040 comp rx=0 tx=0).stop 2023-11-16T02:29:52.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.901+0000 7fd6b891b640 1 -- 172.21.15.28:0/290200631 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6b40b8c90 msgr2=0x7fd6b4139410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:52.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.901+0000 7fd6b891b640 1 --2- 172.21.15.28:0/290200631 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6b40b8c90 0x7fd6b4139410 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00c7f0 tx=0x7fd69c00ccb0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.901+0000 7fd6b891b640 1 -- 172.21.15.28:0/290200631 shutdown_connections 2023-11-16T02:29:52.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.901+0000 7fd6b891b640 1 --2- 172.21.15.28:0/290200631 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fd694065a90 0x7fd694067f50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.901+0000 7fd6b891b640 1 --2- 172.21.15.28:0/290200631 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd6b4141e10 0x7fd6b41e6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.901+0000 7fd6b891b640 1 --2- 172.21.15.28:0/290200631 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6b40b8c90 0x7fd6b4139410 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.901+0000 7fd6b891b640 1 --2- 172.21.15.28:0/290200631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6b40b2180 0x7fd6b409ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:52.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.901+0000 7fd6b891b640 1 -- 172.21.15.28:0/290200631 >> 172.21.15.28:0/290200631 conn(0x7fd6b40b9b20 msgr2=0x7fd6b4069d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:52.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.901+0000 7fd6b891b640 1 -- 172.21.15.28:0/290200631 shutdown_connections 2023-11-16T02:29:52.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:52.901+0000 7fd6b891b640 1 -- 172.21.15.28:0/290200631 wait complete. 2023-11-16T02:29:52.921 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-16T02:29:53.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.033+0000 7f99c4536640 1 Processor -- start 2023-11-16T02:29:53.038 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.033+0000 7f99c4536640 1 -- start start 2023-11-16T02:29:53.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.033+0000 7f99c4536640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99bc0b8240 0x7f99bc0bc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.033+0000 7f99c4536640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f99bc0b3b60 0x7f99bc148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.033+0000 7f99c4536640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc0b52b0 con 0x7f99bc148960 2023-11-16T02:29:53.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.033+0000 7f99c4536640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99bc0b6220 con 0x7f99bc0b3b60 2023-11-16T02:29:53.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.033+0000 7f99c4536640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0b4040 con 0x7f99bc0b8240 2023-11-16T02:29:53.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.033+0000 7f99c1ad1640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f99bc148960 0x7f99bc0b3450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55956/0 (socket says 172.21.15.28:55956) 2023-11-16T02:29:53.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.033+0000 7f99c1ad1640 1 -- 172.21.15.28:0/1343957612 learned_addr learned my addr 172.21.15.28:0/1343957612 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:53.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c12d0640 1 -- 172.21.15.28:0/1343957612 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617097344 0 0) 0x7f99bc0b52b0 con 0x7f99bc148960 2023-11-16T02:29:53.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c22d2640 1 --2- 172.21.15.28:0/1343957612 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99bc0b8240 0x7f99bc0bc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c2ad3640 1 --2- 172.21.15.28:0/1343957612 >> v2:172.21.15.70:3300/0 conn(0x7f99bc0b3b60 0x7f99bc148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c12d0640 1 -- 172.21.15.28:0/1343957612 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99a8003530 con 0x7f99bc148960 2023-11-16T02:29:53.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c12d0640 1 -- 172.21.15.28:0/1343957612 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3814766820 0 0) 0x7f99a8003530 con 0x7f99bc148960 2023-11-16T02:29:53.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c12d0640 1 -- 172.21.15.28:0/1343957612 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99bc0b8240 msgr2=0x7f99bc0bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:53.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c12d0640 1 --2- 172.21.15.28:0/1343957612 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99bc0b8240 0x7f99bc0bc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c12d0640 1 -- 172.21.15.28:0/1343957612 >> v2:172.21.15.70:3300/0 conn(0x7f99bc0b3b60 msgr2=0x7f99bc148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:53.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c12d0640 1 --2- 172.21.15.28:0/1343957612 >> v2:172.21.15.70:3300/0 conn(0x7f99bc0b3b60 0x7f99bc148dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.041 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c12d0640 1 -- 172.21.15.28:0/1343957612 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc0b5a20 con 0x7f99bc148960 2023-11-16T02:29:53.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c12d0640 1 -- 172.21.15.28:0/1343957612 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7f99ac001680 con 0x7f99bc148960 2023-11-16T02:29:53.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c12d0640 1 -- 172.21.15.28:0/1343957612 >> v1:172.21.15.28:6789/0 conn(0x7f99bc148960 legacy=0x7f99bc0b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:53.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c12d0640 1 --2- 172.21.15.28:0/1343957612 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99a8003980 0x7f99a8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c12d0640 1 --2- 172.21.15.28:0/1343957612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99a80047d0 0x7f99a8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c12d0640 1 --2- 172.21.15.28:0/1343957612 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99bc0b8240 0x7f99a8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c12d0640 1 -- 172.21.15.28:0/1343957612 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0b6220 con 0x7f99a8003980 2023-11-16T02:29:53.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c12d0640 1 -- 172.21.15.28:0/1343957612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0b4040 con 0x7f99a80047d0 2023-11-16T02:29:53.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c12d0640 1 -- 172.21.15.28:0/1343957612 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a800b990 con 0x7f99bc0b8240 2023-11-16T02:29:53.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c22d2640 1 --2- 172.21.15.28:0/1343957612 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99a8003980 0x7f99a8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c22d2640 1 -- 172.21.15.28:0/1343957612 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99bc0b8240 msgr2=0x7f99a8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:53.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c2ad3640 1 --2- 172.21.15.28:0/1343957612 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99bc0b8240 0x7f99a8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c1ad1640 1 --2- 172.21.15.28:0/1343957612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99a80047d0 0x7f99a8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c22d2640 1 --2- 172.21.15.28:0/1343957612 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99bc0b8240 0x7f99a8005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c22d2640 1 -- 172.21.15.28:0/1343957612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99a80047d0 msgr2=0x7f99a8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:53.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c22d2640 1 --2- 172.21.15.28:0/1343957612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99a80047d0 0x7f99a8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c22d2640 1 -- 172.21.15.28:0/1343957612 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a8003530 con 0x7f99a8003980 2023-11-16T02:29:53.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c1ad1640 1 --2- 172.21.15.28:0/1343957612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99a80047d0 0x7f99a8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:53.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c22d2640 1 --2- 172.21.15.28:0/1343957612 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99a8003980 0x7f99a8003da0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009ae0 tx=0x7f99b801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e4b092cc76360cb server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:53.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c12d0640 1 -- 172.21.15.28:0/1343957612 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b80a6430 con 0x7f99a8003980 2023-11-16T02:29:53.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c12d0640 1 -- 172.21.15.28:0/1343957612 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b80a6590 con 0x7f99a8003980 2023-11-16T02:29:53.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c12d0640 1 -- 172.21.15.28:0/1343957612 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b80a6940 con 0x7f99a8003980 2023-11-16T02:29:53.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c4536640 1 -- 172.21.15.28:0/1343957612 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99a8003980 msgr2=0x7f99a8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:53.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c4536640 1 --2- 172.21.15.28:0/1343957612 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99a8003980 0x7f99a8003da0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009ae0 tx=0x7f99b801ca20 comp rx=0 tx=0).stop 2023-11-16T02:29:53.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c2ad3640 1 -- 172.21.15.28:0/1343957612 reap_dead start 2023-11-16T02:29:53.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c4536640 1 -- 172.21.15.28:0/1343957612 shutdown_connections 2023-11-16T02:29:53.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c4536640 1 -- 172.21.15.28:0/1343957612 >> 172.21.15.28:0/1343957612 conn(0x7f99bc0b9050 msgr2=0x7f99bc0bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:53.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c4536640 1 -- 172.21.15.28:0/1343957612 shutdown_connections 2023-11-16T02:29:53.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.037+0000 7f99c4536640 1 -- 172.21.15.28:0/1343957612 wait complete. 2023-11-16T02:29:53.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99c4536640 1 Processor -- start 2023-11-16T02:29:53.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99c4536640 1 -- start start 2023-11-16T02:29:53.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99c4536640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99a8003980 0x7f99bc151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99c4536640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99bc0bacf0 0x7f99bc1e3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99c4536640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99bc1e44e0 0x7f99bc144260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99c4536640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc151490 con 0x7f99bc0bacf0 2023-11-16T02:29:53.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99c4536640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc1e4960 con 0x7f99a8003980 2023-11-16T02:29:53.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99c4536640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0bb170 con 0x7f99bc1e44e0 2023-11-16T02:29:53.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99c1ad1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99bc0bacf0 0x7f99bc1e3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99c1ad1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99bc0bacf0 0x7f99bc1e3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47232/0 (socket says 172.21.15.28:47232) 2023-11-16T02:29:53.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99c1ad1640 1 -- 172.21.15.28:0/1832346745 learned_addr learned my addr 172.21.15.28:0/1832346745 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:53.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99c22d2640 1 --2- 172.21.15.28:0/1832346745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99a8003980 0x7f99bc151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99c2ad3640 1 --2- 172.21.15.28:0/1832346745 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99bc1e44e0 0x7f99bc144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99c1ad1640 1 -- 172.21.15.28:0/1832346745 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99bc1e44e0 msgr2=0x7f99bc144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:53.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99c1ad1640 1 --2- 172.21.15.28:0/1832346745 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99bc1e44e0 0x7f99bc144260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99c1ad1640 1 -- 172.21.15.28:0/1832346745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99a8003980 msgr2=0x7f99bc151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:53.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99c1ad1640 1 --2- 172.21.15.28:0/1832346745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99a8003980 0x7f99bc151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99c1ad1640 1 -- 172.21.15.28:0/1832346745 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc149e20 con 0x7f99bc0bacf0 2023-11-16T02:29:53.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99c22d2640 1 --2- 172.21.15.28:0/1832346745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99a8003980 0x7f99bc151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:53.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99c1ad1640 1 --2- 172.21.15.28:0/1832346745 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99bc0bacf0 0x7f99bc1e3fa0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00d830 tx=0x7f99ac00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:53.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99b2ffd640 1 -- 172.21.15.28:0/1832346745 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac007560 con 0x7f99bc0bacf0 2023-11-16T02:29:53.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99b2ffd640 1 -- 172.21.15.28:0/1832346745 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac0047f0 con 0x7f99bc0bacf0 2023-11-16T02:29:53.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99c4536640 1 -- 172.21.15.28:0/1832346745 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99bc150b60 con 0x7f99bc0bacf0 2023-11-16T02:29:53.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99b2ffd640 1 -- 172.21.15.28:0/1832346745 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac0076c0 con 0x7f99bc0bacf0 2023-11-16T02:29:53.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99c4536640 1 -- 172.21.15.28:0/1832346745 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99bc151120 con 0x7f99bc0bacf0 2023-11-16T02:29:53.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99c4536640 1 -- 172.21.15.28:0/1832346745 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99bc04e8a0 con 0x7f99bc0bacf0 2023-11-16T02:29:53.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99b2ffd640 1 -- 172.21.15.28:0/1832346745 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f99ac004b60 con 0x7f99bc0bacf0 2023-11-16T02:29:53.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99b2ffd640 1 --2- 172.21.15.28:0/1832346745 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f99a0065a90 0x7f99a0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99b2ffd640 1 -- 172.21.15.28:0/1832346745 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99ac082f30 con 0x7f99bc0bacf0 2023-11-16T02:29:53.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.041+0000 7f99c22d2640 1 --2- 172.21.15.28:0/1832346745 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f99a0065a90 0x7f99a0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.045+0000 7f99c22d2640 1 --2- 172.21.15.28:0/1832346745 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f99a0065a90 0x7f99a0067f50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f99b80ad000 tx=0x7f99b80046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:53.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.049+0000 7f99b2ffd640 1 -- 172.21.15.28:0/1832346745 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f99ac050910 con 0x7f99bc0bacf0 2023-11-16T02:29:53.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.197+0000 7f99c4536640 1 -- 172.21.15.28:0/1832346745 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99bc0b6420 con 0x7f99bc0bacf0 2023-11-16T02:29:53.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.197+0000 7f99b2ffd640 1 -- 172.21.15.28:0/1832346745 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f99ac019020 con 0x7f99bc0bacf0 2023-11-16T02:29:53.203 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:53.203 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":22,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","created":"2023-11-16T02:29:13.710567+0000","modified":"2023-11-16T02:29:38.871066+0000","last_up_change":"2023-11-16T02:29:24.841087+0000","last_in_change":"2023-11-16T02:29:16.024490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-16T02:29:26.490910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-16T02:29:36.133224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-16T02:29:36.866156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dfa8b58d-3481-4e68-86e8-21873d31d0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":38722},{"type":"v1","addr":"172.21.15.28:6809","nonce":38722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":38722},{"type":"v1","addr":"172.21.15.28:6811","nonce":38722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":38722},{"type":"v1","addr":"172.21.15.28:6815","nonce":38722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":38722},{"type":"v1","addr":"172.21.15.28:6813","nonce":38722}]},"public_addr":"172.21.15.28:6809/38722","cluster_addr":"172.21.15.28:6811/38722","heartbeat_back_addr":"172.21.15.28:6815/38722","heartbeat_front_addr":"172.21.15.28:6813/38722","state":["exists","up"]},{"osd":1,"uuid":"1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":38724},{"type":"v1","addr":"172.21.15.28:6824","nonce":38724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":38724},{"type":"v1","addr":"172.21.15.28:6827","nonce":38724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":38724},{"type":"v1","addr":"172.21.15.28:6831","nonce":38724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":38724},{"type":"v1","addr":"172.21.15.28:6829","nonce":38724}]},"public_addr":"172.21.15.28:6824/38724","cluster_addr":"172.21.15.28:6827/38724","heartbeat_back_addr":"172.21.15.28:6831/38724","heartbeat_front_addr":"172.21.15.28:6829/38724","state":["exists","up"]},{"osd":2,"uuid":"e18f39cd-6a35-4d36-9eed-3877794bf2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":38723},{"type":"v1","addr":"172.21.15.28:6801","nonce":38723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":38723},{"type":"v1","addr":"172.21.15.28:6803","nonce":38723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":38723},{"type":"v1","addr":"172.21.15.28:6807","nonce":38723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":38723},{"type":"v1","addr":"172.21.15.28:6805","nonce":38723}]},"public_addr":"172.21.15.28:6801/38723","cluster_addr":"172.21.15.28:6803/38723","heartbeat_back_addr":"172.21.15.28:6807/38723","heartbeat_front_addr":"172.21.15.28:6805/38723","state":["exists","up"]},{"osd":3,"uuid":"303d0728-409d-47d7-b7a6-6eb273f602fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":38725},{"type":"v1","addr":"172.21.15.28:6817","nonce":38725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":38725},{"type":"v1","addr":"172.21.15.28:6819","nonce":38725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":38725},{"type":"v1","addr":"172.21.15.28:6825","nonce":38725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":38725},{"type":"v1","addr":"172.21.15.28:6821","nonce":38725}]},"public_addr":"172.21.15.28:6817/38725","cluster_addr":"172.21.15.28:6819/38725","heartbeat_back_addr":"172.21.15.28:6825/38725","heartbeat_front_addr":"172.21.15.28:6821/38725","state":["exists","up"]},{"osd":4,"uuid":"df0bf0ac-6efe-4964-ad27-7c1771a70c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":38828},{"type":"v1","addr":"172.21.15.70:6801","nonce":38828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":38828},{"type":"v1","addr":"172.21.15.70:6803","nonce":38828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":38828},{"type":"v1","addr":"172.21.15.70:6807","nonce":38828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":38828},{"type":"v1","addr":"172.21.15.70:6805","nonce":38828}]},"public_addr":"172.21.15.70:6801/38828","cluster_addr":"172.21.15.70:6803/38828","heartbeat_back_addr":"172.21.15.70:6807/38828","heartbeat_front_addr":"172.21.15.70:6805/38828","state":["exists","up"]},{"osd":5,"uuid":"84921219-65cb-4c4e-b9ed-a773db639034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":38830},{"type":"v1","addr":"172.21.15.70:6810","nonce":38830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6813","nonce":38830},{"type":"v1","addr":"172.21.15.70:6814","nonce":38830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":38830},{"type":"v1","addr":"172.21.15.70:6824","nonce":38830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":38830},{"type":"v1","addr":"172.21.15.70:6819","nonce":38830}]},"public_addr":"172.21.15.70:6810/38830","cluster_addr":"172.21.15.70:6814/38830","heartbeat_back_addr":"172.21.15.70:6824/38830","heartbeat_front_addr":"172.21.15.70:6819/38830","state":["exists","up"]},{"osd":6,"uuid":"c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":38829},{"type":"v1","addr":"172.21.15.70:6812","nonce":38829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":38829},{"type":"v1","addr":"172.21.15.70:6820","nonce":38829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":38829},{"type":"v1","addr":"172.21.15.70:6828","nonce":38829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":38829},{"type":"v1","addr":"172.21.15.70:6825","nonce":38829}]},"public_addr":"172.21.15.70:6812/38829","cluster_addr":"172.21.15.70:6820/38829","heartbeat_back_addr":"172.21.15.70:6828/38829","heartbeat_front_addr":"172.21.15.70:6825/38829","state":["exists","up"]},{"osd":7,"uuid":"e2cdd418-12ce-4eea-9b22-efdad83eb76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":38839},{"type":"v1","addr":"172.21.15.70:6815","nonce":38839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":38839},{"type":"v1","addr":"172.21.15.70:6823","nonce":38839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":38839},{"type":"v1","addr":"172.21.15.70:6831","nonce":38839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6827","nonce":38839},{"type":"v1","addr":"172.21.15.70:6829","nonce":38839}]},"public_addr":"172.21.15.70:6815/38839","cluster_addr":"172.21.15.70:6823/38839","heartbeat_back_addr":"172.21.15.70:6831/38839","heartbeat_front_addr":"172.21.15.70:6829/38839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.544240+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.637637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.352115+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.652916+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.624477+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.570247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.706468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.696574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-16T02:29:53.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.201+0000 7f99c4536640 1 -- 172.21.15.28:0/1832346745 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f99a0065a90 msgr2=0x7f99a0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:53.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.201+0000 7f99c4536640 1 --2- 172.21.15.28:0/1832346745 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f99a0065a90 0x7f99a0067f50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f99b80ad000 tx=0x7f99b80046d0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.201+0000 7f99c4536640 1 -- 172.21.15.28:0/1832346745 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99bc0bacf0 msgr2=0x7f99bc1e3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:53.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.201+0000 7f99c4536640 1 --2- 172.21.15.28:0/1832346745 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99bc0bacf0 0x7f99bc1e3fa0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00d830 tx=0x7f99ac00dcf0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.201+0000 7f99c4536640 1 -- 172.21.15.28:0/1832346745 shutdown_connections 2023-11-16T02:29:53.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.201+0000 7f99c4536640 1 --2- 172.21.15.28:0/1832346745 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f99a0065a90 0x7f99a0067f50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.201+0000 7f99c4536640 1 --2- 172.21.15.28:0/1832346745 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f99bc1e44e0 0x7f99bc144260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.201+0000 7f99c4536640 1 --2- 172.21.15.28:0/1832346745 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99bc0bacf0 0x7f99bc1e3fa0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.201+0000 7f99c4536640 1 --2- 172.21.15.28:0/1832346745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99a8003980 0x7f99bc151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.201+0000 7f99c4536640 1 -- 172.21.15.28:0/1832346745 >> 172.21.15.28:0/1832346745 conn(0x7f99bc0b9050 msgr2=0x7f99bc071090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:53.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.201+0000 7f99c4536640 1 -- 172.21.15.28:0/1832346745 shutdown_connections 2023-11-16T02:29:53.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.201+0000 7f99c4536640 1 -- 172.21.15.28:0/1832346745 wait complete. 2023-11-16T02:29:53.221 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-16T02:29:26.490910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-16T02:29:36.133224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-16T02:29:36.866156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-16T02:29:53.221 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-16T02:29:53.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8729751640 1 Processor -- start 2023-11-16T02:29:53.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8729751640 1 -- start start 2023-11-16T02:29:53.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8729751640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f872406bc40 0x7f872414ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8729751640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f87240711c0 0x7f8724069d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8729751640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f872406b8b0 con 0x7f87240b69f0 2023-11-16T02:29:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8729751640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f872414fdf0 con 0x7f872406bc40 2023-11-16T02:29:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8729751640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87240b6dd0 con 0x7f87240711c0 2023-11-16T02:29:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8722ffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f87240b69f0 0x7f8724070ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55958/0 (socket says 172.21.15.28:55958) 2023-11-16T02:29:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8722ffd640 1 -- 172.21.15.28:0/2173515888 learned_addr learned my addr 172.21.15.28:0/2173515888 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8721ffb640 1 -- 172.21.15.28:0/2173515888 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 243817561 0 0) 0x7f872406b8b0 con 0x7f87240b69f0 2023-11-16T02:29:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8721ffb640 1 -- 172.21.15.28:0/2173515888 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f870c003530 con 0x7f87240b69f0 2023-11-16T02:29:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f87237fe640 1 --2- 172.21.15.28:0/2173515888 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f87240711c0 0x7f8724069d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f87227fc640 1 --2- 172.21.15.28:0/2173515888 >> v2:172.21.15.70:3300/0 conn(0x7f872406bc40 0x7f872414ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8721ffb640 1 -- 172.21.15.28:0/2173515888 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2580927533 0 0) 0x7f870c003530 con 0x7f87240b69f0 2023-11-16T02:29:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8721ffb640 1 -- 172.21.15.28:0/2173515888 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f87240711c0 msgr2=0x7f8724069d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:53.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8721ffb640 1 --2- 172.21.15.28:0/2173515888 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f87240711c0 0x7f8724069d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8721ffb640 1 -- 172.21.15.28:0/2173515888 >> v2:172.21.15.70:3300/0 conn(0x7f872406bc40 msgr2=0x7f872414ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:53.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8721ffb640 1 --2- 172.21.15.28:0/2173515888 >> v2:172.21.15.70:3300/0 conn(0x7f872406bc40 0x7f872414ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8721ffb640 1 -- 172.21.15.28:0/2173515888 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872414f550 con 0x7f87240b69f0 2023-11-16T02:29:53.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8721ffb640 1 -- 172.21.15.28:0/2173515888 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7f871c001a00 con 0x7f87240b69f0 2023-11-16T02:29:53.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8721ffb640 1 -- 172.21.15.28:0/2173515888 >> v1:172.21.15.28:6789/0 conn(0x7f87240b69f0 legacy=0x7f8724070ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:53.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8721ffb640 1 --2- 172.21.15.28:0/2173515888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f870c003980 0x7f870c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8721ffb640 1 --2- 172.21.15.28:0/2173515888 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f87240711c0 0x7f870c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8721ffb640 1 --2- 172.21.15.28:0/2173515888 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f870c004d10 0x7f870c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8721ffb640 1 -- 172.21.15.28:0/2173515888 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872414fdf0 con 0x7f870c004d10 2023-11-16T02:29:53.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8721ffb640 1 -- 172.21.15.28:0/2173515888 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87240b6dd0 con 0x7f870c003980 2023-11-16T02:29:53.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8721ffb640 1 -- 172.21.15.28:0/2173515888 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870c00ba40 con 0x7f87240711c0 2023-11-16T02:29:53.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f87237fe640 1 --2- 172.21.15.28:0/2173515888 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f870c004d10 0x7f870c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8722ffd640 1 --2- 172.21.15.28:0/2173515888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f870c003980 0x7f870c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f87227fc640 1 --2- 172.21.15.28:0/2173515888 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f87240711c0 0x7f870c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f87237fe640 1 -- 172.21.15.28:0/2173515888 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f87240711c0 msgr2=0x7f870c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:53.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f87237fe640 1 --2- 172.21.15.28:0/2173515888 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f87240711c0 0x7f870c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f87237fe640 1 -- 172.21.15.28:0/2173515888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f870c003980 msgr2=0x7f870c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:53.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f87237fe640 1 --2- 172.21.15.28:0/2173515888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f870c003980 0x7f870c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f87237fe640 1 -- 172.21.15.28:0/2173515888 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c003530 con 0x7f870c004d10 2023-11-16T02:29:53.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f8722ffd640 1 --2- 172.21.15.28:0/2173515888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f870c003980 0x7f870c003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:29:53.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.341+0000 7f87227fc640 1 --2- 172.21.15.28:0/2173515888 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f87240711c0 0x7f870c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:53.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.345+0000 7f87237fe640 1 --2- 172.21.15.28:0/2173515888 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f870c004d10 0x7f870c005190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f871400ba60 tx=0x7f871401c660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc6472eb1bf17c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:53.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.345+0000 7f8721ffb640 1 -- 172.21.15.28:0/2173515888 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87140ab670 con 0x7f870c004d10 2023-11-16T02:29:53.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.345+0000 7f8721ffb640 1 -- 172.21.15.28:0/2173515888 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87140ab7d0 con 0x7f870c004d10 2023-11-16T02:29:53.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.345+0000 7f8721ffb640 1 -- 172.21.15.28:0/2173515888 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87140abb80 con 0x7f870c004d10 2023-11-16T02:29:53.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.345+0000 7f8729751640 1 -- 172.21.15.28:0/2173515888 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f870c004d10 msgr2=0x7f870c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:53.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.345+0000 7f8729751640 1 --2- 172.21.15.28:0/2173515888 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f870c004d10 0x7f870c005190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f871400ba60 tx=0x7f871401c660 comp rx=0 tx=0).stop 2023-11-16T02:29:53.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.345+0000 7f87237fe640 1 -- 172.21.15.28:0/2173515888 reap_dead start 2023-11-16T02:29:53.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.345+0000 7f8729751640 1 -- 172.21.15.28:0/2173515888 shutdown_connections 2023-11-16T02:29:53.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.345+0000 7f8729751640 1 -- 172.21.15.28:0/2173515888 >> 172.21.15.28:0/2173515888 conn(0x7f87240bd310 msgr2=0x7f87240bd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:53.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.345+0000 7f8729751640 1 -- 172.21.15.28:0/2173515888 shutdown_connections 2023-11-16T02:29:53.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.345+0000 7f8729751640 1 -- 172.21.15.28:0/2173515888 wait complete. 2023-11-16T02:29:53.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.345+0000 7f8729751640 1 Processor -- start 2023-11-16T02:29:53.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.345+0000 7f8729751640 1 -- start start 2023-11-16T02:29:53.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.345+0000 7f8729751640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8724147570 0x7f87241e4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.345+0000 7f8729751640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87241498c0 0x7f87241e4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.345+0000 7f8729751640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8724147db0 0x7f8724145ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.345+0000 7f8729751640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87240b5e70 con 0x7f87241498c0 2023-11-16T02:29:53.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.345+0000 7f8729751640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8724146ea0 con 0x7f8724147db0 2023-11-16T02:29:53.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.345+0000 7f8729751640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87240b60c0 con 0x7f8724147570 2023-11-16T02:29:53.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.349+0000 7f87237fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8724147db0 0x7f8724145ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.349+0000 7f87227fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87241498c0 0x7f87241e4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.349+0000 7f87237fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8724147db0 0x7f8724145ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.28:47154/0 (socket says 172.21.15.28:47154) 2023-11-16T02:29:53.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.349+0000 7f87237fe640 1 -- 172.21.15.28:0/579367993 learned_addr learned my addr 172.21.15.28:0/579367993 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.349+0000 7f8722ffd640 1 --2- 172.21.15.28:0/579367993 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8724147570 0x7f87241e4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.349+0000 7f87227fc640 1 -- 172.21.15.28:0/579367993 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8724147570 msgr2=0x7f87241e4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.349+0000 7f87227fc640 1 --2- 172.21.15.28:0/579367993 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8724147570 0x7f87241e4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.349+0000 7f87227fc640 1 -- 172.21.15.28:0/579367993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8724147db0 msgr2=0x7f8724145ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.349+0000 7f87227fc640 1 --2- 172.21.15.28:0/579367993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8724147db0 0x7f8724145ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.349+0000 7f87227fc640 1 -- 172.21.15.28:0/579367993 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8724148b30 con 0x7f87241498c0 2023-11-16T02:29:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.349+0000 7f87227fc640 1 --2- 172.21.15.28:0/579367993 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87241498c0 0x7f87241e4cd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f871800e810 tx=0x7f871800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.349+0000 7f870b7fe640 1 -- 172.21.15.28:0/579367993 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8718004030 con 0x7f87241498c0 2023-11-16T02:29:53.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.349+0000 7f870b7fe640 1 -- 172.21.15.28:0/579367993 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8718004190 con 0x7f87241498c0 2023-11-16T02:29:53.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.349+0000 7f870b7fe640 1 -- 172.21.15.28:0/579367993 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871800c6d0 con 0x7f87241498c0 2023-11-16T02:29:53.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.349+0000 7f8729751640 1 -- 172.21.15.28:0/579367993 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8724148e10 con 0x7f87241498c0 2023-11-16T02:29:53.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.349+0000 7f8729751640 1 -- 172.21.15.28:0/579367993 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8724143420 con 0x7f87241498c0 2023-11-16T02:29:53.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.349+0000 7f8729751640 1 -- 172.21.15.28:0/579367993 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f872404e8a0 con 0x7f87241498c0 2023-11-16T02:29:53.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.349+0000 7f870b7fe640 1 -- 172.21.15.28:0/579367993 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f871800c830 con 0x7f87241498c0 2023-11-16T02:29:53.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.349+0000 7f870b7fe640 1 --2- 172.21.15.28:0/579367993 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8710065a60 0x7f8710067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.349+0000 7f870b7fe640 1 -- 172.21.15.28:0/579367993 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8718082fc0 con 0x7f87241498c0 2023-11-16T02:29:53.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.349+0000 7f8722ffd640 1 --2- 172.21.15.28:0/579367993 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8710065a60 0x7f8710067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.349+0000 7f8722ffd640 1 --2- 172.21.15.28:0/579367993 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8710065a60 0x7f8710067f20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f871c000f90 tx=0x7f871c002160 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:53.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.353+0000 7f870b7fe640 1 -- 172.21.15.28:0/579367993 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f8718050ba0 con 0x7f87241498c0 2023-11-16T02:29:53.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.509+0000 7f8729751640 1 -- 172.21.15.28:0/579367993 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f872414fae0 con 0x7f87241498c0 2023-11-16T02:29:53.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.509+0000 7f870b7fe640 1 -- 172.21.15.28:0/579367993 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f87180200a0 con 0x7f87241498c0 2023-11-16T02:29:53.512 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-11-16T02:29:53.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.509+0000 7f8729751640 1 -- 172.21.15.28:0/579367993 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8710065a60 msgr2=0x7f8710067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:53.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.509+0000 7f8729751640 1 --2- 172.21.15.28:0/579367993 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8710065a60 0x7f8710067f20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f871c000f90 tx=0x7f871c002160 comp rx=0 tx=0).stop 2023-11-16T02:29:53.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.509+0000 7f8729751640 1 -- 172.21.15.28:0/579367993 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87241498c0 msgr2=0x7f87241e4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:53.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.509+0000 7f8729751640 1 --2- 172.21.15.28:0/579367993 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87241498c0 0x7f87241e4cd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f871800e810 tx=0x7f871800ecd0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.509+0000 7f8729751640 1 -- 172.21.15.28:0/579367993 shutdown_connections 2023-11-16T02:29:53.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.509+0000 7f8729751640 1 --2- 172.21.15.28:0/579367993 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8710065a60 0x7f8710067f20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.509+0000 7f8729751640 1 --2- 172.21.15.28:0/579367993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8724147db0 0x7f8724145ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.509+0000 7f8729751640 1 --2- 172.21.15.28:0/579367993 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87241498c0 0x7f87241e4cd0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.509+0000 7f8729751640 1 --2- 172.21.15.28:0/579367993 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8724147570 0x7f87241e4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.509+0000 7f8729751640 1 -- 172.21.15.28:0/579367993 >> 172.21.15.28:0/579367993 conn(0x7f87240bd310 msgr2=0x7f872406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:53.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.509+0000 7f8729751640 1 -- 172.21.15.28:0/579367993 shutdown_connections 2023-11-16T02:29:53.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.509+0000 7f8729751640 1 -- 172.21.15.28:0/579367993 wait complete. 2023-11-16T02:29:53.530 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-16T02:29:53.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.649+0000 7f8554be8640 1 Processor -- start 2023-11-16T02:29:53.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.649+0000 7f8554be8640 1 -- start start 2023-11-16T02:29:53.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.649+0000 7f8554be8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85501415b0 0x7f85500ba410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.649+0000 7f8554be8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f85500b8340 0x7f85500b87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.649+0000 7f8554be8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85500b78a0 con 0x7f855014e0f0 2023-11-16T02:29:53.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.649+0000 7f8554be8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85500ba060 con 0x7f85500b8340 2023-11-16T02:29:53.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.649+0000 7f8554be8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85500b9390 con 0x7f85501415b0 2023-11-16T02:29:53.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.649+0000 7f854dd9b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f85500b8340 0x7f85500b87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.649+0000 7f854dd9b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f85500b8340 0x7f85500b87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47250/0 (socket says 172.21.15.28:47250) 2023-11-16T02:29:53.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.649+0000 7f854ed9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f855014e0f0 0x7f855014e560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55968/0 (socket says 172.21.15.28:55968) 2023-11-16T02:29:53.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.649+0000 7f854dd9b640 1 -- 172.21.15.28:0/1615925892 learned_addr learned my addr 172.21.15.28:0/1615925892 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:53.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.649+0000 7f854dd9b640 1 -- 172.21.15.28:0/1615925892 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85501415b0 msgr2=0x7f85500ba410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:53.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.649+0000 7f854dd9b640 1 --2- 172.21.15.28:0/1615925892 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85501415b0 0x7f85500ba410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.649+0000 7f854dd9b640 1 -- 172.21.15.28:0/1615925892 >> v1:172.21.15.28:6789/0 conn(0x7f855014e0f0 legacy=0x7f855014e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:53.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.649+0000 7f854dd9b640 1 -- 172.21.15.28:0/1615925892 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85500b8ce0 con 0x7f85500b8340 2023-11-16T02:29:53.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.649+0000 7f854d59a640 1 -- 172.21.15.28:0/1615925892 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1700641508 0 0) 0x7f85500b78a0 con 0x7f855014e0f0 2023-11-16T02:29:53.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f854dd9b640 1 --2- 172.21.15.28:0/1615925892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85500b8340 0x7f85500b87a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8544009870 tx=0x7f854401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84607b97a34e1eb server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:53.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f854d59a640 1 -- 172.21.15.28:0/1615925892 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85440a9400 con 0x7f85500b8340 2023-11-16T02:29:53.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f854d59a640 1 -- 172.21.15.28:0/1615925892 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85440a9560 con 0x7f85500b8340 2023-11-16T02:29:53.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f854d59a640 1 -- 172.21.15.28:0/1615925892 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85440a98f0 con 0x7f85500b8340 2023-11-16T02:29:53.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f8554be8640 1 -- 172.21.15.28:0/1615925892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85500b8340 msgr2=0x7f85500b87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:53.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f8554be8640 1 --2- 172.21.15.28:0/1615925892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85500b8340 0x7f85500b87a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8544009870 tx=0x7f854401c540 comp rx=0 tx=0).stop 2023-11-16T02:29:53.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f8554be8640 1 -- 172.21.15.28:0/1615925892 shutdown_connections 2023-11-16T02:29:53.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f8554be8640 1 --2- 172.21.15.28:0/1615925892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f85500b8340 0x7f85500b87a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f8554be8640 1 --2- 172.21.15.28:0/1615925892 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85501415b0 0x7f85500ba410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f8554be8640 1 -- 172.21.15.28:0/1615925892 >> 172.21.15.28:0/1615925892 conn(0x7f855006b7e0 msgr2=0x7f855006bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:53.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f8554be8640 1 -- 172.21.15.28:0/1615925892 shutdown_connections 2023-11-16T02:29:53.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f8554be8640 1 -- 172.21.15.28:0/1615925892 wait complete. 2023-11-16T02:29:53.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f8554be8640 1 Processor -- start 2023-11-16T02:29:53.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f8554be8640 1 -- start start 2023-11-16T02:29:53.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f8554be8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85500b8340 0x7f855014d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f8554be8640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85501415b0 0x7f85500bf550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f8554be8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f855014e0f0 0x7f85501e69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f8554be8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8550144090 con 0x7f855014e0f0 2023-11-16T02:29:53.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f8554be8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85500bfa90 con 0x7f85500b8340 2023-11-16T02:29:53.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f8554be8640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85501e6290 con 0x7f85501415b0 2023-11-16T02:29:53.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f854ed9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f855014e0f0 0x7f85501e69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f854ed9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f855014e0f0 0x7f85501e69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47254/0 (socket says 172.21.15.28:47254) 2023-11-16T02:29:53.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f854ed9d640 1 -- 172.21.15.28:0/3151450663 learned_addr learned my addr 172.21.15.28:0/3151450663 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:53.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f854dd9b640 1 --2- 172.21.15.28:0/3151450663 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85501415b0 0x7f85500bf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f854e59c640 1 --2- 172.21.15.28:0/3151450663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85500b8340 0x7f855014d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f854ed9d640 1 -- 172.21.15.28:0/3151450663 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85501415b0 msgr2=0x7f85500bf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:53.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f854ed9d640 1 --2- 172.21.15.28:0/3151450663 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85501415b0 0x7f85500bf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f854ed9d640 1 -- 172.21.15.28:0/3151450663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85500b8340 msgr2=0x7f855014d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:53.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f854ed9d640 1 --2- 172.21.15.28:0/3151450663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85500b8340 0x7f855014d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f854ed9d640 1 -- 172.21.15.28:0/3151450663 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85440094d0 con 0x7f855014e0f0 2023-11-16T02:29:53.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f854dd9b640 1 --2- 172.21.15.28:0/3151450663 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85501415b0 0x7f85500bf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:53.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f854ed9d640 1 --2- 172.21.15.28:0/3151450663 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f855014e0f0 0x7f85501e69c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f854800c780 tx=0x7f854800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:53.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f853effd640 1 -- 172.21.15.28:0/3151450663 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854800ce90 con 0x7f855014e0f0 2023-11-16T02:29:53.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f853effd640 1 -- 172.21.15.28:0/3151450663 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854800a640 con 0x7f855014e0f0 2023-11-16T02:29:53.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f853effd640 1 -- 172.21.15.28:0/3151450663 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854800a9d0 con 0x7f855014e0f0 2023-11-16T02:29:53.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f8554be8640 1 -- 172.21.15.28:0/3151450663 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85501e6530 con 0x7f855014e0f0 2023-11-16T02:29:53.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.653+0000 7f8554be8640 1 -- 172.21.15.28:0/3151450663 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855014dcd0 con 0x7f855014e0f0 2023-11-16T02:29:53.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.657+0000 7f8554be8640 1 -- 172.21.15.28:0/3151450663 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85501e66c0 con 0x7f855014e0f0 2023-11-16T02:29:53.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.657+0000 7f853effd640 1 -- 172.21.15.28:0/3151450663 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f854800ab30 con 0x7f855014e0f0 2023-11-16T02:29:53.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.657+0000 7f853effd640 1 --2- 172.21.15.28:0/3151450663 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8530065a60 0x7f8530067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.657+0000 7f853effd640 1 -- 172.21.15.28:0/3151450663 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8548082830 con 0x7f855014e0f0 2023-11-16T02:29:53.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.657+0000 7f854e59c640 1 --2- 172.21.15.28:0/3151450663 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8530065a60 0x7f8530067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.657+0000 7f854e59c640 1 --2- 172.21.15.28:0/3151450663 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8530065a60 0x7f8530067f20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8540006fd0 tx=0x7f8540008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:53.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.661+0000 7f853effd640 1 -- 172.21.15.28:0/3151450663 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f85480500c0 con 0x7f855014e0f0 2023-11-16T02:29:53.814 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.809+0000 7f8554be8640 1 -- 172.21.15.28:0/3151450663 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f855014ebf0 con 0x7f855014e0f0 2023-11-16T02:29:53.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.809+0000 7f853effd640 1 -- 172.21.15.28:0/3151450663 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8548018020 con 0x7f855014e0f0 2023-11-16T02:29:53.815 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-11-16T02:29:53.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.813+0000 7f8554be8640 1 -- 172.21.15.28:0/3151450663 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8530065a60 msgr2=0x7f8530067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:53.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.813+0000 7f8554be8640 1 --2- 172.21.15.28:0/3151450663 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8530065a60 0x7f8530067f20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8540006fd0 tx=0x7f8540008040 comp rx=0 tx=0).stop 2023-11-16T02:29:53.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.813+0000 7f8554be8640 1 -- 172.21.15.28:0/3151450663 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f855014e0f0 msgr2=0x7f85501e69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:53.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.813+0000 7f8554be8640 1 --2- 172.21.15.28:0/3151450663 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f855014e0f0 0x7f85501e69c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f854800c780 tx=0x7f854800cc40 comp rx=0 tx=0).stop 2023-11-16T02:29:53.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.813+0000 7f8554be8640 1 -- 172.21.15.28:0/3151450663 shutdown_connections 2023-11-16T02:29:53.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.813+0000 7f8554be8640 1 --2- 172.21.15.28:0/3151450663 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8530065a60 0x7f8530067f20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.813+0000 7f8554be8640 1 --2- 172.21.15.28:0/3151450663 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f855014e0f0 0x7f85501e69c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.813+0000 7f8554be8640 1 --2- 172.21.15.28:0/3151450663 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f85501415b0 0x7f85500bf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.813+0000 7f8554be8640 1 --2- 172.21.15.28:0/3151450663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85500b8340 0x7f855014d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.813+0000 7f8554be8640 1 -- 172.21.15.28:0/3151450663 >> 172.21.15.28:0/3151450663 conn(0x7f855006b7e0 msgr2=0x7f85501391a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:53.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.813+0000 7f8554be8640 1 -- 172.21.15.28:0/3151450663 shutdown_connections 2023-11-16T02:29:53.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.813+0000 7f8554be8640 1 -- 172.21.15.28:0/3151450663 wait complete. 2023-11-16T02:29:53.832 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-16T02:29:53.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.941+0000 7f11fb6af640 1 Processor -- start 2023-11-16T02:29:53.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.945+0000 7f11fb6af640 1 -- start start 2023-11-16T02:29:53.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.945+0000 7f11fb6af640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f11f4141b40 0x7f11f406ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.945+0000 7f11fb6af640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f11f406fea0 0x7f11f4070300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.945+0000 7f11fb6af640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f11f414aec0 0x7f11f414b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.945+0000 7f11fb6af640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f4070840 con 0x7f11f406fea0 2023-11-16T02:29:53.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.945+0000 7f11fb6af640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f40b4270 con 0x7f11f414aec0 2023-11-16T02:29:53.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.945+0000 7f11fb6af640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f4071c70 con 0x7f11f4141b40 2023-11-16T02:29:53.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.945+0000 7f11f8c4a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f11f406fea0 0x7f11f4070300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.945+0000 7f11f8c4a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f11f406fea0 0x7f11f4070300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47268/0 (socket says 172.21.15.28:47268) 2023-11-16T02:29:53.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.945+0000 7f11f8c4a640 1 -- 172.21.15.28:0/2296940485 learned_addr learned my addr 172.21.15.28:0/2296940485 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:53.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.945+0000 7f11f944b640 1 --2- 172.21.15.28:0/2296940485 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f11f4141b40 0x7f11f406ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.945+0000 7f11f8c4a640 1 -- 172.21.15.28:0/2296940485 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f11f4141b40 msgr2=0x7f11f406ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:53.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.945+0000 7f11f9c4c640 1 --2- 172.21.15.28:0/2296940485 >> v2:172.21.15.70:3300/0 conn(0x7f11f414aec0 0x7f11f414b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.945+0000 7f11f8c4a640 1 --2- 172.21.15.28:0/2296940485 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f11f4141b40 0x7f11f406ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.945+0000 7f11f8c4a640 1 -- 172.21.15.28:0/2296940485 >> v2:172.21.15.70:3300/0 conn(0x7f11f414aec0 msgr2=0x7f11f414b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:53.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.945+0000 7f11f8c4a640 1 --2- 172.21.15.28:0/2296940485 >> v2:172.21.15.70:3300/0 conn(0x7f11f414aec0 0x7f11f414b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.945+0000 7f11f8c4a640 1 -- 172.21.15.28:0/2296940485 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f414b890 con 0x7f11f406fea0 2023-11-16T02:29:53.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.945+0000 7f11f9c4c640 1 --2- 172.21.15.28:0/2296940485 >> v2:172.21.15.70:3300/0 conn(0x7f11f414aec0 0x7f11f414b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:53.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.945+0000 7f11f8c4a640 1 --2- 172.21.15.28:0/2296940485 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f11f406fea0 0x7f11f4070300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f11f40bd0f0 tx=0x7f11e401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb83ef6757cb2a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:53.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.945+0000 7f11ebfff640 1 -- 172.21.15.28:0/2296940485 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e40a89b0 con 0x7f11f406fea0 2023-11-16T02:29:53.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.945+0000 7f11ebfff640 1 -- 172.21.15.28:0/2296940485 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e40a8b10 con 0x7f11f406fea0 2023-11-16T02:29:53.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.945+0000 7f11ebfff640 1 -- 172.21.15.28:0/2296940485 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e40a8ea0 con 0x7f11f406fea0 2023-11-16T02:29:53.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11fb6af640 1 -- 172.21.15.28:0/2296940485 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f11f406fea0 msgr2=0x7f11f4070300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:53.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11fb6af640 1 --2- 172.21.15.28:0/2296940485 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f11f406fea0 0x7f11f4070300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f11f40bd0f0 tx=0x7f11e401ecf0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11fb6af640 1 -- 172.21.15.28:0/2296940485 shutdown_connections 2023-11-16T02:29:53.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11fb6af640 1 --2- 172.21.15.28:0/2296940485 >> v2:172.21.15.70:3300/0 conn(0x7f11f414aec0 0x7f11f414b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11fb6af640 1 --2- 172.21.15.28:0/2296940485 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f11f406fea0 0x7f11f4070300 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11fb6af640 1 --2- 172.21.15.28:0/2296940485 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f11f4141b40 0x7f11f406ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11fb6af640 1 -- 172.21.15.28:0/2296940485 >> 172.21.15.28:0/2296940485 conn(0x7f11f40bd310 msgr2=0x7f11f40bd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:53.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11fb6af640 1 -- 172.21.15.28:0/2296940485 shutdown_connections 2023-11-16T02:29:53.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11fb6af640 1 -- 172.21.15.28:0/2296940485 wait complete. 2023-11-16T02:29:53.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11fb6af640 1 Processor -- start 2023-11-16T02:29:53.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11fb6af640 1 -- start start 2023-11-16T02:29:53.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11fb6af640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f11f406fea0 0x7f11f40bc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11fb6af640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f11f4141b40 0x7f11f41e2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11fb6af640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11f414aec0 0x7f11f4139410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11fb6af640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f40bce70 con 0x7f11f406fea0 2023-11-16T02:29:53.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11fb6af640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f41e07c0 con 0x7f11f414aec0 2023-11-16T02:29:53.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11fb6af640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f406a640 con 0x7f11f4141b40 2023-11-16T02:29:53.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11f944b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f11f406fea0 0x7f11f40bc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11f944b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f11f406fea0 0x7f11f40bc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47282/0 (socket says 172.21.15.28:47282) 2023-11-16T02:29:53.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11f944b640 1 -- 172.21.15.28:0/1498103824 learned_addr learned my addr 172.21.15.28:0/1498103824 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:53.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11f9c4c640 1 --2- 172.21.15.28:0/1498103824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11f414aec0 0x7f11f4139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11f8c4a640 1 --2- 172.21.15.28:0/1498103824 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f11f4141b40 0x7f11f41e2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11f944b640 1 -- 172.21.15.28:0/1498103824 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f11f4141b40 msgr2=0x7f11f41e2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:53.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11f944b640 1 --2- 172.21.15.28:0/1498103824 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f11f4141b40 0x7f11f41e2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11f944b640 1 -- 172.21.15.28:0/1498103824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11f414aec0 msgr2=0x7f11f4139410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:53.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11f944b640 1 --2- 172.21.15.28:0/1498103824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11f414aec0 0x7f11f4139410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:53.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11f944b640 1 -- 172.21.15.28:0/1498103824 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e40094d0 con 0x7f11f406fea0 2023-11-16T02:29:53.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11f9c4c640 1 --2- 172.21.15.28:0/1498103824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11f414aec0 0x7f11f4139410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:53.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11f944b640 1 --2- 172.21.15.28:0/1498103824 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f11f406fea0 0x7f11f40bc930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f11f000c850 tx=0x7f11f000cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:53.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11e9ffb640 1 -- 172.21.15.28:0/1498103824 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f0004020 con 0x7f11f406fea0 2023-11-16T02:29:53.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11e9ffb640 1 -- 172.21.15.28:0/1498103824 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f0004180 con 0x7f11f406fea0 2023-11-16T02:29:53.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11fb6af640 1 -- 172.21.15.28:0/1498103824 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f41dfa00 con 0x7f11f406fea0 2023-11-16T02:29:53.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11e9ffb640 1 -- 172.21.15.28:0/1498103824 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f0007830 con 0x7f11f406fea0 2023-11-16T02:29:53.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11fb6af640 1 -- 172.21.15.28:0/1498103824 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f41dffc0 con 0x7f11f406fea0 2023-11-16T02:29:53.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.949+0000 7f11fb6af640 1 -- 172.21.15.28:0/1498103824 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f404e8a0 con 0x7f11f406fea0 2023-11-16T02:29:53.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.953+0000 7f11e9ffb640 1 -- 172.21.15.28:0/1498103824 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f11f0007990 con 0x7f11f406fea0 2023-11-16T02:29:53.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.953+0000 7f11e9ffb640 1 --2- 172.21.15.28:0/1498103824 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f11d8065a60 0x7f11d8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:53.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.953+0000 7f11e9ffb640 1 -- 172.21.15.28:0/1498103824 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11f0082f10 con 0x7f11f406fea0 2023-11-16T02:29:53.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.953+0000 7f11f8c4a640 1 --2- 172.21.15.28:0/1498103824 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f11d8065a60 0x7f11d8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:53.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.953+0000 7f11f8c4a640 1 --2- 172.21.15.28:0/1498103824 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f11d8065a60 0x7f11d8067f20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f11e40b2000 tx=0x7f11e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:53.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:53.957+0000 7f11e9ffb640 1 -- 172.21.15.28:0/1498103824 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f11f0050840 con 0x7f11f406fea0 2023-11-16T02:29:54.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.109+0000 7f11fb6af640 1 -- 172.21.15.28:0/1498103824 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f11f40bda70 con 0x7f11f406fea0 2023-11-16T02:29:54.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.109+0000 7f11e9ffb640 1 -- 172.21.15.28:0/1498103824 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f11f001e070 con 0x7f11f406fea0 2023-11-16T02:29:54.112 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-11-16T02:29:54.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.109+0000 7f11fb6af640 1 -- 172.21.15.28:0/1498103824 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f11d8065a60 msgr2=0x7f11d8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:54.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.109+0000 7f11fb6af640 1 --2- 172.21.15.28:0/1498103824 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f11d8065a60 0x7f11d8067f20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f11e40b2000 tx=0x7f11e4008040 comp rx=0 tx=0).stop 2023-11-16T02:29:54.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.109+0000 7f11fb6af640 1 -- 172.21.15.28:0/1498103824 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f11f406fea0 msgr2=0x7f11f40bc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:54.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.109+0000 7f11fb6af640 1 --2- 172.21.15.28:0/1498103824 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f11f406fea0 0x7f11f40bc930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f11f000c850 tx=0x7f11f000cd10 comp rx=0 tx=0).stop 2023-11-16T02:29:54.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.109+0000 7f11fb6af640 1 -- 172.21.15.28:0/1498103824 shutdown_connections 2023-11-16T02:29:54.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.109+0000 7f11fb6af640 1 --2- 172.21.15.28:0/1498103824 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f11d8065a60 0x7f11d8067f20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.109+0000 7f11fb6af640 1 --2- 172.21.15.28:0/1498103824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f11f414aec0 0x7f11f4139410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.109+0000 7f11fb6af640 1 --2- 172.21.15.28:0/1498103824 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f11f4141b40 0x7f11f41e2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.109+0000 7f11fb6af640 1 --2- 172.21.15.28:0/1498103824 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f11f406fea0 0x7f11f40bc930 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.109+0000 7f11fb6af640 1 -- 172.21.15.28:0/1498103824 >> 172.21.15.28:0/1498103824 conn(0x7f11f40bd310 msgr2=0x7f11f413eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:54.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.109+0000 7f11fb6af640 1 -- 172.21.15.28:0/1498103824 shutdown_connections 2023-11-16T02:29:54.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.109+0000 7f11fb6af640 1 -- 172.21.15.28:0/1498103824 wait complete. 2023-11-16T02:29:54.132 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-16T02:29:54.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.257+0000 7f50929df640 1 Processor -- start 2023-11-16T02:29:54.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.257+0000 7f50929df640 1 -- start start 2023-11-16T02:29:54.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.257+0000 7f50929df640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f508c0b2180 0x7f508c1418d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:54.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.257+0000 7f50929df640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f508c141e10 0x7f508c147910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:54.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.257+0000 7f50929df640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508c06d790 con 0x7f508c0b8c90 2023-11-16T02:29:54.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.257+0000 7f50929df640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f508c148840 con 0x7f508c0b2180 2023-11-16T02:29:54.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.257+0000 7f50929df640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508c06cbf0 con 0x7f508c141e10 2023-11-16T02:29:54.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.257+0000 7f508b7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f508c0b2180 0x7f508c1418d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:54.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.257+0000 7f508b7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f508c0b2180 0x7f508c1418d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47290/0 (socket says 172.21.15.28:47290) 2023-11-16T02:29:54.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.257+0000 7f508b7fe640 1 -- 172.21.15.28:0/1991753225 learned_addr learned my addr 172.21.15.28:0/1991753225 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:54.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.257+0000 7f5090f7c640 1 --2- 172.21.15.28:0/1991753225 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f508c141e10 0x7f508c147910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:54.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.257+0000 7f508b7fe640 1 -- 172.21.15.28:0/1991753225 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f508c141e10 msgr2=0x7f508c147910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:54.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.257+0000 7f508b7fe640 1 --2- 172.21.15.28:0/1991753225 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f508c141e10 0x7f508c147910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.257+0000 7f508b7fe640 1 -- 172.21.15.28:0/1991753225 >> v1:172.21.15.70:6789/0 conn(0x7f508c0b8c90 legacy=0x7f508c06d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:54.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.257+0000 7f508b7fe640 1 -- 172.21.15.28:0/1991753225 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c148560 con 0x7f508c0b2180 2023-11-16T02:29:54.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.261+0000 7f508b7fe640 1 --2- 172.21.15.28:0/1991753225 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f508c0b2180 0x7f508c1418d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5080009870 tx=0x7f508001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42751d31a3cc0f93 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:54.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.261+0000 7f508affd640 1 -- 172.21.15.28:0/1991753225 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50800a95f0 con 0x7f508c0b2180 2023-11-16T02:29:54.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.261+0000 7f508affd640 1 -- 172.21.15.28:0/1991753225 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50800a9750 con 0x7f508c0b2180 2023-11-16T02:29:54.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.261+0000 7f508affd640 1 -- 172.21.15.28:0/1991753225 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50800a9ae0 con 0x7f508c0b2180 2023-11-16T02:29:54.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.261+0000 7f50929df640 1 -- 172.21.15.28:0/1991753225 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f508c0b2180 msgr2=0x7f508c1418d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:54.265 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.261+0000 7f50929df640 1 --2- 172.21.15.28:0/1991753225 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f508c0b2180 0x7f508c1418d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5080009870 tx=0x7f508001c510 comp rx=0 tx=0).stop 2023-11-16T02:29:54.265 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.261+0000 7f50929df640 1 -- 172.21.15.28:0/1991753225 shutdown_connections 2023-11-16T02:29:54.265 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.261+0000 7f50929df640 1 --2- 172.21.15.28:0/1991753225 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f508c141e10 0x7f508c147910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.265 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.261+0000 7f50929df640 1 --2- 172.21.15.28:0/1991753225 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f508c0b2180 0x7f508c1418d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.265 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.261+0000 7f50929df640 1 -- 172.21.15.28:0/1991753225 >> 172.21.15.28:0/1991753225 conn(0x7f508c0b9b20 msgr2=0x7f508c0b9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:54.265 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.261+0000 7f50929df640 1 -- 172.21.15.28:0/1991753225 shutdown_connections 2023-11-16T02:29:54.265 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.261+0000 7f50929df640 1 -- 172.21.15.28:0/1991753225 wait complete. 2023-11-16T02:29:54.265 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.261+0000 7f50929df640 1 Processor -- start 2023-11-16T02:29:54.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.261+0000 7f50929df640 1 -- start start 2023-11-16T02:29:54.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.261+0000 7f50929df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f508c0b2180 0x7f508c0b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:54.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.261+0000 7f50929df640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f508c0b8c90 0x7f508c140910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:54.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.261+0000 7f50929df640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f508c141e10 0x7f508c1e2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:54.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.261+0000 7f50929df640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c0b6660 con 0x7f508c0b8c90 2023-11-16T02:29:54.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.261+0000 7f50929df640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c140480 con 0x7f508c0b2180 2023-11-16T02:29:54.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.261+0000 7f50929df640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508c0b6380 con 0x7f508c141e10 2023-11-16T02:29:54.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.261+0000 7f508b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f508c0b8c90 0x7f508c140910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:54.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.261+0000 7f508b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f508c0b8c90 0x7f508c140910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47294/0 (socket says 172.21.15.28:47294) 2023-11-16T02:29:54.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.261+0000 7f508b7fe640 1 -- 172.21.15.28:0/4289519061 learned_addr learned my addr 172.21.15.28:0/4289519061 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:54.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.265+0000 7f5090f7c640 1 --2- 172.21.15.28:0/4289519061 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f508c141e10 0x7f508c1e2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:54.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.265+0000 7f508bfff640 1 --2- 172.21.15.28:0/4289519061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f508c0b2180 0x7f508c0b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:54.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.265+0000 7f508b7fe640 1 -- 172.21.15.28:0/4289519061 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f508c141e10 msgr2=0x7f508c1e2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:54.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.265+0000 7f508b7fe640 1 --2- 172.21.15.28:0/4289519061 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f508c141e10 0x7f508c1e2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.265+0000 7f508b7fe640 1 -- 172.21.15.28:0/4289519061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f508c0b2180 msgr2=0x7f508c0b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:54.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.265+0000 7f508b7fe640 1 --2- 172.21.15.28:0/4289519061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f508c0b2180 0x7f508c0b4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.265+0000 7f508b7fe640 1 -- 172.21.15.28:0/4289519061 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50800094d0 con 0x7f508c0b8c90 2023-11-16T02:29:54.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.265+0000 7f508bfff640 1 --2- 172.21.15.28:0/4289519061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f508c0b2180 0x7f508c0b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:54.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.265+0000 7f5090f7c640 1 --2- 172.21.15.28:0/4289519061 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f508c141e10 0x7f508c1e2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:54.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.265+0000 7f508b7fe640 1 --2- 172.21.15.28:0/4289519061 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f508c0b8c90 0x7f508c140910 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f50800ab040 tx=0x7f508001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:54.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.265+0000 7f5088ff9640 1 -- 172.21.15.28:0/4289519061 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50800a95f0 con 0x7f508c0b8c90 2023-11-16T02:29:54.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.265+0000 7f5088ff9640 1 -- 172.21.15.28:0/4289519061 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50800b1820 con 0x7f508c0b8c90 2023-11-16T02:29:54.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.265+0000 7f50929df640 1 -- 172.21.15.28:0/4289519061 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508c140110 con 0x7f508c0b8c90 2023-11-16T02:29:54.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.265+0000 7f5088ff9640 1 -- 172.21.15.28:0/4289519061 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50800b1bd0 con 0x7f508c0b8c90 2023-11-16T02:29:54.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.265+0000 7f50929df640 1 -- 172.21.15.28:0/4289519061 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508c13c3e0 con 0x7f508c0b8c90 2023-11-16T02:29:54.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.265+0000 7f50929df640 1 -- 172.21.15.28:0/4289519061 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f508c066f00 con 0x7f508c0b8c90 2023-11-16T02:29:54.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.265+0000 7f5088ff9640 1 -- 172.21.15.28:0/4289519061 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f50800b1d30 con 0x7f508c0b8c90 2023-11-16T02:29:54.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.265+0000 7f5088ff9640 1 --2- 172.21.15.28:0/4289519061 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5078065a60 0x7f5078067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:54.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.265+0000 7f5088ff9640 1 -- 172.21.15.28:0/4289519061 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f508011dad0 con 0x7f508c0b8c90 2023-11-16T02:29:54.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.265+0000 7f508bfff640 1 --2- 172.21.15.28:0/4289519061 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5078065a60 0x7f5078067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:54.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.265+0000 7f508bfff640 1 --2- 172.21.15.28:0/4289519061 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5078065a60 0x7f5078067f20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f507c000f70 tx=0x7f507c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:54.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.269+0000 7f5088ff9640 1 -- 172.21.15.28:0/4289519061 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f50800eb520 con 0x7f508c0b8c90 2023-11-16T02:29:54.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.461+0000 7f50929df640 1 -- 172.21.15.28:0/4289519061 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f508c140610 con 0x7f508c0b8c90 2023-11-16T02:29:54.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.461+0000 7f5088ff9640 1 -- 172.21.15.28:0/4289519061 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3883 (secure 0 0 0) 0x7f50800eeb40 con 0x7f508c0b8c90 2023-11-16T02:29:54.466 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:54.466 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/4054669002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":4054669002},{"type":"v1","addr":"172.21.15.28:6836","nonce":4054669002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/903740631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":903740631},{"type":"v1","addr":"172.21.15.70:6833","nonce":903740631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-16T02:29:37.868031+0000","modified":"2023-11-16T02:29:40.877544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6837/1025130674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1025130674},{"type":"v1","addr":"172.21.15.28:6837","nonce":1025130674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-16T02:29:54.466 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 7 2023-11-16T02:29:54.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.465+0000 7f50929df640 1 -- 172.21.15.28:0/4289519061 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5078065a60 msgr2=0x7f5078067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:54.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.465+0000 7f50929df640 1 --2- 172.21.15.28:0/4289519061 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5078065a60 0x7f5078067f20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f507c000f70 tx=0x7f507c009040 comp rx=0 tx=0).stop 2023-11-16T02:29:54.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.465+0000 7f50929df640 1 -- 172.21.15.28:0/4289519061 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f508c0b8c90 msgr2=0x7f508c140910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:54.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.465+0000 7f50929df640 1 --2- 172.21.15.28:0/4289519061 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f508c0b8c90 0x7f508c140910 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f50800ab040 tx=0x7f508001ad50 comp rx=0 tx=0).stop 2023-11-16T02:29:54.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.465+0000 7f50929df640 1 -- 172.21.15.28:0/4289519061 shutdown_connections 2023-11-16T02:29:54.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.465+0000 7f50929df640 1 --2- 172.21.15.28:0/4289519061 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5078065a60 0x7f5078067f20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.465+0000 7f50929df640 1 --2- 172.21.15.28:0/4289519061 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f508c141e10 0x7f508c1e2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.465+0000 7f50929df640 1 --2- 172.21.15.28:0/4289519061 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f508c0b8c90 0x7f508c140910 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.465+0000 7f50929df640 1 --2- 172.21.15.28:0/4289519061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f508c0b2180 0x7f508c0b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.465+0000 7f50929df640 1 -- 172.21.15.28:0/4289519061 >> 172.21.15.28:0/4289519061 conn(0x7f508c0b9b20 msgr2=0x7f508c0731d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:54.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.465+0000 7f50929df640 1 -- 172.21.15.28:0/4289519061 shutdown_connections 2023-11-16T02:29:54.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.465+0000 7f50929df640 1 -- 172.21.15.28:0/4289519061 wait complete. 2023-11-16T02:29:54.485 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-16T02:29:54.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.593+0000 7f91c5a16640 1 Processor -- start 2023-11-16T02:29:54.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.593+0000 7f91c5a16640 1 -- start start 2023-11-16T02:29:54.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.597+0000 7f91c5a16640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f91c00bc900 0x7f91c00b82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:54.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.597+0000 7f91c5a16640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f91c0148370 0x7f91c0141b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:54.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.597+0000 7f91c5a16640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c00712b0 con 0x7f91c01416d0 2023-11-16T02:29:54.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.597+0000 7f91c5a16640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c0071b50 con 0x7f91c0148370 2023-11-16T02:29:54.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.597+0000 7f91c5a16640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c0071590 con 0x7f91c00bc900 2023-11-16T02:29:54.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.597+0000 7f91bf7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f91c0148370 0x7f91c0141b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:54.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.597+0000 7f91bf7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f91c0148370 0x7f91c0141b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47304/0 (socket says 172.21.15.28:47304) 2023-11-16T02:29:54.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.597+0000 7f91bf7fe640 1 -- 172.21.15.28:0/843348795 learned_addr learned my addr 172.21.15.28:0/843348795 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:54.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.597+0000 7f91beffd640 1 --2- 172.21.15.28:0/843348795 >> v2:172.21.15.70:3300/0 conn(0x7f91c00bc900 0x7f91c00b82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:54.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.597+0000 7f91bf7fe640 1 -- 172.21.15.28:0/843348795 >> v2:172.21.15.70:3300/0 conn(0x7f91c00bc900 msgr2=0x7f91c00b82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:54.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.597+0000 7f91bf7fe640 1 --2- 172.21.15.28:0/843348795 >> v2:172.21.15.70:3300/0 conn(0x7f91c00bc900 0x7f91c00b82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.597+0000 7f91bf7fe640 1 -- 172.21.15.28:0/843348795 >> v1:172.21.15.70:6789/0 conn(0x7f91c01416d0 legacy=0x7f91c0147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:54.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.597+0000 7f91bf7fe640 1 -- 172.21.15.28:0/843348795 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c0071870 con 0x7f91c0148370 2023-11-16T02:29:54.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.597+0000 7f91beffd640 1 --2- 172.21.15.28:0/843348795 >> v2:172.21.15.70:3300/0 conn(0x7f91c00bc900 0x7f91c00b82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:54.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91bf7fe640 1 --2- 172.21.15.28:0/843348795 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91c0148370 0x7f91c0141b40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f91c00bcff0 tx=0x7f91b001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ddc29312ab951a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:54.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91bdffb640 1 -- 172.21.15.28:0/843348795 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b00ac630 con 0x7f91c0148370 2023-11-16T02:29:54.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91bdffb640 1 -- 172.21.15.28:0/843348795 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b00ac790 con 0x7f91c0148370 2023-11-16T02:29:54.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91bdffb640 1 -- 172.21.15.28:0/843348795 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b00acb20 con 0x7f91c0148370 2023-11-16T02:29:54.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91c5a16640 1 -- 172.21.15.28:0/843348795 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91c0148370 msgr2=0x7f91c0141b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:54.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91c5a16640 1 --2- 172.21.15.28:0/843348795 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91c0148370 0x7f91c0141b40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f91c00bcff0 tx=0x7f91b001c4c0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91c5a16640 1 -- 172.21.15.28:0/843348795 shutdown_connections 2023-11-16T02:29:54.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91c5a16640 1 --2- 172.21.15.28:0/843348795 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91c0148370 0x7f91c0141b40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91c5a16640 1 --2- 172.21.15.28:0/843348795 >> v2:172.21.15.70:3300/0 conn(0x7f91c00bc900 0x7f91c00b82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91c5a16640 1 -- 172.21.15.28:0/843348795 >> 172.21.15.28:0/843348795 conn(0x7f91c00b9050 msgr2=0x7f91c00bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:54.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91c5a16640 1 -- 172.21.15.28:0/843348795 shutdown_connections 2023-11-16T02:29:54.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91c5a16640 1 -- 172.21.15.28:0/843348795 wait complete. 2023-11-16T02:29:54.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91c5a16640 1 Processor -- start 2023-11-16T02:29:54.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91c5a16640 1 -- start start 2023-11-16T02:29:54.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91c5a16640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91c00bc900 0x7f91c01e1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:54.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91c5a16640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91c01416d0 0x7f91c00b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:54.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91c5a16640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f91c0148370 0x7f91c01470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:54.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91c5a16640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c00b4af0 con 0x7f91c00bc900 2023-11-16T02:29:54.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91c5a16640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c0147600 con 0x7f91c01416d0 2023-11-16T02:29:54.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91c5a16640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c00b5a90 con 0x7f91c0148370 2023-11-16T02:29:54.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91beffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91c00bc900 0x7f91c01e1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:54.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91beffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91c00bc900 0x7f91c01e1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47316/0 (socket says 172.21.15.28:47316) 2023-11-16T02:29:54.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91beffd640 1 -- 172.21.15.28:0/313315384 learned_addr learned my addr 172.21.15.28:0/313315384 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:54.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91be7fc640 1 --2- 172.21.15.28:0/313315384 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91c01416d0 0x7f91c00b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:54.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91beffd640 1 -- 172.21.15.28:0/313315384 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f91c0148370 msgr2=0x7f91c01470c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:54.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91bf7fe640 1 --2- 172.21.15.28:0/313315384 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f91c0148370 0x7f91c01470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:54.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91beffd640 1 --2- 172.21.15.28:0/313315384 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f91c0148370 0x7f91c01470c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91beffd640 1 -- 172.21.15.28:0/313315384 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91c01416d0 msgr2=0x7f91c00b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:54.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91beffd640 1 --2- 172.21.15.28:0/313315384 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91c01416d0 0x7f91c00b53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91beffd640 1 -- 172.21.15.28:0/313315384 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b00094d0 con 0x7f91c00bc900 2023-11-16T02:29:54.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91be7fc640 1 --2- 172.21.15.28:0/313315384 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91c01416d0 0x7f91c00b53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:54.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91beffd640 1 --2- 172.21.15.28:0/313315384 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91c00bc900 0x7f91c01e1ba0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f91b800cf60 tx=0x7f91b800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:54.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91a7fff640 1 -- 172.21.15.28:0/313315384 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b800d840 con 0x7f91c00bc900 2023-11-16T02:29:54.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91a7fff640 1 -- 172.21.15.28:0/313315384 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b800d9a0 con 0x7f91c00bc900 2023-11-16T02:29:54.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91c5a16640 1 -- 172.21.15.28:0/313315384 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c00b6050 con 0x7f91c00bc900 2023-11-16T02:29:54.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91a7fff640 1 -- 172.21.15.28:0/313315384 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b800dd30 con 0x7f91c00bc900 2023-11-16T02:29:54.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.601+0000 7f91c5a16640 1 -- 172.21.15.28:0/313315384 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c00b6610 con 0x7f91c00bc900 2023-11-16T02:29:54.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.605+0000 7f91c5a16640 1 -- 172.21.15.28:0/313315384 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c004e8a0 con 0x7f91c00bc900 2023-11-16T02:29:54.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.605+0000 7f91a7fff640 1 -- 172.21.15.28:0/313315384 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f91b8015440 con 0x7f91c00bc900 2023-11-16T02:29:54.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.605+0000 7f91a7fff640 1 --2- 172.21.15.28:0/313315384 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f91ac065a90 0x7f91ac067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:54.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.605+0000 7f91a7fff640 1 -- 172.21.15.28:0/313315384 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91b8083a90 con 0x7f91c00bc900 2023-11-16T02:29:54.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.605+0000 7f91be7fc640 1 --2- 172.21.15.28:0/313315384 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f91ac065a90 0x7f91ac067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:54.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.605+0000 7f91be7fc640 1 --2- 172.21.15.28:0/313315384 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f91ac065a90 0x7f91ac067f50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f91b4003e40 tx=0x7f91b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:54.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.609+0000 7f91a7fff640 1 -- 172.21.15.28:0/313315384 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f91b8051590 con 0x7f91c00bc900 2023-11-16T02:29:54.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.761+0000 7f91c5a16640 1 -- 172.21.15.28:0/313315384 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91c0139020 con 0x7f91c00bc900 2023-11-16T02:29:54.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.761+0000 7f91a7fff640 1 -- 172.21.15.28:0/313315384 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f91b801a090 con 0x7f91c00bc900 2023-11-16T02:29:54.766 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:54.766 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":22,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","created":"2023-11-16T02:29:13.710567+0000","modified":"2023-11-16T02:29:38.871066+0000","last_up_change":"2023-11-16T02:29:24.841087+0000","last_in_change":"2023-11-16T02:29:16.024490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-16T02:29:26.490910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-16T02:29:36.133224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-16T02:29:36.866156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dfa8b58d-3481-4e68-86e8-21873d31d0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":38722},{"type":"v1","addr":"172.21.15.28:6809","nonce":38722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":38722},{"type":"v1","addr":"172.21.15.28:6811","nonce":38722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":38722},{"type":"v1","addr":"172.21.15.28:6815","nonce":38722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":38722},{"type":"v1","addr":"172.21.15.28:6813","nonce":38722}]},"public_addr":"172.21.15.28:6809/38722","cluster_addr":"172.21.15.28:6811/38722","heartbeat_back_addr":"172.21.15.28:6815/38722","heartbeat_front_addr":"172.21.15.28:6813/38722","state":["exists","up"]},{"osd":1,"uuid":"1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":38724},{"type":"v1","addr":"172.21.15.28:6824","nonce":38724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":38724},{"type":"v1","addr":"172.21.15.28:6827","nonce":38724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":38724},{"type":"v1","addr":"172.21.15.28:6831","nonce":38724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":38724},{"type":"v1","addr":"172.21.15.28:6829","nonce":38724}]},"public_addr":"172.21.15.28:6824/38724","cluster_addr":"172.21.15.28:6827/38724","heartbeat_back_addr":"172.21.15.28:6831/38724","heartbeat_front_addr":"172.21.15.28:6829/38724","state":["exists","up"]},{"osd":2,"uuid":"e18f39cd-6a35-4d36-9eed-3877794bf2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":38723},{"type":"v1","addr":"172.21.15.28:6801","nonce":38723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":38723},{"type":"v1","addr":"172.21.15.28:6803","nonce":38723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":38723},{"type":"v1","addr":"172.21.15.28:6807","nonce":38723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":38723},{"type":"v1","addr":"172.21.15.28:6805","nonce":38723}]},"public_addr":"172.21.15.28:6801/38723","cluster_addr":"172.21.15.28:6803/38723","heartbeat_back_addr":"172.21.15.28:6807/38723","heartbeat_front_addr":"172.21.15.28:6805/38723","state":["exists","up"]},{"osd":3,"uuid":"303d0728-409d-47d7-b7a6-6eb273f602fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":38725},{"type":"v1","addr":"172.21.15.28:6817","nonce":38725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":38725},{"type":"v1","addr":"172.21.15.28:6819","nonce":38725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":38725},{"type":"v1","addr":"172.21.15.28:6825","nonce":38725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":38725},{"type":"v1","addr":"172.21.15.28:6821","nonce":38725}]},"public_addr":"172.21.15.28:6817/38725","cluster_addr":"172.21.15.28:6819/38725","heartbeat_back_addr":"172.21.15.28:6825/38725","heartbeat_front_addr":"172.21.15.28:6821/38725","state":["exists","up"]},{"osd":4,"uuid":"df0bf0ac-6efe-4964-ad27-7c1771a70c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":38828},{"type":"v1","addr":"172.21.15.70:6801","nonce":38828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":38828},{"type":"v1","addr":"172.21.15.70:6803","nonce":38828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":38828},{"type":"v1","addr":"172.21.15.70:6807","nonce":38828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":38828},{"type":"v1","addr":"172.21.15.70:6805","nonce":38828}]},"public_addr":"172.21.15.70:6801/38828","cluster_addr":"172.21.15.70:6803/38828","heartbeat_back_addr":"172.21.15.70:6807/38828","heartbeat_front_addr":"172.21.15.70:6805/38828","state":["exists","up"]},{"osd":5,"uuid":"84921219-65cb-4c4e-b9ed-a773db639034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":38830},{"type":"v1","addr":"172.21.15.70:6810","nonce":38830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6813","nonce":38830},{"type":"v1","addr":"172.21.15.70:6814","nonce":38830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":38830},{"type":"v1","addr":"172.21.15.70:6824","nonce":38830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":38830},{"type":"v1","addr":"172.21.15.70:6819","nonce":38830}]},"public_addr":"172.21.15.70:6810/38830","cluster_addr":"172.21.15.70:6814/38830","heartbeat_back_addr":"172.21.15.70:6824/38830","heartbeat_front_addr":"172.21.15.70:6819/38830","state":["exists","up"]},{"osd":6,"uuid":"c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":38829},{"type":"v1","addr":"172.21.15.70:6812","nonce":38829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":38829},{"type":"v1","addr":"172.21.15.70:6820","nonce":38829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":38829},{"type":"v1","addr":"172.21.15.70:6828","nonce":38829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":38829},{"type":"v1","addr":"172.21.15.70:6825","nonce":38829}]},"public_addr":"172.21.15.70:6812/38829","cluster_addr":"172.21.15.70:6820/38829","heartbeat_back_addr":"172.21.15.70:6828/38829","heartbeat_front_addr":"172.21.15.70:6825/38829","state":["exists","up"]},{"osd":7,"uuid":"e2cdd418-12ce-4eea-9b22-efdad83eb76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":38839},{"type":"v1","addr":"172.21.15.70:6815","nonce":38839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":38839},{"type":"v1","addr":"172.21.15.70:6823","nonce":38839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":38839},{"type":"v1","addr":"172.21.15.70:6831","nonce":38839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6827","nonce":38839},{"type":"v1","addr":"172.21.15.70:6829","nonce":38839}]},"public_addr":"172.21.15.70:6815/38839","cluster_addr":"172.21.15.70:6823/38839","heartbeat_back_addr":"172.21.15.70:6831/38839","heartbeat_front_addr":"172.21.15.70:6829/38839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.544240+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.637637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.352115+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.652916+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.624477+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.570247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.706468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.696574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-16T02:29:54.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.765+0000 7f91c5a16640 1 -- 172.21.15.28:0/313315384 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f91ac065a90 msgr2=0x7f91ac067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:54.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.765+0000 7f91c5a16640 1 --2- 172.21.15.28:0/313315384 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f91ac065a90 0x7f91ac067f50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f91b4003e40 tx=0x7f91b4009040 comp rx=0 tx=0).stop 2023-11-16T02:29:54.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.765+0000 7f91c5a16640 1 -- 172.21.15.28:0/313315384 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91c00bc900 msgr2=0x7f91c01e1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:54.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.765+0000 7f91c5a16640 1 --2- 172.21.15.28:0/313315384 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91c00bc900 0x7f91c01e1ba0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f91b800cf60 tx=0x7f91b800cf90 comp rx=0 tx=0).stop 2023-11-16T02:29:54.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.765+0000 7f91c5a16640 1 -- 172.21.15.28:0/313315384 shutdown_connections 2023-11-16T02:29:54.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.765+0000 7f91c5a16640 1 --2- 172.21.15.28:0/313315384 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f91ac065a90 0x7f91ac067f50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.765+0000 7f91c5a16640 1 --2- 172.21.15.28:0/313315384 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f91c0148370 0x7f91c01470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.765+0000 7f91c5a16640 1 --2- 172.21.15.28:0/313315384 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91c01416d0 0x7f91c00b53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.765+0000 7f91c5a16640 1 --2- 172.21.15.28:0/313315384 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f91c00bc900 0x7f91c01e1ba0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.765+0000 7f91c5a16640 1 -- 172.21.15.28:0/313315384 >> 172.21.15.28:0/313315384 conn(0x7f91c00b9050 msgr2=0x7f91c0138600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:54.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.765+0000 7f91c5a16640 1 -- 172.21.15.28:0/313315384 shutdown_connections 2023-11-16T02:29:54.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.765+0000 7f91c5a16640 1 -- 172.21.15.28:0/313315384 wait complete. 2023-11-16T02:29:54.783 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-16T02:29:54.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.901+0000 7f40e9179640 1 Processor -- start 2023-11-16T02:29:54.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.901+0000 7f40e9179640 1 -- start start 2023-11-16T02:29:54.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.901+0000 7f40e9179640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f40e40b8c90 0x7f40e40703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:54.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e9179640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f40e409fcd0 0x7f40e4152710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:54.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e9179640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f40e4152c50 0x7f40e4148eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:54.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e9179640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e4153100 con 0x7f40e40b8c90 2023-11-16T02:29:54.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e9179640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e406ddc0 con 0x7f40e409fcd0 2023-11-16T02:29:54.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e9179640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e406e0a0 con 0x7f40e4152c50 2023-11-16T02:29:54.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e2d9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f40e40b8c90 0x7f40e40703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:54.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e2d9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f40e40b8c90 0x7f40e40703a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47332/0 (socket says 172.21.15.28:47332) 2023-11-16T02:29:54.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e2d9d640 1 -- 172.21.15.28:0/1781884050 learned_addr learned my addr 172.21.15.28:0/1781884050 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:54.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e359e640 1 --2- 172.21.15.28:0/1781884050 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f40e4152c50 0x7f40e4148eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:54.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e259c640 1 --2- 172.21.15.28:0/1781884050 >> v2:172.21.15.70:3300/0 conn(0x7f40e409fcd0 0x7f40e4152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:54.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e2d9d640 1 -- 172.21.15.28:0/1781884050 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f40e4152c50 msgr2=0x7f40e4148eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:54.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e2d9d640 1 --2- 172.21.15.28:0/1781884050 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f40e4152c50 0x7f40e4148eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e2d9d640 1 -- 172.21.15.28:0/1781884050 >> v2:172.21.15.70:3300/0 conn(0x7f40e409fcd0 msgr2=0x7f40e4152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:54.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e2d9d640 1 --2- 172.21.15.28:0/1781884050 >> v2:172.21.15.70:3300/0 conn(0x7f40e409fcd0 0x7f40e4152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e2d9d640 1 -- 172.21.15.28:0/1781884050 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e406e380 con 0x7f40e40b8c90 2023-11-16T02:29:54.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e259c640 1 --2- 172.21.15.28:0/1781884050 >> v2:172.21.15.70:3300/0 conn(0x7f40e409fcd0 0x7f40e4152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:54.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e2d9d640 1 --2- 172.21.15.28:0/1781884050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f40e40b8c90 0x7f40e40703a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f40e406fbd0 tx=0x7f40d801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f705bbad56bf96d server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:54.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e1d9b640 1 -- 172.21.15.28:0/1781884050 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d80a89b0 con 0x7f40e40b8c90 2023-11-16T02:29:54.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e1d9b640 1 -- 172.21.15.28:0/1781884050 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d80a8b10 con 0x7f40e40b8c90 2023-11-16T02:29:54.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e1d9b640 1 -- 172.21.15.28:0/1781884050 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d80a8ea0 con 0x7f40e40b8c90 2023-11-16T02:29:54.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e9179640 1 -- 172.21.15.28:0/1781884050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f40e40b8c90 msgr2=0x7f40e40703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:54.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e9179640 1 --2- 172.21.15.28:0/1781884050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f40e40b8c90 0x7f40e40703a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f40e406fbd0 tx=0x7f40d801ecf0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e9179640 1 -- 172.21.15.28:0/1781884050 shutdown_connections 2023-11-16T02:29:54.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e9179640 1 --2- 172.21.15.28:0/1781884050 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f40e4152c50 0x7f40e4148eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e9179640 1 --2- 172.21.15.28:0/1781884050 >> v2:172.21.15.70:3300/0 conn(0x7f40e409fcd0 0x7f40e4152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e9179640 1 --2- 172.21.15.28:0/1781884050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f40e40b8c90 0x7f40e40703a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e9179640 1 -- 172.21.15.28:0/1781884050 >> 172.21.15.28:0/1781884050 conn(0x7f40e40b9b20 msgr2=0x7f40e40b9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:54.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e9179640 1 -- 172.21.15.28:0/1781884050 shutdown_connections 2023-11-16T02:29:54.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.905+0000 7f40e9179640 1 -- 172.21.15.28:0/1781884050 wait complete. 2023-11-16T02:29:54.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.909+0000 7f40e9179640 1 Processor -- start 2023-11-16T02:29:54.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.909+0000 7f40e9179640 1 -- start start 2023-11-16T02:29:54.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.909+0000 7f40e9179640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40e409fcd0 0x7f40e40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:54.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.909+0000 7f40e9179640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f40e40b8c90 0x7f40e40b6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:54.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.909+0000 7f40e9179640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f40e4152c50 0x7f40e40b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:54.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.909+0000 7f40e9179640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e4151fb0 con 0x7f40e4152c50 2023-11-16T02:29:54.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.909+0000 7f40e9179640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e4151710 con 0x7f40e409fcd0 2023-11-16T02:29:54.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.909+0000 7f40e9179640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e41519f0 con 0x7f40e40b8c90 2023-11-16T02:29:54.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.909+0000 7f40e359e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f40e4152c50 0x7f40e40b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:54.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.909+0000 7f40e359e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f40e4152c50 0x7f40e40b4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47344/0 (socket says 172.21.15.28:47344) 2023-11-16T02:29:54.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.909+0000 7f40e359e640 1 -- 172.21.15.28:0/1962784596 learned_addr learned my addr 172.21.15.28:0/1962784596 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:54.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.909+0000 7f40e2d9d640 1 --2- 172.21.15.28:0/1962784596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40e409fcd0 0x7f40e40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:54.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.909+0000 7f40e259c640 1 --2- 172.21.15.28:0/1962784596 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f40e40b8c90 0x7f40e40b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:54.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.909+0000 7f40e359e640 1 -- 172.21.15.28:0/1962784596 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f40e40b8c90 msgr2=0x7f40e40b6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:54.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.909+0000 7f40e359e640 1 --2- 172.21.15.28:0/1962784596 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f40e40b8c90 0x7f40e40b6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.909+0000 7f40e359e640 1 -- 172.21.15.28:0/1962784596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40e409fcd0 msgr2=0x7f40e40b6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:54.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.909+0000 7f40e359e640 1 --2- 172.21.15.28:0/1962784596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40e409fcd0 0x7f40e40b6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:54.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.909+0000 7f40e359e640 1 -- 172.21.15.28:0/1962784596 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d80094d0 con 0x7f40e4152c50 2023-11-16T02:29:54.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.909+0000 7f40e359e640 1 --2- 172.21.15.28:0/1962784596 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f40e4152c50 0x7f40e40b4ba0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f40dc007e60 tx=0x7f40dc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:54.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.909+0000 7f40cb7fe640 1 -- 172.21.15.28:0/1962784596 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc014420 con 0x7f40e4152c50 2023-11-16T02:29:54.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.909+0000 7f40cb7fe640 1 -- 172.21.15.28:0/1962784596 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc0145a0 con 0x7f40e4152c50 2023-11-16T02:29:54.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.909+0000 7f40e9179640 1 -- 172.21.15.28:0/1962784596 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e4151cd0 con 0x7f40e4152c50 2023-11-16T02:29:54.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.909+0000 7f40cb7fe640 1 -- 172.21.15.28:0/1962784596 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc014950 con 0x7f40e4152c50 2023-11-16T02:29:54.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.909+0000 7f40e9179640 1 -- 172.21.15.28:0/1962784596 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e414f6c0 con 0x7f40e4152c50 2023-11-16T02:29:54.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.909+0000 7f40e9179640 1 -- 172.21.15.28:0/1962784596 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e4066f00 con 0x7f40e4152c50 2023-11-16T02:29:54.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.909+0000 7f40cb7fe640 1 -- 172.21.15.28:0/1962784596 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f40dc014ab0 con 0x7f40e4152c50 2023-11-16T02:29:54.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.913+0000 7f40cb7fe640 1 --2- 172.21.15.28:0/1962784596 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f40d0065a60 0x7f40d0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:54.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.913+0000 7f40cb7fe640 1 -- 172.21.15.28:0/1962784596 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40dc083a70 con 0x7f40e4152c50 2023-11-16T02:29:54.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.913+0000 7f40e2d9d640 1 --2- 172.21.15.28:0/1962784596 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f40d0065a60 0x7f40d0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:54.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.913+0000 7f40e2d9d640 1 --2- 172.21.15.28:0/1962784596 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f40d0065a60 0x7f40d0067f20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f40d80b2000 tx=0x7f40d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:54.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:54.917+0000 7f40cb7fe640 1 -- 172.21.15.28:0/1962784596 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f40dc051430 con 0x7f40e4152c50 2023-11-16T02:29:55.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.101+0000 7f40e9179640 1 -- 172.21.15.28:0/1962784596 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40e40b48c0 con 0x7f40e4152c50 2023-11-16T02:29:55.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.105+0000 7f40cb7fe640 1 -- 172.21.15.28:0/1962784596 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3883 (secure 0 0 0) 0x7f40e40b48c0 con 0x7f40e4152c50 2023-11-16T02:29:55.107 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:55.107 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/4054669002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":4054669002},{"type":"v1","addr":"172.21.15.28:6836","nonce":4054669002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/903740631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":903740631},{"type":"v1","addr":"172.21.15.70:6833","nonce":903740631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-16T02:29:37.868031+0000","modified":"2023-11-16T02:29:40.877544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6837/1025130674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1025130674},{"type":"v1","addr":"172.21.15.28:6837","nonce":1025130674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-16T02:29:55.107 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 7 2023-11-16T02:29:55.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.105+0000 7f40e9179640 1 -- 172.21.15.28:0/1962784596 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f40d0065a60 msgr2=0x7f40d0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:55.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.105+0000 7f40e9179640 1 --2- 172.21.15.28:0/1962784596 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f40d0065a60 0x7f40d0067f20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f40d80b2000 tx=0x7f40d8008040 comp rx=0 tx=0).stop 2023-11-16T02:29:55.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.105+0000 7f40e9179640 1 -- 172.21.15.28:0/1962784596 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f40e4152c50 msgr2=0x7f40e40b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:55.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.105+0000 7f40e9179640 1 --2- 172.21.15.28:0/1962784596 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f40e4152c50 0x7f40e40b4ba0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f40dc007e60 tx=0x7f40dc00e4b0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.105+0000 7f40e9179640 1 -- 172.21.15.28:0/1962784596 shutdown_connections 2023-11-16T02:29:55.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.105+0000 7f40e9179640 1 --2- 172.21.15.28:0/1962784596 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f40d0065a60 0x7f40d0067f20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.105+0000 7f40e9179640 1 --2- 172.21.15.28:0/1962784596 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f40e4152c50 0x7f40e40b4ba0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.105+0000 7f40e9179640 1 --2- 172.21.15.28:0/1962784596 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f40e40b8c90 0x7f40e40b6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.105+0000 7f40e9179640 1 --2- 172.21.15.28:0/1962784596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40e409fcd0 0x7f40e40b6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.105+0000 7f40e9179640 1 -- 172.21.15.28:0/1962784596 >> 172.21.15.28:0/1962784596 conn(0x7f40e40b9b20 msgr2=0x7f40e4147410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:55.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.105+0000 7f40e9179640 1 -- 172.21.15.28:0/1962784596 shutdown_connections 2023-11-16T02:29:55.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.105+0000 7f40e9179640 1 -- 172.21.15.28:0/1962784596 wait complete. 2023-11-16T02:29:55.428 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-16T02:29:37.868031+0000', 'modified': '2023-11-16T02:29:40.877544+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4263}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4263': {'gid': 4263, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.28:6837/1025130674', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.28:6835', 'nonce': 1025130674}, {'type': 'v1', 'addr': '172.21.15.28:6837', 'nonce': 1025130674}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-16T02:29:55.428 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-16T02:29:55.428 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-16T02:29:55.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.561+0000 7f43487dc640 1 Processor -- start 2023-11-16T02:29:55.567 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.561+0000 7f43487dc640 1 -- start start 2023-11-16T02:29:55.568 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.565+0000 7f43487dc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f43400b38f0 0x7f434006a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:55.568 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.565+0000 7f43487dc640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43400b3e10 con 0x7f43400b6020 2023-11-16T02:29:55.568 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.565+0000 7f43487dc640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43400b5820 con 0x7f43400b2a00 2023-11-16T02:29:55.568 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.565+0000 7f43487dc640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43400b5b00 con 0x7f43400b38f0 2023-11-16T02:29:55.568 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.565+0000 7f4345d77640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f43400b38f0 0x7f434006a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:55.568 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.565+0000 7f4346d79640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f43400b6020 0x7f43401532f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55982/0 (socket says 172.21.15.28:55982) 2023-11-16T02:29:55.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.565+0000 7f4346d79640 1 -- 172.21.15.28:0/2241753845 learned_addr learned my addr 172.21.15.28:0/2241753845 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:55.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.565+0000 7f4345d77640 1 -- 172.21.15.28:0/2241753845 >> v1:172.21.15.70:6789/0 conn(0x7f43400b2a00 legacy=0x7f43401489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:55.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.565+0000 7f4345d77640 1 -- 172.21.15.28:0/2241753845 >> v1:172.21.15.28:6789/0 conn(0x7f43400b6020 legacy=0x7f43401532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:55.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.565+0000 7f4345d77640 1 -- 172.21.15.28:0/2241753845 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43400b5040 con 0x7f43400b38f0 2023-11-16T02:29:55.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.565+0000 7f4345576640 1 -- 172.21.15.28:0/2241753845 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 716194045 0 0) 0x7f43400b3e10 con 0x7f43400b6020 2023-11-16T02:29:55.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.565+0000 7f4345d77640 1 --2- 172.21.15.28:0/2241753845 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43400b38f0 0x7f434006a170 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f43300097c0 tx=0x7f433001ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee8b68e84b15a4a server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:55.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.565+0000 7f4345576640 1 -- 172.21.15.28:0/2241753845 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43300a8930 con 0x7f43400b38f0 2023-11-16T02:29:55.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.565+0000 7f4345576640 1 -- 172.21.15.28:0/2241753845 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43300a8a90 con 0x7f43400b38f0 2023-11-16T02:29:55.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.565+0000 7f4345576640 1 -- 172.21.15.28:0/2241753845 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43300a8e20 con 0x7f43400b38f0 2023-11-16T02:29:55.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.565+0000 7f43487dc640 1 -- 172.21.15.28:0/2241753845 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43400b38f0 msgr2=0x7f434006a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:55.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.565+0000 7f43487dc640 1 --2- 172.21.15.28:0/2241753845 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43400b38f0 0x7f434006a170 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f43300097c0 tx=0x7f433001ec30 comp rx=0 tx=0).stop 2023-11-16T02:29:55.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f43487dc640 1 -- 172.21.15.28:0/2241753845 shutdown_connections 2023-11-16T02:29:55.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f43487dc640 1 --2- 172.21.15.28:0/2241753845 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43400b38f0 0x7f434006a170 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f43487dc640 1 -- 172.21.15.28:0/2241753845 >> 172.21.15.28:0/2241753845 conn(0x7f43400bc3e0 msgr2=0x7f43400bc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:55.572 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f43487dc640 1 -- 172.21.15.28:0/2241753845 shutdown_connections 2023-11-16T02:29:55.572 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f43487dc640 1 -- 172.21.15.28:0/2241753845 wait complete. 2023-11-16T02:29:55.574 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f43487dc640 1 Processor -- start 2023-11-16T02:29:55.574 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f43487dc640 1 -- start start 2023-11-16T02:29:55.574 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f43487dc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43400b2a00 0x7f4340141340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:55.574 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f43487dc640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f43400b38f0 0x7f434013ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:55.574 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f43487dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43400b6020 0x7f4340140450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:55.574 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f43487dc640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43401463f0 con 0x7f43400b2a00 2023-11-16T02:29:55.574 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f43487dc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4340145ec0 con 0x7f43400b6020 2023-11-16T02:29:55.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f43487dc640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4340143be0 con 0x7f43400b38f0 2023-11-16T02:29:55.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f4346578640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43400b2a00 0x7f4340141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:55.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f4346578640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43400b2a00 0x7f4340141340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47364/0 (socket says 172.21.15.28:47364) 2023-11-16T02:29:55.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f4346578640 1 -- 172.21.15.28:0/2289998417 learned_addr learned my addr 172.21.15.28:0/2289998417 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:55.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f4345d77640 1 --2- 172.21.15.28:0/2289998417 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f43400b38f0 0x7f434013ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:55.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f4346d79640 1 --2- 172.21.15.28:0/2289998417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43400b6020 0x7f4340140450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:55.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f4346578640 1 -- 172.21.15.28:0/2289998417 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f43400b38f0 msgr2=0x7f434013ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:55.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f4346578640 1 --2- 172.21.15.28:0/2289998417 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f43400b38f0 0x7f434013ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f4346578640 1 -- 172.21.15.28:0/2289998417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43400b6020 msgr2=0x7f4340140450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:55.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f4346578640 1 --2- 172.21.15.28:0/2289998417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43400b6020 0x7f4340140450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f4346578640 1 -- 172.21.15.28:0/2289998417 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4330009420 con 0x7f43400b2a00 2023-11-16T02:29:55.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f4346d79640 1 --2- 172.21.15.28:0/2289998417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43400b6020 0x7f4340140450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:55.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f4346578640 1 --2- 172.21.15.28:0/2289998417 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43400b2a00 0x7f4340141340 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f433c00c450 tx=0x7f433c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:55.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f4336ffd640 1 -- 172.21.15.28:0/2289998417 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c012830 con 0x7f43400b2a00 2023-11-16T02:29:55.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f4336ffd640 1 -- 172.21.15.28:0/2289998417 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433c0129b0 con 0x7f43400b2a00 2023-11-16T02:29:55.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f4336ffd640 1 -- 172.21.15.28:0/2289998417 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c012d60 con 0x7f43400b2a00 2023-11-16T02:29:55.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f43487dc640 1 -- 172.21.15.28:0/2289998417 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4340146110 con 0x7f43400b2a00 2023-11-16T02:29:55.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.569+0000 7f43487dc640 1 -- 172.21.15.28:0/2289998417 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43400b86a0 con 0x7f43400b2a00 2023-11-16T02:29:55.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f4336ffd640 1 -- 172.21.15.28:0/2289998417 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f433c01c460 con 0x7f43400b2a00 2023-11-16T02:29:55.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f4336ffd640 1 --2- 172.21.15.28:0/2289998417 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4324065a60 0x7f4324067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:55.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f4345d77640 1 --2- 172.21.15.28:0/2289998417 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4324065a60 0x7f4324067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:55.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f4336ffd640 1 -- 172.21.15.28:0/2289998417 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f433c082f90 con 0x7f43400b2a00 2023-11-16T02:29:55.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f4345d77640 1 --2- 172.21.15.28:0/2289998417 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4324065a60 0x7f4324067f20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f43300b2000 tx=0x7f4330008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:55.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f434b904000 1 Processor -- start 2023-11-16T02:29:55.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f434b904000 1 -- start start 2023-11-16T02:29:55.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f434b904000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94490b930 0x55c94490bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:55.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f434b904000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490c250 0x55c94490c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:55.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f434b904000 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55c94490cb70 0x55c94494abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:55.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f434b904000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9447d3fc0 con 0x55c94490c250 2023-11-16T02:29:55.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f434b904000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9447621a0 con 0x55c94490b930 2023-11-16T02:29:55.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f434b904000 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c94475f770 con 0x55c94490cb70 2023-11-16T02:29:55.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f4345d77640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490c250 0x55c94490c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:55.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f4345d77640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490c250 0x55c94490c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47372/0 (socket says 172.21.15.28:47372) 2023-11-16T02:29:55.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f4345d77640 1 -- 172.21.15.28:0/115334187 learned_addr learned my addr 172.21.15.28:0/115334187 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:55.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f4346d79640 1 --2- 172.21.15.28:0/115334187 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55c94490cb70 0x55c94494abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:55.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f4346578640 1 --2- 172.21.15.28:0/115334187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94490b930 0x55c94490bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:55.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f4345d77640 1 -- 172.21.15.28:0/115334187 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55c94490cb70 msgr2=0x55c94494abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:55.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f4345d77640 1 --2- 172.21.15.28:0/115334187 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55c94490cb70 0x55c94494abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f4345d77640 1 -- 172.21.15.28:0/115334187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94490b930 msgr2=0x55c94490bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:55.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f4345d77640 1 --2- 172.21.15.28:0/115334187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94490b930 0x55c94490bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f4345d77640 1 -- 172.21.15.28:0/115334187 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c944457890 con 0x55c94490c250 2023-11-16T02:29:55.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f4346d79640 1 --2- 172.21.15.28:0/115334187 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55c94490cb70 0x55c94494abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:55.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f4345d77640 1 --2- 172.21.15.28:0/115334187 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490c250 0x55c94490c630 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4330008010 tx=0x7f43300aa070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f736b42274277d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:55.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f4323fff640 1 -- 172.21.15.28:0/115334187 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43300b0e90 con 0x55c94490c250 2023-11-16T02:29:55.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f4323fff640 1 -- 172.21.15.28:0/115334187 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43300c1070 con 0x55c94490c250 2023-11-16T02:29:55.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f4323fff640 1 -- 172.21.15.28:0/115334187 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43300c7630 con 0x55c94490c250 2023-11-16T02:29:55.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f434b904000 1 -- 172.21.15.28:0/115334187 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490c250 msgr2=0x55c94490c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:55.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f434b904000 1 --2- 172.21.15.28:0/115334187 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490c250 0x55c94490c630 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4330008010 tx=0x7f43300aa070 comp rx=0 tx=0).stop 2023-11-16T02:29:55.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f434b904000 1 -- 172.21.15.28:0/115334187 shutdown_connections 2023-11-16T02:29:55.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f434b904000 1 --2- 172.21.15.28:0/115334187 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55c94490cb70 0x55c94494abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.573+0000 7f434b904000 1 --2- 172.21.15.28:0/115334187 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490c250 0x55c94490c630 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 1 --2- 172.21.15.28:0/115334187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94490b930 0x55c94490bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 1 -- 172.21.15.28:0/115334187 >> 172.21.15.28:0/115334187 conn(0x55c944907e20 msgr2=0x55c94490a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:55.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 1 -- 172.21.15.28:0/115334187 shutdown_connections 2023-11-16T02:29:55.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 1 -- 172.21.15.28:0/115334187 wait complete. 2023-11-16T02:29:55.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 1 -- start start 2023-11-16T02:29:55.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 1 Processor -- start 2023-11-16T02:29:55.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94490b930 0x55c9449459d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:55.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55c94490c250 0x55c9449464d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:55.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490cb70 0x55c944946a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:55.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c94475b060 con 0x55c94490cb70 2023-11-16T02:29:55.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9446fa290 con 0x55c94490b930 2023-11-16T02:29:55.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c9447186f0 con 0x55c94490c250 2023-11-16T02:29:55.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 10 client.0 _ll_register_callbacks cb 0x55c9448f71d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-16T02:29:55.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f4346d79640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490cb70 0x55c944946a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:55.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f4346d79640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490cb70 0x55c944946a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47378/0 (socket says 172.21.15.28:47378) 2023-11-16T02:29:55.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f4346d79640 1 -- 172.21.15.28:0/2039599878 learned_addr learned my addr 172.21.15.28:0/2039599878 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:55.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f4346578640 1 --2- 172.21.15.28:0/2039599878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94490b930 0x55c9449459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:55.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f4345d77640 1 --2- 172.21.15.28:0/2039599878 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55c94490c250 0x55c9449464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:55.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f4346d79640 1 -- 172.21.15.28:0/2039599878 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55c94490c250 msgr2=0x55c9449464d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:55.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f4346d79640 1 --2- 172.21.15.28:0/2039599878 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55c94490c250 0x55c9449464d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f4346d79640 1 -- 172.21.15.28:0/2039599878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94490b930 msgr2=0x55c9449459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:55.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f4346d79640 1 --2- 172.21.15.28:0/2039599878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94490b930 0x55c9449459d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f4346d79640 1 -- 172.21.15.28:0/2039599878 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43400b5040 con 0x55c94490cb70 2023-11-16T02:29:55.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f4346d79640 1 --2- 172.21.15.28:0/2039599878 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490cb70 0x55c944946a10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f433800e4f0 tx=0x7f433800e9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978b03f771393308 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:55.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f43217fa640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2023-11-16T02:29:55.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f43217fa640 1 -- 172.21.15.28:0/2039599878 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43380070d0 con 0x55c94490cb70 2023-11-16T02:29:55.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f43217fa640 1 -- 172.21.15.28:0/2039599878 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4338014af0 con 0x55c94490cb70 2023-11-16T02:29:55.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 1 -- 172.21.15.28:0/2039599878 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c9447599b0 con 0x55c94490cb70 2023-11-16T02:29:55.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f43217fa640 1 -- 172.21.15.28:0/2039599878 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4338014cb0 con 0x55c94490cb70 2023-11-16T02:29:55.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 10 client.4671 fetch_fsmap learned FSMap version 7 2023-11-16T02:29:55.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 1 -- 172.21.15.28:0/2039599878 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55c9447201e0 con 0x55c94490cb70 2023-11-16T02:29:55.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f43217fa640 1 -- 172.21.15.28:0/2039599878 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c9447599b0 con 0x55c94490cb70 2023-11-16T02:29:55.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f43217fa640 1 -- 172.21.15.28:0/2039599878 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 7) v1 ==== 2561+0+0 (secure 0 0 0) 0x7f4338007230 con 0x55c94490cb70 2023-11-16T02:29:55.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 10 client.4671 fetch_fsmap finished waiting for FSMap version 7 2023-11-16T02:29:55.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 10 client.4671 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-16T02:29:55.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 20 client.4671 populate_metadata read hostname 'smithi028' 2023-11-16T02:29:55.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 1 --2- 172.21.15.28:0/2039599878 >> [v2:172.21.15.28:6835/1025130674,v1:172.21.15.28:6837/1025130674] conn(0x55c944947420 0x55c944947800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:55.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 4 client.4671 mds_command: new command op to 4263 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-16T02:29:55.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 1 -- 172.21.15.28:0/2039599878 --> [v2:172.21.15.28:6835/1025130674,v1:172.21.15.28:6837/1025130674] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c94478a4d0 con 0x55c944947420 2023-11-16T02:29:55.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f4346578640 1 --2- 172.21.15.28:0/2039599878 >> [v2:172.21.15.28:6835/1025130674,v1:172.21.15.28:6837/1025130674] conn(0x55c944947420 0x55c944947800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:55.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f4346578640 1 --2- 172.21.15.28:0/2039599878 >> [v2:172.21.15.28:6835/1025130674,v1:172.21.15.28:6837/1025130674] conn(0x55c944947420 0x55c944947800 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=344a80efbd84ce50 server_cookie=4c702c67ff276311 in_seq=0 out_seq=0 2023-11-16T02:29:55.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f43217fa640 10 client.4671 ms_handle_connect on v2:172.21.15.28:6835/1025130674 2023-11-16T02:29:55.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f43217fa640 1 -- 172.21.15.28:0/2039599878 <== mds.0 v2:172.21.15.28:6835/1025130674 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55c94478a4d0 con 0x55c944947420 2023-11-16T02:29:55.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f43217fa640 10 client.4671 handle_command_reply: tid=0 2023-11-16T02:29:55.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 1 client.4671 shutdown 2023-11-16T02:29:55.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 1 -- 172.21.15.28:0/2039599878 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490cb70 msgr2=0x55c944946a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:55.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 1 --2- 172.21.15.28:0/2039599878 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490cb70 0x55c944946a10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f433800e4f0 tx=0x7f433800e9b0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 1 -- 172.21.15.28:0/2039599878 shutdown_connections 2023-11-16T02:29:55.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 1 --2- 172.21.15.28:0/2039599878 >> [v2:172.21.15.28:6835/1025130674,v1:172.21.15.28:6837/1025130674] conn(0x55c944947420 0x55c944947800 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 1 --2- 172.21.15.28:0/2039599878 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490cb70 0x55c944946a10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.577+0000 7f434b904000 1 --2- 172.21.15.28:0/2039599878 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55c94490c250 0x55c9449464d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.581+0000 7f43217fa640 0 client.4671 ms_handle_reset on v2:172.21.15.28:6835/1025130674 2023-11-16T02:29:55.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.581+0000 7f434b904000 1 --2- 172.21.15.28:0/2039599878 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94490b930 0x55c9449459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.581+0000 7f434b904000 1 -- 172.21.15.28:0/2039599878 >> 172.21.15.28:0/2039599878 conn(0x55c944907e20 msgr2=0x55c94490aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:55.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.581+0000 7f434b904000 1 -- 172.21.15.28:0/2039599878 shutdown_connections 2023-11-16T02:29:55.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.581+0000 7f434b904000 1 -- 172.21.15.28:0/2039599878 wait complete. 2023-11-16T02:29:55.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.581+0000 7f434b904000 20 client.4671 trim_cache size 0 max 16384 2023-11-16T02:29:55.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.593+0000 7f434b904000 1 Processor -- start 2023-11-16T02:29:55.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.593+0000 7f434b904000 1 -- start start 2023-11-16T02:29:55.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.593+0000 7f434b904000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490b930 0x55c94490b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:55.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.593+0000 7f434b904000 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55c94490c250 0x55c944947f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:55.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.593+0000 7f434b904000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94490cb70 0x55c944956c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:55.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.593+0000 7f434b904000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c944418940 con 0x55c94490b930 2023-11-16T02:29:55.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.593+0000 7f434b904000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c944759ef0 con 0x55c94490cb70 2023-11-16T02:29:55.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.593+0000 7f434b904000 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c9449032a0 con 0x55c94490c250 2023-11-16T02:29:55.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.593+0000 7f4346578640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490b930 0x55c94490b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:55.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.593+0000 7f4346578640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490b930 0x55c94490b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47394/0 (socket says 172.21.15.28:47394) 2023-11-16T02:29:55.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.593+0000 7f4346578640 1 -- 172.21.15.28:0/3648331443 learned_addr learned my addr 172.21.15.28:0/3648331443 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:55.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.593+0000 7f4346578640 1 -- 172.21.15.28:0/3648331443 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55c94490c250 msgr2=0x55c944947f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:55.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.593+0000 7f4346578640 1 --2- 172.21.15.28:0/3648331443 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55c94490c250 0x55c944947f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.593+0000 7f4346578640 1 -- 172.21.15.28:0/3648331443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94490cb70 msgr2=0x55c944956c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:55.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.593+0000 7f4346d79640 1 --2- 172.21.15.28:0/3648331443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94490cb70 0x55c944956c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:55.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.593+0000 7f4346578640 1 --2- 172.21.15.28:0/3648331443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94490cb70 0x55c944956c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.593+0000 7f4346578640 1 -- 172.21.15.28:0/3648331443 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c94490fd80 con 0x55c94490b930 2023-11-16T02:29:55.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.593+0000 7f4346578640 1 --2- 172.21.15.28:0/3648331443 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490b930 0x55c94490b220 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f433c00ce10 tx=0x7f433c014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b189081a70c4aa75 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:55.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f4334ff9640 1 -- 172.21.15.28:0/3648331443 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c0527c0 con 0x55c94490b930 2023-11-16T02:29:55.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f4334ff9640 1 -- 172.21.15.28:0/3648331443 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433c052a20 con 0x55c94490b930 2023-11-16T02:29:55.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f4334ff9640 1 -- 172.21.15.28:0/3648331443 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c050d90 con 0x55c94490b930 2023-11-16T02:29:55.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 -- 172.21.15.28:0/3648331443 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490b930 msgr2=0x55c94490b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:55.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 --2- 172.21.15.28:0/3648331443 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490b930 0x55c94490b220 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f433c00ce10 tx=0x7f433c014040 comp rx=0 tx=0).stop 2023-11-16T02:29:55.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 -- 172.21.15.28:0/3648331443 shutdown_connections 2023-11-16T02:29:55.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 --2- 172.21.15.28:0/3648331443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94490cb70 0x55c944956c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 --2- 172.21.15.28:0/3648331443 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55c94490c250 0x55c944947f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 --2- 172.21.15.28:0/3648331443 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490b930 0x55c94490b220 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 -- 172.21.15.28:0/3648331443 >> 172.21.15.28:0/3648331443 conn(0x55c944907e20 msgr2=0x55c944947800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:55.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 -- 172.21.15.28:0/3648331443 shutdown_connections 2023-11-16T02:29:55.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 -- 172.21.15.28:0/3648331443 wait complete. 2023-11-16T02:29:55.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 -- start start 2023-11-16T02:29:55.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 Processor -- start 2023-11-16T02:29:55.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490b930 0x55c94499fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:55.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55c94490c250 0x55c9449598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:55.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94490cb70 0x55c944959e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:55.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c944758460 con 0x55c94490b930 2023-11-16T02:29:55.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9447006f0 con 0x55c94490cb70 2023-11-16T02:29:55.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c94475f060 con 0x55c94490c250 2023-11-16T02:29:55.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 10 client.0 _ll_register_callbacks cb 0x55c9446fb1d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-16T02:29:55.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f4346578640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490b930 0x55c94499fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:55.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f4346578640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490b930 0x55c94499fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47406/0 (socket says 172.21.15.28:47406) 2023-11-16T02:29:55.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f4346578640 1 -- 172.21.15.28:0/4189901352 learned_addr learned my addr 172.21.15.28:0/4189901352 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:55.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f4345d77640 1 --2- 172.21.15.28:0/4189901352 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55c94490c250 0x55c9449598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:55.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f4346578640 1 -- 172.21.15.28:0/4189901352 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55c94490c250 msgr2=0x55c9449598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:55.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f4346d79640 1 --2- 172.21.15.28:0/4189901352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94490cb70 0x55c944959e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:55.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f4346578640 1 --2- 172.21.15.28:0/4189901352 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55c94490c250 0x55c9449598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f4346578640 1 -- 172.21.15.28:0/4189901352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94490cb70 msgr2=0x55c944959e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:55.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f4346578640 1 --2- 172.21.15.28:0/4189901352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94490cb70 0x55c944959e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f4346578640 1 -- 172.21.15.28:0/4189901352 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43400b86a0 con 0x55c94490b930 2023-11-16T02:29:55.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f4346578640 1 --2- 172.21.15.28:0/4189901352 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490b930 0x55c94499fc10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f433c081500 tx=0x7f433c057040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1152ce42e17c3bca server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:55.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f43217fa640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2023-11-16T02:29:55.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f43217fa640 1 -- 172.21.15.28:0/4189901352 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c078070 con 0x55c94490b930 2023-11-16T02:29:55.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f43217fa640 1 -- 172.21.15.28:0/4189901352 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f433c07f070 con 0x55c94490b930 2023-11-16T02:29:55.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 -- 172.21.15.28:0/4189901352 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c94472ab90 con 0x55c94490b930 2023-11-16T02:29:55.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f43217fa640 1 -- 172.21.15.28:0/4189901352 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f433c058120 con 0x55c94490b930 2023-11-16T02:29:55.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 10 client.4677 fetch_fsmap learned FSMap version 7 2023-11-16T02:29:55.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 -- 172.21.15.28:0/4189901352 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55c944706330 con 0x55c94490b930 2023-11-16T02:29:55.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f43217fa640 1 -- 172.21.15.28:0/4189901352 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c94472ab90 con 0x55c94490b930 2023-11-16T02:29:55.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f43217fa640 1 -- 172.21.15.28:0/4189901352 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 7) v1 ==== 2561+0+0 (secure 0 0 0) 0x7f433c050d90 con 0x55c94490b930 2023-11-16T02:29:55.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 10 client.4677 fetch_fsmap finished waiting for FSMap version 7 2023-11-16T02:29:55.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 10 client.4677 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-16T02:29:55.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 20 client.4677 populate_metadata read hostname 'smithi028' 2023-11-16T02:29:55.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 --2- 172.21.15.28:0/4189901352 >> [v2:172.21.15.28:6835/1025130674,v1:172.21.15.28:6837/1025130674] conn(0x55c94495a350 0x55c94495a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:55.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 4 client.4677 mds_command: new command op to 4263 tid=0[{"prefix": "status"}] 2023-11-16T02:29:55.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 -- 172.21.15.28:0/4189901352 --> [v2:172.21.15.28:6835/1025130674,v1:172.21.15.28:6837/1025130674] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c9447540e0 con 0x55c94495a350 2023-11-16T02:29:55.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f4345d77640 1 --2- 172.21.15.28:0/4189901352 >> [v2:172.21.15.28:6835/1025130674,v1:172.21.15.28:6837/1025130674] conn(0x55c94495a350 0x55c94495a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:55.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f4345d77640 1 --2- 172.21.15.28:0/4189901352 >> [v2:172.21.15.28:6835/1025130674,v1:172.21.15.28:6837/1025130674] conn(0x55c94495a350 0x55c94495a730 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c6e551b2d741874 server_cookie=e274aebaab27abd5 in_seq=0 out_seq=0 2023-11-16T02:29:55.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f43217fa640 10 client.4677 ms_handle_connect on v2:172.21.15.28:6835/1025130674 2023-11-16T02:29:55.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f43217fa640 1 -- 172.21.15.28:0/4189901352 <== mds.0 v2:172.21.15.28:6835/1025130674 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55c9447540e0 con 0x55c94495a350 2023-11-16T02:29:55.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f43217fa640 10 client.4677 handle_command_reply: tid=0 2023-11-16T02:29:55.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 client.4677 shutdown 2023-11-16T02:29:55.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 -- 172.21.15.28:0/4189901352 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490b930 msgr2=0x55c94499fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:55.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 --2- 172.21.15.28:0/4189901352 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490b930 0x55c94499fc10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f433c081500 tx=0x7f433c057040 comp rx=0 tx=0).stop 2023-11-16T02:29:55.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 -- 172.21.15.28:0/4189901352 shutdown_connections 2023-11-16T02:29:55.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 --2- 172.21.15.28:0/4189901352 >> [v2:172.21.15.28:6835/1025130674,v1:172.21.15.28:6837/1025130674] conn(0x55c94495a350 0x55c94495a730 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 --2- 172.21.15.28:0/4189901352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94490cb70 0x55c944959e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 --2- 172.21.15.28:0/4189901352 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x55c94490c250 0x55c9449598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f43217fa640 0 client.4677 ms_handle_reset on v2:172.21.15.28:6835/1025130674 2023-11-16T02:29:55.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 --2- 172.21.15.28:0/4189901352 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c94490b930 0x55c94499fc10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.597+0000 7f434b904000 1 -- 172.21.15.28:0/4189901352 >> 172.21.15.28:0/4189901352 conn(0x55c944907e20 msgr2=0x55c94490aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:55.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.601+0000 7f434b904000 1 -- 172.21.15.28:0/4189901352 shutdown_connections 2023-11-16T02:29:55.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.601+0000 7f434b904000 1 -- 172.21.15.28:0/4189901352 wait complete. 2023-11-16T02:29:55.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.601+0000 7f434b904000 20 client.4677 trim_cache size 0 max 16384 2023-11-16T02:29:55.612 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2023-11-16T02:29:55.612 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "1325a234-ab9e-4632-9a6e-98afbef8ae76", 2023-11-16T02:29:55.612 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 0, 2023-11-16T02:29:55.613 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 4263, 2023-11-16T02:29:55.613 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2023-11-16T02:29:55.613 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2023-11-16T02:29:55.613 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2023-11-16T02:29:55.613 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 17.733113155000002, 2023-11-16T02:29:55.613 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 7, 2023-11-16T02:29:55.613 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 22, 2023-11-16T02:29:55.613 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 22, 2023-11-16T02:29:55.613 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 23.965888198999998 2023-11-16T02:29:55.613 INFO:teuthology.orchestra.run.smithi028.stdout:} 2023-11-16T02:29:55.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.601+0000 7f43487dc640 1 -- 172.21.15.28:0/2289998417 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4324065a60 msgr2=0x7f4324067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:55.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.601+0000 7f43487dc640 1 --2- 172.21.15.28:0/2289998417 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4324065a60 0x7f4324067f20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f43300b2000 tx=0x7f4330008040 comp rx=0 tx=0).stop 2023-11-16T02:29:55.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.601+0000 7f43487dc640 1 -- 172.21.15.28:0/2289998417 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43400b2a00 msgr2=0x7f4340141340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:55.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.601+0000 7f43487dc640 1 --2- 172.21.15.28:0/2289998417 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43400b2a00 0x7f4340141340 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f433c00c450 tx=0x7f433c00c910 comp rx=0 tx=0).stop 2023-11-16T02:29:55.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.601+0000 7f43487dc640 1 -- 172.21.15.28:0/2289998417 shutdown_connections 2023-11-16T02:29:55.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.601+0000 7f43487dc640 1 --2- 172.21.15.28:0/2289998417 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4324065a60 0x7f4324067f20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.601+0000 7f43487dc640 1 --2- 172.21.15.28:0/2289998417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43400b6020 0x7f4340140450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.601+0000 7f43487dc640 1 --2- 172.21.15.28:0/2289998417 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f43400b38f0 0x7f434013ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.601+0000 7f43487dc640 1 --2- 172.21.15.28:0/2289998417 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f43400b2a00 0x7f4340141340 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.601+0000 7f43487dc640 1 -- 172.21.15.28:0/2289998417 >> 172.21.15.28:0/2289998417 conn(0x7f43400bc3e0 msgr2=0x7f43400bac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:55.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.601+0000 7f43487dc640 1 -- 172.21.15.28:0/2289998417 shutdown_connections 2023-11-16T02:29:55.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.601+0000 7f43487dc640 1 -- 172.21.15.28:0/2289998417 wait complete. 2023-11-16T02:29:55.619 INFO:teuthology.run_tasks:Running task kclient... 2023-11-16T02:29:55.641 INFO:tasks.kclient:Mounting kernel clients... 2023-11-16T02:29:55.642 INFO:tasks.kclient:config is {'client.0': {}} 2023-11-16T02:29:55.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:29:55.642 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list 2023-11-16T02:29:55.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:29:55.653 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link delete ceph-brx 2023-11-16T02:29:55.720 INFO:teuthology.orchestra.run.smithi204.stderr:Cannot find device "ceph-brx" 2023-11-16T02:29:55.722 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-16T02:29:55.723 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-11-16T02:29:55.723 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-16T02:29:55.723 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-16T02:29:55.723 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-16T02:29:55.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.845+0000 7f97101ea640 1 Processor -- start 2023-11-16T02:29:55.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.845+0000 7f97101ea640 1 -- start start 2023-11-16T02:29:55.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.849+0000 7f97101ea640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f97080b8240 0x7f97080bc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:55.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.849+0000 7f97101ea640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f97080b3b60 0x7f9708148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:55.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.849+0000 7f97101ea640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97080b52b0 con 0x7f9708148960 2023-11-16T02:29:55.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.849+0000 7f97101ea640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97080b6220 con 0x7f97080b3b60 2023-11-16T02:29:55.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.849+0000 7f97101ea640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97080b4040 con 0x7f97080b8240 2023-11-16T02:29:55.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.849+0000 7f970e787640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f97080b3b60 0x7f9708148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:55.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.849+0000 7f970df86640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f97080b8240 0x7f97080bc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:55.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.849+0000 7f970d785640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f9708148960 0x7f97080b3450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.28:33942/0 (socket says 172.21.15.28:33942) 2023-11-16T02:29:55.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.849+0000 7f970d785640 1 -- 172.21.15.28:0/471065403 learned_addr learned my addr 172.21.15.28:0/471065403 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:55.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.849+0000 7f970e787640 1 -- 172.21.15.28:0/471065403 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f97080b8240 msgr2=0x7f97080bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:55.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.849+0000 7f970e787640 1 --2- 172.21.15.28:0/471065403 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f97080b8240 0x7f97080bc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.849+0000 7f970e787640 1 -- 172.21.15.28:0/471065403 >> v1:172.21.15.70:6789/0 conn(0x7f9708148960 legacy=0x7f97080b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:55.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.849+0000 7f970e787640 1 -- 172.21.15.28:0/471065403 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97080b5a20 con 0x7f97080b3b60 2023-11-16T02:29:55.853 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.849+0000 7f970df86640 1 --2- 172.21.15.28:0/471065403 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f97080b8240 0x7f97080bc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-16T02:29:55.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.849+0000 7f970e787640 1 --2- 172.21.15.28:0/471065403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f97080b3b60 0x7f9708148dc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f97000097c0 tx=0x7f970001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fd8e3a411311880 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:55.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f970cf84640 1 -- 172.21.15.28:0/471065403 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97000ad660 con 0x7f97080b3b60 2023-11-16T02:29:55.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f970cf84640 1 -- 172.21.15.28:0/471065403 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97000ad7c0 con 0x7f97080b3b60 2023-11-16T02:29:55.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f970cf84640 1 -- 172.21.15.28:0/471065403 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97000adb50 con 0x7f97080b3b60 2023-11-16T02:29:55.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f97101ea640 1 -- 172.21.15.28:0/471065403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f97080b3b60 msgr2=0x7f9708148dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:55.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f97101ea640 1 --2- 172.21.15.28:0/471065403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f97080b3b60 0x7f9708148dc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f97000097c0 tx=0x7f970001c450 comp rx=0 tx=0).stop 2023-11-16T02:29:55.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f97101ea640 1 -- 172.21.15.28:0/471065403 shutdown_connections 2023-11-16T02:29:55.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f97101ea640 1 --2- 172.21.15.28:0/471065403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f97080b3b60 0x7f9708148dc0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f97101ea640 1 --2- 172.21.15.28:0/471065403 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f97080b8240 0x7f97080bc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f97101ea640 1 -- 172.21.15.28:0/471065403 >> 172.21.15.28:0/471065403 conn(0x7f97080b9050 msgr2=0x7f97080bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:55.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f97101ea640 1 -- 172.21.15.28:0/471065403 shutdown_connections 2023-11-16T02:29:55.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f97101ea640 1 -- 172.21.15.28:0/471065403 wait complete. 2023-11-16T02:29:55.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f97101ea640 1 Processor -- start 2023-11-16T02:29:55.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f97101ea640 1 -- start start 2023-11-16T02:29:55.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f97101ea640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97080b3b60 0x7f97081415c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:55.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f97101ea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f97080b8240 0x7f9708140020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:55.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f97101ea640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9708148960 0x7f9708146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:55.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f97101ea640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9708142c40 con 0x7f97080b3b60 2023-11-16T02:29:55.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f97101ea640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97081e1910 con 0x7f97080b8240 2023-11-16T02:29:55.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f97101ea640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97081e0b50 con 0x7f9708148960 2023-11-16T02:29:55.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f970df86640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97080b3b60 0x7f97081415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:55.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f970df86640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97080b3b60 0x7f97081415c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47414/0 (socket says 172.21.15.28:47414) 2023-11-16T02:29:55.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f970df86640 1 -- 172.21.15.28:0/2260645201 learned_addr learned my addr 172.21.15.28:0/2260645201 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:55.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f970d785640 1 --2- 172.21.15.28:0/2260645201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f97080b8240 0x7f9708140020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:55.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f970e787640 1 --2- 172.21.15.28:0/2260645201 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9708148960 0x7f9708146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:55.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f970df86640 1 -- 172.21.15.28:0/2260645201 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9708148960 msgr2=0x7f9708146f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:55.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f970df86640 1 --2- 172.21.15.28:0/2260645201 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9708148960 0x7f9708146f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f970df86640 1 -- 172.21.15.28:0/2260645201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f97080b8240 msgr2=0x7f9708140020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:55.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f970df86640 1 --2- 172.21.15.28:0/2260645201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f97080b8240 0x7f9708140020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:55.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f970df86640 1 -- 172.21.15.28:0/2260645201 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9704009a70 con 0x7f97080b3b60 2023-11-16T02:29:55.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f970df86640 1 --2- 172.21.15.28:0/2260645201 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97080b3b60 0x7f97081415c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f970400efc0 tx=0x7f970400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:55.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f96fe7fc640 1 -- 172.21.15.28:0/2260645201 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9704014680 con 0x7f97080b3b60 2023-11-16T02:29:55.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f96fe7fc640 1 -- 172.21.15.28:0/2260645201 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970400f040 con 0x7f97080b3b60 2023-11-16T02:29:55.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f97101ea640 1 -- 172.21.15.28:0/2260645201 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9700009420 con 0x7f97080b3b60 2023-11-16T02:29:55.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f96fe7fc640 1 -- 172.21.15.28:0/2260645201 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9704014a00 con 0x7f97080b3b60 2023-11-16T02:29:55.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.853+0000 7f97101ea640 1 -- 172.21.15.28:0/2260645201 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97081e1110 con 0x7f97080b3b60 2023-11-16T02:29:55.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.857+0000 7f97101ea640 1 -- 172.21.15.28:0/2260645201 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f970804e8a0 con 0x7f97080b3b60 2023-11-16T02:29:55.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.857+0000 7f96fe7fc640 1 -- 172.21.15.28:0/2260645201 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9704014b60 con 0x7f97080b3b60 2023-11-16T02:29:55.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.857+0000 7f96fe7fc640 1 --2- 172.21.15.28:0/2260645201 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f96ec065a60 0x7f96ec067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:55.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.857+0000 7f96fe7fc640 1 -- 172.21.15.28:0/2260645201 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9704084170 con 0x7f97080b3b60 2023-11-16T02:29:55.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.857+0000 7f970d785640 1 --2- 172.21.15.28:0/2260645201 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f96ec065a60 0x7f96ec067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:55.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.857+0000 7f970d785640 1 --2- 172.21.15.28:0/2260645201 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f96ec065a60 0x7f96ec067f20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f97081365b0 tx=0x7f96f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:55.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:55.861+0000 7f96fe7fc640 1 -- 172.21.15.28:0/2260645201 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f9704051bc0 con 0x7f97080b3b60 2023-11-16T02:29:56.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:56.053+0000 7f97101ea640 1 -- 172.21.15.28:0/2260645201 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f97080b6420 con 0x7f97080b3b60 2023-11-16T02:29:56.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:56.057+0000 7f96fe7fc640 1 -- 172.21.15.28:0/2260645201 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f97040551e0 con 0x7f97080b3b60 2023-11-16T02:29:56.059 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-16T02:29:56.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:56.057+0000 7f97101ea640 1 -- 172.21.15.28:0/2260645201 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f96ec065a60 msgr2=0x7f96ec067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:56.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:56.057+0000 7f97101ea640 1 --2- 172.21.15.28:0/2260645201 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f96ec065a60 0x7f96ec067f20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f97081365b0 tx=0x7f96f8009040 comp rx=0 tx=0).stop 2023-11-16T02:29:56.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:56.057+0000 7f97101ea640 1 -- 172.21.15.28:0/2260645201 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97080b3b60 msgr2=0x7f97081415c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:56.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:56.057+0000 7f97101ea640 1 --2- 172.21.15.28:0/2260645201 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97080b3b60 0x7f97081415c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f970400efc0 tx=0x7f970400c490 comp rx=0 tx=0).stop 2023-11-16T02:29:56.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:56.057+0000 7f97101ea640 1 -- 172.21.15.28:0/2260645201 shutdown_connections 2023-11-16T02:29:56.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:56.057+0000 7f97101ea640 1 --2- 172.21.15.28:0/2260645201 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f96ec065a60 0x7f96ec067f20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:56.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:56.057+0000 7f97101ea640 1 --2- 172.21.15.28:0/2260645201 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9708148960 0x7f9708146f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:56.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:56.057+0000 7f97101ea640 1 --2- 172.21.15.28:0/2260645201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f97080b8240 0x7f9708140020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:56.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:56.057+0000 7f97101ea640 1 --2- 172.21.15.28:0/2260645201 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97080b3b60 0x7f97081415c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:56.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:56.057+0000 7f97101ea640 1 -- 172.21.15.28:0/2260645201 >> 172.21.15.28:0/2260645201 conn(0x7f97080b9050 msgr2=0x7f97080b6640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:56.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:56.057+0000 7f97101ea640 1 -- 172.21.15.28:0/2260645201 shutdown_connections 2023-11-16T02:29:56.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:56.057+0000 7f97101ea640 1 -- 172.21.15.28:0/2260645201 wait complete. 2023-11-16T02:29:56.078 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-16T02:29:56.078 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-16T02:29:56.078 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi204.front.sepia.ceph.com 2023-11-16T02:29:56.078 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-16T02:29:56.078 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-16T02:29:56.078 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-16T02:29:56.079 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-16T02:29:56.079 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-16T02:29:56.079 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-16T02:29:56.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:29:56.079 DEBUG:teuthology.orchestra.run.smithi204:> ip addr 2023-11-16T02:29:56.089 INFO:teuthology.orchestra.run.smithi204.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-16T02:29:56.089 INFO:teuthology.orchestra.run.smithi204.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-16T02:29:56.089 INFO:teuthology.orchestra.run.smithi204.stdout: inet 127.0.0.1/8 scope host lo 2023-11-16T02:29:56.089 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-16T02:29:56.090 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 ::1/128 scope host 2023-11-16T02:29:56.090 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-16T02:29:56.090 INFO:teuthology.orchestra.run.smithi204.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-16T02:29:56.090 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:d9:36:2a brd ff:ff:ff:ff:ff:ff 2023-11-16T02:29:56.090 INFO:teuthology.orchestra.run.smithi204.stdout: altname enp7s0f0 2023-11-16T02:29:56.090 INFO:teuthology.orchestra.run.smithi204.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-16T02:29:56.090 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:d9:36:2b brd ff:ff:ff:ff:ff:ff 2023-11-16T02:29:56.091 INFO:teuthology.orchestra.run.smithi204.stdout: altname enp7s0f1 2023-11-16T02:29:56.091 INFO:teuthology.orchestra.run.smithi204.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-16T02:29:56.091 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:88:77:aa brd ff:ff:ff:ff:ff:ff 2023-11-16T02:29:56.091 INFO:teuthology.orchestra.run.smithi204.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-16T02:29:56.091 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:88:77:ab brd ff:ff:ff:ff:ff:ff 2023-11-16T02:29:56.091 INFO:teuthology.orchestra.run.smithi204.stdout: inet 172.21.15.204/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-16T02:29:56.091 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft 42368sec preferred_lft 42368sec 2023-11-16T02:29:56.092 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::ec4:7aff:fe88:77ab/64 scope link 2023-11-16T02:29:56.092 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-16T02:29:56.092 INFO:teuthology.orchestra.run.smithi204.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-16T02:29:56.092 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 02:42:cc:64:ac:d0 brd ff:ff:ff:ff:ff:ff 2023-11-16T02:29:56.092 INFO:teuthology.orchestra.run.smithi204.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-16T02:29:56.092 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-16T02:29:56.093 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-16T02:29:56.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:29:56.094 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2023-11-16T02:29:56.094 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2023-11-16T02:29:56.094 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link add name ceph-brx type bridge 2023-11-16T02:29:56.094 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip addr flush dev ceph-brx 2023-11-16T02:29:56.095 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set ceph-brx up 2023-11-16T02:29:56.095 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-16T02:29:56.095 DEBUG:teuthology.orchestra.run.smithi204:> ') 2023-11-16T02:29:56.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:29:56.213 DEBUG:teuthology.orchestra.run.smithi204:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-16T02:29:56.233 INFO:teuthology.orchestra.run.smithi204.stdout:1 2023-11-16T02:29:56.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:29:56.235 DEBUG:teuthology.orchestra.run.smithi204:> route 2023-11-16T02:29:56.312 INFO:teuthology.orchestra.run.smithi204.stdout:Kernel IP routing table 2023-11-16T02:29:56.312 INFO:teuthology.orchestra.run.smithi204.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-16T02:29:56.313 INFO:teuthology.orchestra.run.smithi204.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-16T02:29:56.313 INFO:teuthology.orchestra.run.smithi204.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-16T02:29:56.313 INFO:teuthology.orchestra.run.smithi204.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-16T02:29:56.313 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-16T02:29:56.313 INFO:teuthology.orchestra.run.smithi204.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-16T02:29:56.313 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-16T02:29:56.313 INFO:teuthology.orchestra.run.smithi204.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-16T02:29:56.313 INFO:teuthology.orchestra.run.smithi204.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-16T02:29:56.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:29:56.314 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2023-11-16T02:29:56.314 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2023-11-16T02:29:56.314 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-16T02:29:56.314 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-16T02:29:56.314 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-16T02:29:56.314 DEBUG:teuthology.orchestra.run.smithi204:> ') 2023-11-16T02:29:56.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:29:56.410 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list 2023-11-16T02:29:56.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:29:56.420 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list-id 2023-11-16T02:29:56.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:29:56.471 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2023-11-16T02:29:56.472 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2023-11-16T02:29:56.472 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-16T02:29:56.472 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-16T02:29:56.472 DEBUG:teuthology.orchestra.run.smithi204:> ') 2023-11-16T02:29:56.555 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-16T02:29:56.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:29:56.555 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2023-11-16T02:29:56.555 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2023-11-16T02:29:56.555 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-16T02:29:56.555 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-16T02:29:56.555 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-16T02:29:56.555 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-16T02:29:56.555 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-16T02:29:56.555 DEBUG:teuthology.orchestra.run.smithi204:> ') 2023-11-16T02:29:56.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:29:56.734 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2023-11-16T02:29:56.735 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2023-11-16T02:29:56.735 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set brx.0 up 2023-11-16T02:29:56.735 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set dev brx.0 master ceph-brx 2023-11-16T02:29:56.735 DEBUG:teuthology.orchestra.run.smithi204:> ') 2023-11-16T02:29:56.776 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-16T02:29:56.776 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-16T02:29:56.831 INFO:teuthology.orchestra.run.smithi204.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-16T02:29:56.831 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-16T02:29:56.831 DEBUG:teuthology.orchestra.run.smithi204:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-16T02:29:56.886 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-16T02:29:56.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:29:56.887 DEBUG:teuthology.orchestra.run.smithi204:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-16T02:29:56.996 INFO:teuthology.orchestra.run.smithi204.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-16T02:29:56.996 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-16T02:29:56.996 INFO:teuthology.orchestra.run.smithi204.stdout:invalid new device string format 2023-11-16T02:29:57.107 INFO:teuthology.orchestra.run.smithi204.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-16T02:29:57.107 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-16T02:29:57.107 INFO:teuthology.orchestra.run.smithi204.stdout:invalid new device string format 2023-11-16T02:29:57.107 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: resolved to: "172.21.15.28:3300,172.21.15.70:3300,172.21.15.70:3301" 2023-11-16T02:29:57.107 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-16T02:29:57.123 INFO:teuthology.orchestra.run.smithi204.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-16T02:29:57.124 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-16T02:29:57.124 INFO:teuthology.orchestra.run.smithi204.stdout:invalid new device string format 2023-11-16T02:29:57.124 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: resolved to: "172.21.15.28:3300,172.21.15.70:3300,172.21.15.70:3301" 2023-11-16T02:29:57.124 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-16T02:29:57.124 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: resolved to: "172.21.15.28:6789,172.21.15.70:6789,172.21.15.70:6790" 2023-11-16T02:29:57.124 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.28:6789,172.21.15.70:6789,172.21.15.70:6790:/ 2023-11-16T02:29:57.124 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=1325a234-ab9e-4632-9a6e-98afbef8ae76" will pass to kernel 2023-11-16T02:29:57.127 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-16T02:29:57.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:29:57.128 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-16T02:29:57.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:29:57.149 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-16T02:29:57.234 INFO:teuthology.orchestra.run.smithi204.stdout:client4448 2023-11-16T02:29:57.234 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-16T02:29:57.234 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-16T02:29:57.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:29:57.283 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-16T02:29:57.360 INFO:teuthology.orchestra.run.smithi204.stdout:client4448 2023-11-16T02:29:57.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:29:57.361 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-16T02:29:57.432 INFO:teuthology.orchestra.run.smithi204.stdout:client4448 2023-11-16T02:29:57.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:29:57.432 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/1325a234-ab9e-4632-9a6e-98afbef8ae76.client4448/status') 2023-11-16T02:29:57.507 INFO:teuthology.orchestra.run.smithi204.stdout:instance: client.4448 (3)172.21.15.204:0/1115708162 2023-11-16T02:29:57.507 INFO:teuthology.orchestra.run.smithi204.stdout:blocklisted: false 2023-11-16T02:29:57.507 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records in 2023-11-16T02:29:57.507 INFO:teuthology.orchestra.run.smithi204.stderr:0+1 records out 2023-11-16T02:29:57.507 INFO:teuthology.orchestra.run.smithi204.stderr:71 bytes copied, 6.3596e-05 s, 1.1 MB/s 2023-11-16T02:29:57.509 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-16T02:29:57.528 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-16T02:29:57.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.657+0000 7f7fbab80640 1 Processor -- start 2023-11-16T02:29:57.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.657+0000 7f7fbab80640 1 -- start start 2023-11-16T02:29:57.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fbab80640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7fb40b8240 0x7f7fb40bc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:57.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fbab80640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb40b52b0 con 0x7f7fb40b3b60 2023-11-16T02:29:57.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fbab80640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb40b6220 con 0x7f7fb4148960 2023-11-16T02:29:57.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fbab80640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb40b4040 con 0x7f7fb40b8240 2023-11-16T02:29:57.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb911d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f7fb40b3b60 0x7f7fb41532a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55988/0 (socket says 172.21.15.28:55988) 2023-11-16T02:29:57.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb911d640 1 -- 172.21.15.28:0/2312047063 learned_addr learned my addr 172.21.15.28:0/2312047063 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:57.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb891c640 1 --2- 172.21.15.28:0/2312047063 >> v2:172.21.15.70:3300/0 conn(0x7f7fb40b8240 0x7f7fb40bc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:57.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb37fe640 1 -- 172.21.15.28:0/2312047063 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 793160335 0 0) 0x7f7fb40b52b0 con 0x7f7fb40b3b60 2023-11-16T02:29:57.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb37fe640 1 -- 172.21.15.28:0/2312047063 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f9c003530 con 0x7f7fb40b3b60 2023-11-16T02:29:57.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb37fe640 1 -- 172.21.15.28:0/2312047063 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3578584017 0 0) 0x7f7f9c003530 con 0x7f7fb40b3b60 2023-11-16T02:29:57.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb37fe640 1 -- 172.21.15.28:0/2312047063 >> v2:172.21.15.70:3300/0 conn(0x7f7fb40b8240 msgr2=0x7f7fb40bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:57.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb37fe640 1 --2- 172.21.15.28:0/2312047063 >> v2:172.21.15.70:3300/0 conn(0x7f7fb40b8240 0x7f7fb40bc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:57.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb37fe640 1 -- 172.21.15.28:0/2312047063 >> v1:172.21.15.70:6789/0 conn(0x7f7fb4148960 legacy=0x7f7fb40b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:57.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb37fe640 1 -- 172.21.15.28:0/2312047063 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb40b5a20 con 0x7f7fb40b3b60 2023-11-16T02:29:57.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb37fe640 1 -- 172.21.15.28:0/2312047063 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7f7fac001a00 con 0x7f7fb40b3b60 2023-11-16T02:29:57.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb37fe640 1 -- 172.21.15.28:0/2312047063 >> v1:172.21.15.28:6789/0 conn(0x7f7fb40b3b60 legacy=0x7f7fb41532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:57.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb37fe640 1 --2- 172.21.15.28:0/2312047063 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f9c003980 0x7f7f9c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:57.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb37fe640 1 --2- 172.21.15.28:0/2312047063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f9c0047d0 0x7f7f9c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:57.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb37fe640 1 --2- 172.21.15.28:0/2312047063 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7f9c005190 0x7f7f9c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:57.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb37fe640 1 -- 172.21.15.28:0/2312047063 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb40b4040 con 0x7f7f9c003980 2023-11-16T02:29:57.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb37fe640 1 -- 172.21.15.28:0/2312047063 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9c00c030 con 0x7f7f9c0047d0 2023-11-16T02:29:57.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb37fe640 1 -- 172.21.15.28:0/2312047063 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9c00c1f0 con 0x7f7f9c005190 2023-11-16T02:29:57.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb891c640 1 --2- 172.21.15.28:0/2312047063 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f9c003980 0x7f7f9c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:57.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb3fff640 1 --2- 172.21.15.28:0/2312047063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f9c0047d0 0x7f7f9c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:57.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb911d640 1 --2- 172.21.15.28:0/2312047063 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7f9c005190 0x7f7f9c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:57.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb891c640 1 -- 172.21.15.28:0/2312047063 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7f9c005190 msgr2=0x7f7f9c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:57.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb891c640 1 --2- 172.21.15.28:0/2312047063 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7f9c005190 0x7f7f9c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:57.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb891c640 1 -- 172.21.15.28:0/2312047063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f9c0047d0 msgr2=0x7f7f9c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:57.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb891c640 1 --2- 172.21.15.28:0/2312047063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7f9c0047d0 0x7f7f9c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:57.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb891c640 1 -- 172.21.15.28:0/2312047063 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f9c003530 con 0x7f7f9c003980 2023-11-16T02:29:57.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.661+0000 7f7fb911d640 1 -- 172.21.15.28:0/2312047063 reap_dead start 2023-11-16T02:29:57.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fb891c640 1 --2- 172.21.15.28:0/2312047063 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f9c003980 0x7f7f9c003da0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009ae0 tx=0x7f7fa401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42364de8ed91c938 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:57.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fb37fe640 1 -- 172.21.15.28:0/2312047063 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40a6510 con 0x7f7f9c003980 2023-11-16T02:29:57.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fb37fe640 1 -- 172.21.15.28:0/2312047063 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa40a6670 con 0x7f7f9c003980 2023-11-16T02:29:57.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fb37fe640 1 -- 172.21.15.28:0/2312047063 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40a6a20 con 0x7f7f9c003980 2023-11-16T02:29:57.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fbab80640 1 -- 172.21.15.28:0/2312047063 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f9c003980 msgr2=0x7f7f9c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:57.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fbab80640 1 --2- 172.21.15.28:0/2312047063 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f9c003980 0x7f7f9c003da0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009ae0 tx=0x7f7fa401ca20 comp rx=0 tx=0).stop 2023-11-16T02:29:57.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fbab80640 1 -- 172.21.15.28:0/2312047063 shutdown_connections 2023-11-16T02:29:57.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fbab80640 1 --2- 172.21.15.28:0/2312047063 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f9c003980 0x7f7f9c003da0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:57.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fbab80640 1 -- 172.21.15.28:0/2312047063 >> 172.21.15.28:0/2312047063 conn(0x7f7fb40b9050 msgr2=0x7f7fb40bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:57.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fbab80640 1 -- 172.21.15.28:0/2312047063 shutdown_connections 2023-11-16T02:29:57.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fbab80640 1 -- 172.21.15.28:0/2312047063 wait complete. 2023-11-16T02:29:57.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fbab80640 1 Processor -- start 2023-11-16T02:29:57.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fbab80640 1 -- start start 2023-11-16T02:29:57.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fbab80640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f9c003980 0x7f7fb4149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:57.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fbab80640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fb40ba7c0 0x7f7fb414ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:57.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fbab80640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7fb41e1530 0x7f7fb413a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:57.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fbab80640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb414a280 con 0x7f7f9c003980 2023-11-16T02:29:57.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fbab80640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb413add0 con 0x7f7fb40ba7c0 2023-11-16T02:29:57.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fbab80640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb414b280 con 0x7f7fb41e1530 2023-11-16T02:29:57.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fb891c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f9c003980 0x7f7fb4149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:57.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fb891c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f9c003980 0x7f7fb4149d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47426/0 (socket says 172.21.15.28:47426) 2023-11-16T02:29:57.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fb891c640 1 -- 172.21.15.28:0/1419465127 learned_addr learned my addr 172.21.15.28:0/1419465127 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:57.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fb911d640 1 --2- 172.21.15.28:0/1419465127 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7fb41e1530 0x7f7fb413a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:57.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fb891c640 1 -- 172.21.15.28:0/1419465127 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7fb41e1530 msgr2=0x7f7fb413a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:57.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fb891c640 1 --2- 172.21.15.28:0/1419465127 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7fb41e1530 0x7f7fb413a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:57.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fb891c640 1 -- 172.21.15.28:0/1419465127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fb40ba7c0 msgr2=0x7f7fb414ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:57.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fb891c640 1 --2- 172.21.15.28:0/1419465127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fb40ba7c0 0x7f7fb414ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:57.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fb891c640 1 -- 172.21.15.28:0/1419465127 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb413afe0 con 0x7f7f9c003980 2023-11-16T02:29:57.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fb911d640 1 --2- 172.21.15.28:0/1419465127 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7fb41e1530 0x7f7fb413a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:57.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fb891c640 1 --2- 172.21.15.28:0/1419465127 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f9c003980 0x7f7fb4149d40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40b0040 tx=0x7f7fa40197c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:57.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fb17fa640 1 -- 172.21.15.28:0/1419465127 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40a67e0 con 0x7f7f9c003980 2023-11-16T02:29:57.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fb17fa640 1 -- 172.21.15.28:0/1419465127 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa40a6940 con 0x7f7f9c003980 2023-11-16T02:29:57.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fbab80640 1 -- 172.21.15.28:0/1419465127 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb40ba2e0 con 0x7f7f9c003980 2023-11-16T02:29:57.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.665+0000 7f7fb17fa640 1 -- 172.21.15.28:0/1419465127 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa40a6cb0 con 0x7f7f9c003980 2023-11-16T02:29:57.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.669+0000 7f7fbab80640 1 -- 172.21.15.28:0/1419465127 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb40bbc00 con 0x7f7f9c003980 2023-11-16T02:29:57.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.669+0000 7f7fbab80640 1 -- 172.21.15.28:0/1419465127 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb40bb780 con 0x7f7f9c003980 2023-11-16T02:29:57.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.669+0000 7f7fb17fa640 1 -- 172.21.15.28:0/1419465127 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7fa4006040 con 0x7f7f9c003980 2023-11-16T02:29:57.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.669+0000 7f7fb17fa640 1 --2- 172.21.15.28:0/1419465127 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f7fa0065a60 0x7f7fa0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:57.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.669+0000 7f7fb17fa640 1 -- 172.21.15.28:0/1419465127 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fa40aa070 con 0x7f7f9c003980 2023-11-16T02:29:57.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.669+0000 7f7fb3fff640 1 --2- 172.21.15.28:0/1419465127 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f7fa0065a60 0x7f7fa0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:57.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.669+0000 7f7fb3fff640 1 --2- 172.21.15.28:0/1419465127 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f7fa0065a60 0x7f7fa0067f20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8007ab0 tx=0x7f7fa8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:57.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.673+0000 7f7fb17fa640 1 -- 172.21.15.28:0/1419465127 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f7fa40ebd00 con 0x7f7f9c003980 2023-11-16T02:29:57.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.829+0000 7f7fbab80640 1 -- 172.21.15.28:0/1419465127 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fb40bb780 con 0x7f7f9c003980 2023-11-16T02:29:57.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.833+0000 7f7fb17fa640 1 -- 172.21.15.28:0/1419465127 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f7fb40bb780 con 0x7f7f9c003980 2023-11-16T02:29:57.837 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:57.837 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":22,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","created":"2023-11-16T02:29:13.710567+0000","modified":"2023-11-16T02:29:38.871066+0000","last_up_change":"2023-11-16T02:29:24.841087+0000","last_in_change":"2023-11-16T02:29:16.024490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-16T02:29:26.490910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-16T02:29:36.133224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-16T02:29:36.866156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dfa8b58d-3481-4e68-86e8-21873d31d0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":38722},{"type":"v1","addr":"172.21.15.28:6809","nonce":38722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":38722},{"type":"v1","addr":"172.21.15.28:6811","nonce":38722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":38722},{"type":"v1","addr":"172.21.15.28:6815","nonce":38722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":38722},{"type":"v1","addr":"172.21.15.28:6813","nonce":38722}]},"public_addr":"172.21.15.28:6809/38722","cluster_addr":"172.21.15.28:6811/38722","heartbeat_back_addr":"172.21.15.28:6815/38722","heartbeat_front_addr":"172.21.15.28:6813/38722","state":["exists","up"]},{"osd":1,"uuid":"1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":38724},{"type":"v1","addr":"172.21.15.28:6824","nonce":38724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":38724},{"type":"v1","addr":"172.21.15.28:6827","nonce":38724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":38724},{"type":"v1","addr":"172.21.15.28:6831","nonce":38724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":38724},{"type":"v1","addr":"172.21.15.28:6829","nonce":38724}]},"public_addr":"172.21.15.28:6824/38724","cluster_addr":"172.21.15.28:6827/38724","heartbeat_back_addr":"172.21.15.28:6831/38724","heartbeat_front_addr":"172.21.15.28:6829/38724","state":["exists","up"]},{"osd":2,"uuid":"e18f39cd-6a35-4d36-9eed-3877794bf2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":38723},{"type":"v1","addr":"172.21.15.28:6801","nonce":38723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":38723},{"type":"v1","addr":"172.21.15.28:6803","nonce":38723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":38723},{"type":"v1","addr":"172.21.15.28:6807","nonce":38723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":38723},{"type":"v1","addr":"172.21.15.28:6805","nonce":38723}]},"public_addr":"172.21.15.28:6801/38723","cluster_addr":"172.21.15.28:6803/38723","heartbeat_back_addr":"172.21.15.28:6807/38723","heartbeat_front_addr":"172.21.15.28:6805/38723","state":["exists","up"]},{"osd":3,"uuid":"303d0728-409d-47d7-b7a6-6eb273f602fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":38725},{"type":"v1","addr":"172.21.15.28:6817","nonce":38725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":38725},{"type":"v1","addr":"172.21.15.28:6819","nonce":38725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":38725},{"type":"v1","addr":"172.21.15.28:6825","nonce":38725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":38725},{"type":"v1","addr":"172.21.15.28:6821","nonce":38725}]},"public_addr":"172.21.15.28:6817/38725","cluster_addr":"172.21.15.28:6819/38725","heartbeat_back_addr":"172.21.15.28:6825/38725","heartbeat_front_addr":"172.21.15.28:6821/38725","state":["exists","up"]},{"osd":4,"uuid":"df0bf0ac-6efe-4964-ad27-7c1771a70c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":38828},{"type":"v1","addr":"172.21.15.70:6801","nonce":38828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":38828},{"type":"v1","addr":"172.21.15.70:6803","nonce":38828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":38828},{"type":"v1","addr":"172.21.15.70:6807","nonce":38828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":38828},{"type":"v1","addr":"172.21.15.70:6805","nonce":38828}]},"public_addr":"172.21.15.70:6801/38828","cluster_addr":"172.21.15.70:6803/38828","heartbeat_back_addr":"172.21.15.70:6807/38828","heartbeat_front_addr":"172.21.15.70:6805/38828","state":["exists","up"]},{"osd":5,"uuid":"84921219-65cb-4c4e-b9ed-a773db639034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":38830},{"type":"v1","addr":"172.21.15.70:6810","nonce":38830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6813","nonce":38830},{"type":"v1","addr":"172.21.15.70:6814","nonce":38830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":38830},{"type":"v1","addr":"172.21.15.70:6824","nonce":38830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":38830},{"type":"v1","addr":"172.21.15.70:6819","nonce":38830}]},"public_addr":"172.21.15.70:6810/38830","cluster_addr":"172.21.15.70:6814/38830","heartbeat_back_addr":"172.21.15.70:6824/38830","heartbeat_front_addr":"172.21.15.70:6819/38830","state":["exists","up"]},{"osd":6,"uuid":"c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":38829},{"type":"v1","addr":"172.21.15.70:6812","nonce":38829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":38829},{"type":"v1","addr":"172.21.15.70:6820","nonce":38829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":38829},{"type":"v1","addr":"172.21.15.70:6828","nonce":38829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":38829},{"type":"v1","addr":"172.21.15.70:6825","nonce":38829}]},"public_addr":"172.21.15.70:6812/38829","cluster_addr":"172.21.15.70:6820/38829","heartbeat_back_addr":"172.21.15.70:6828/38829","heartbeat_front_addr":"172.21.15.70:6825/38829","state":["exists","up"]},{"osd":7,"uuid":"e2cdd418-12ce-4eea-9b22-efdad83eb76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":38839},{"type":"v1","addr":"172.21.15.70:6815","nonce":38839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":38839},{"type":"v1","addr":"172.21.15.70:6823","nonce":38839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":38839},{"type":"v1","addr":"172.21.15.70:6831","nonce":38839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6827","nonce":38839},{"type":"v1","addr":"172.21.15.70:6829","nonce":38839}]},"public_addr":"172.21.15.70:6815/38839","cluster_addr":"172.21.15.70:6823/38839","heartbeat_back_addr":"172.21.15.70:6831/38839","heartbeat_front_addr":"172.21.15.70:6829/38839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.544240+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.637637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.352115+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.652916+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.624477+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.570247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.706468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.696574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-16T02:29:57.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.837+0000 7f7fbab80640 1 -- 172.21.15.28:0/1419465127 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f7fa0065a60 msgr2=0x7f7fa0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:57.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.837+0000 7f7fbab80640 1 --2- 172.21.15.28:0/1419465127 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f7fa0065a60 0x7f7fa0067f20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8007ab0 tx=0x7f7fa8009040 comp rx=0 tx=0).stop 2023-11-16T02:29:57.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.837+0000 7f7fbab80640 1 -- 172.21.15.28:0/1419465127 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f9c003980 msgr2=0x7f7fb4149d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:57.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.837+0000 7f7fbab80640 1 --2- 172.21.15.28:0/1419465127 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f9c003980 0x7f7fb4149d40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40b0040 tx=0x7f7fa40197c0 comp rx=0 tx=0).stop 2023-11-16T02:29:57.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.837+0000 7f7fbab80640 1 -- 172.21.15.28:0/1419465127 shutdown_connections 2023-11-16T02:29:57.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.837+0000 7f7fbab80640 1 --2- 172.21.15.28:0/1419465127 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f7fa0065a60 0x7f7fa0067f20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:57.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.837+0000 7f7fbab80640 1 --2- 172.21.15.28:0/1419465127 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7fb41e1530 0x7f7fb413a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:57.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.837+0000 7f7fbab80640 1 --2- 172.21.15.28:0/1419465127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7fb40ba7c0 0x7f7fb414ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:57.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.837+0000 7f7fbab80640 1 --2- 172.21.15.28:0/1419465127 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f9c003980 0x7f7fb4149d40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:57.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.837+0000 7f7fbab80640 1 -- 172.21.15.28:0/1419465127 >> 172.21.15.28:0/1419465127 conn(0x7f7fb40b9050 msgr2=0x7f7fb413ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:57.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.837+0000 7f7fbab80640 1 -- 172.21.15.28:0/1419465127 shutdown_connections 2023-11-16T02:29:57.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.837+0000 7f7fbab80640 1 -- 172.21.15.28:0/1419465127 wait complete. 2023-11-16T02:29:57.857 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-16T02:29:26.490910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-16T02:29:36.133224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-16T02:29:36.866156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-16T02:29:57.858 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-16T02:29:57.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.981+0000 7f2b2d69a640 1 Processor -- start 2023-11-16T02:29:57.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.981+0000 7f2b2d69a640 1 -- start start 2023-11-16T02:29:57.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.981+0000 7f2b2d69a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2b2806f510 0x7f2b2806a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:57.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.981+0000 7f2b2d69a640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2b2814a700 0x7f2b2814ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:57.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.981+0000 7f2b2d69a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f2b280b7b60 0x7f2b280b7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:57.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.981+0000 7f2b2d69a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b280b8530 con 0x7f2b2806f510 2023-11-16T02:29:57.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.981+0000 7f2b2d69a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b2806f8f0 con 0x7f2b280b7b60 2023-11-16T02:29:57.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.981+0000 7f2b2d69a640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b280b5cd0 con 0x7f2b2814a700 2023-11-16T02:29:57.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.981+0000 7f2b26ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2b2806f510 0x7f2b2806a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:57.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.981+0000 7f2b26ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2b2806f510 0x7f2b2806a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47440/0 (socket says 172.21.15.28:47440) 2023-11-16T02:29:57.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.981+0000 7f2b26ffd640 1 -- 172.21.15.28:0/3661932366 learned_addr learned my addr 172.21.15.28:0/3661932366 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:57.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.981+0000 7f2b267fc640 1 --2- 172.21.15.28:0/3661932366 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2b2814a700 0x7f2b2814ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:57.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.981+0000 7f2b277fe640 1 --2- 172.21.15.28:0/3661932366 >> v2:172.21.15.70:3300/0 conn(0x7f2b280b7b60 0x7f2b280b7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:57.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.981+0000 7f2b26ffd640 1 -- 172.21.15.28:0/3661932366 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2b2814a700 msgr2=0x7f2b2814ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:57.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.981+0000 7f2b26ffd640 1 --2- 172.21.15.28:0/3661932366 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2b2814a700 0x7f2b2814ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:57.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.981+0000 7f2b26ffd640 1 -- 172.21.15.28:0/3661932366 >> v2:172.21.15.70:3300/0 conn(0x7f2b280b7b60 msgr2=0x7f2b280b7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:57.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.981+0000 7f2b26ffd640 1 --2- 172.21.15.28:0/3661932366 >> v2:172.21.15.70:3300/0 conn(0x7f2b280b7b60 0x7f2b280b7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:57.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.981+0000 7f2b26ffd640 1 -- 172.21.15.28:0/3661932366 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2806f170 con 0x7f2b2806f510 2023-11-16T02:29:57.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.985+0000 7f2b26ffd640 1 --2- 172.21.15.28:0/3661932366 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2b2806f510 0x7f2b2806a170 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2b2806acf0 tx=0x7f2b2001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2146a304c40fbe9 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:57.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.985+0000 7f2b25ffb640 1 -- 172.21.15.28:0/3661932366 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b200af400 con 0x7f2b2806f510 2023-11-16T02:29:57.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.985+0000 7f2b25ffb640 1 -- 172.21.15.28:0/3661932366 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b200ab050 con 0x7f2b2806f510 2023-11-16T02:29:57.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.985+0000 7f2b25ffb640 1 -- 172.21.15.28:0/3661932366 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b200af780 con 0x7f2b2806f510 2023-11-16T02:29:57.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.985+0000 7f2b2d69a640 1 -- 172.21.15.28:0/3661932366 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2b2806f510 msgr2=0x7f2b2806a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:57.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.985+0000 7f2b2d69a640 1 --2- 172.21.15.28:0/3661932366 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2b2806f510 0x7f2b2806a170 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2b2806acf0 tx=0x7f2b2001f1c0 comp rx=0 tx=0).stop 2023-11-16T02:29:57.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.985+0000 7f2b2d69a640 1 -- 172.21.15.28:0/3661932366 shutdown_connections 2023-11-16T02:29:57.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.985+0000 7f2b2d69a640 1 --2- 172.21.15.28:0/3661932366 >> v2:172.21.15.70:3300/0 conn(0x7f2b280b7b60 0x7f2b280b7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:57.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.985+0000 7f2b2d69a640 1 --2- 172.21.15.28:0/3661932366 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2b2814a700 0x7f2b2814ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:57.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.985+0000 7f2b2d69a640 1 --2- 172.21.15.28:0/3661932366 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2b2806f510 0x7f2b2806a170 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:57.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.985+0000 7f2b2d69a640 1 -- 172.21.15.28:0/3661932366 >> 172.21.15.28:0/3661932366 conn(0x7f2b280bc5a0 msgr2=0x7f2b280bc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:57.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.985+0000 7f2b2d69a640 1 -- 172.21.15.28:0/3661932366 shutdown_connections 2023-11-16T02:29:57.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.985+0000 7f2b2d69a640 1 -- 172.21.15.28:0/3661932366 wait complete. 2023-11-16T02:29:57.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.985+0000 7f2b2d69a640 1 Processor -- start 2023-11-16T02:29:57.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.985+0000 7f2b2d69a640 1 -- start start 2023-11-16T02:29:57.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.985+0000 7f2b2d69a640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2b2806f510 0x7f2b28148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:57.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.985+0000 7f2b2d69a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b280b7b60 0x7f2b281dfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:57.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.985+0000 7f2b2d69a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2b2814a700 0x7f2b280b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:57.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.985+0000 7f2b2d69a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b28149480 con 0x7f2b2814a700 2023-11-16T02:29:57.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.985+0000 7f2b2d69a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b28138e30 con 0x7f2b280b7b60 2023-11-16T02:29:57.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.985+0000 7f2b2d69a640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b28141de0 con 0x7f2b2806f510 2023-11-16T02:29:57.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.985+0000 7f2b277fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2b2814a700 0x7f2b280b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:57.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.985+0000 7f2b277fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2b2814a700 0x7f2b280b1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47450/0 (socket says 172.21.15.28:47450) 2023-11-16T02:29:57.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.985+0000 7f2b277fe640 1 -- 172.21.15.28:0/2578239832 learned_addr learned my addr 172.21.15.28:0/2578239832 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:57.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.985+0000 7f2b267fc640 1 --2- 172.21.15.28:0/2578239832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b280b7b60 0x7f2b281dfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:57.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.985+0000 7f2b26ffd640 1 --2- 172.21.15.28:0/2578239832 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2b2806f510 0x7f2b28148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:57.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.989+0000 7f2b277fe640 1 -- 172.21.15.28:0/2578239832 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2b2806f510 msgr2=0x7f2b28148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:57.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.989+0000 7f2b277fe640 1 --2- 172.21.15.28:0/2578239832 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2b2806f510 0x7f2b28148f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:57.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.989+0000 7f2b277fe640 1 -- 172.21.15.28:0/2578239832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b280b7b60 msgr2=0x7f2b281dfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:57.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.989+0000 7f2b277fe640 1 --2- 172.21.15.28:0/2578239832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b280b7b60 0x7f2b281dfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:57.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.989+0000 7f2b277fe640 1 -- 172.21.15.28:0/2578239832 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b20009b30 con 0x7f2b2814a700 2023-11-16T02:29:57.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.989+0000 7f2b267fc640 1 --2- 172.21.15.28:0/2578239832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b280b7b60 0x7f2b281dfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:57.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.989+0000 7f2b277fe640 1 --2- 172.21.15.28:0/2578239832 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2b2814a700 0x7f2b280b1b60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2b1800d830 tx=0x7f2b1800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:57.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.989+0000 7f2b1f7fe640 1 -- 172.21.15.28:0/2578239832 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b180096c0 con 0x7f2b2814a700 2023-11-16T02:29:57.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.989+0000 7f2b1f7fe640 1 -- 172.21.15.28:0/2578239832 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b18009820 con 0x7f2b2814a700 2023-11-16T02:29:57.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.989+0000 7f2b2d69a640 1 -- 172.21.15.28:0/2578239832 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b280b4500 con 0x7f2b2814a700 2023-11-16T02:29:57.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.989+0000 7f2b1f7fe640 1 -- 172.21.15.28:0/2578239832 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b18009bd0 con 0x7f2b2814a700 2023-11-16T02:29:57.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.989+0000 7f2b2d69a640 1 -- 172.21.15.28:0/2578239832 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b2813d9a0 con 0x7f2b2814a700 2023-11-16T02:29:57.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.989+0000 7f2b2d69a640 1 -- 172.21.15.28:0/2578239832 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b2804e8a0 con 0x7f2b2814a700 2023-11-16T02:29:57.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.989+0000 7f2b1f7fe640 1 -- 172.21.15.28:0/2578239832 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2b18014410 con 0x7f2b2814a700 2023-11-16T02:29:57.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.989+0000 7f2b1f7fe640 1 --2- 172.21.15.28:0/2578239832 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2b08065a90 0x7f2b08067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:57.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.989+0000 7f2b1f7fe640 1 -- 172.21.15.28:0/2578239832 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b180839c0 con 0x7f2b2814a700 2023-11-16T02:29:57.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.989+0000 7f2b26ffd640 1 --2- 172.21.15.28:0/2578239832 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2b08065a90 0x7f2b08067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:57.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.989+0000 7f2b26ffd640 1 --2- 172.21.15.28:0/2578239832 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2b08065a90 0x7f2b08067f50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2b200b1000 tx=0x7f2b200aa000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:57.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:57.993+0000 7f2b1f7fe640 1 -- 172.21.15.28:0/2578239832 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f2b18051410 con 0x7f2b2814a700 2023-11-16T02:29:58.153 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.149+0000 7f2b2d69a640 1 -- 172.21.15.28:0/2578239832 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2b28071490 con 0x7f2b2814a700 2023-11-16T02:29:58.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.149+0000 7f2b1f7fe640 1 -- 172.21.15.28:0/2578239832 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2b1800b3c0 con 0x7f2b2814a700 2023-11-16T02:29:58.154 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-11-16T02:29:58.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.153+0000 7f2b2d69a640 1 -- 172.21.15.28:0/2578239832 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2b08065a90 msgr2=0x7f2b08067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:58.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.153+0000 7f2b2d69a640 1 --2- 172.21.15.28:0/2578239832 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2b08065a90 0x7f2b08067f50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2b200b1000 tx=0x7f2b200aa000 comp rx=0 tx=0).stop 2023-11-16T02:29:58.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.153+0000 7f2b2d69a640 1 -- 172.21.15.28:0/2578239832 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2b2814a700 msgr2=0x7f2b280b1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:58.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.153+0000 7f2b2d69a640 1 --2- 172.21.15.28:0/2578239832 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2b2814a700 0x7f2b280b1b60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2b1800d830 tx=0x7f2b1800dcf0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.153+0000 7f2b2d69a640 1 -- 172.21.15.28:0/2578239832 shutdown_connections 2023-11-16T02:29:58.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.153+0000 7f2b2d69a640 1 --2- 172.21.15.28:0/2578239832 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2b08065a90 0x7f2b08067f50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.153+0000 7f2b2d69a640 1 --2- 172.21.15.28:0/2578239832 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2b2814a700 0x7f2b280b1b60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.153+0000 7f2b2d69a640 1 --2- 172.21.15.28:0/2578239832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b280b7b60 0x7f2b281dfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.153+0000 7f2b2d69a640 1 --2- 172.21.15.28:0/2578239832 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f2b2806f510 0x7f2b28148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.153+0000 7f2b2d69a640 1 -- 172.21.15.28:0/2578239832 >> 172.21.15.28:0/2578239832 conn(0x7f2b280bc5a0 msgr2=0x7f2b2806a140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:58.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.153+0000 7f2b2d69a640 1 -- 172.21.15.28:0/2578239832 shutdown_connections 2023-11-16T02:29:58.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.153+0000 7f2b2d69a640 1 -- 172.21.15.28:0/2578239832 wait complete. 2023-11-16T02:29:58.174 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-16T02:29:58.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.293+0000 7ff576d39640 1 Processor -- start 2023-11-16T02:29:58.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.293+0000 7ff576d39640 1 -- start start 2023-11-16T02:29:58.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff576d39640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff57006a170 0x7ff5700b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:58.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff576d39640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7ff57006a550 0x7ff570148a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:58.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff576d39640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff570071800 con 0x7ff570148fa0 2023-11-16T02:29:58.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff576d39640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5700b5ec0 con 0x7ff57006a550 2023-11-16T02:29:58.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff576d39640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5700b6350 con 0x7ff57006a170 2023-11-16T02:29:58.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff5752d6640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff570148fa0 0x7ff5700b7c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:56002/0 (socket says 172.21.15.28:56002) 2023-11-16T02:29:58.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff5752d6640 1 -- 172.21.15.28:0/3224282474 learned_addr learned my addr 172.21.15.28:0/3224282474 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:58.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff574ad5640 1 --2- 172.21.15.28:0/3224282474 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff57006a170 0x7ff5700b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:58.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff56ffff640 1 --2- 172.21.15.28:0/3224282474 >> v2:172.21.15.70:3300/0 conn(0x7ff57006a550 0x7ff570148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:58.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff56f7fe640 1 -- 172.21.15.28:0/3224282474 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584284839 0 0) 0x7ff5680014a0 con 0x7ff570148fa0 2023-11-16T02:29:58.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff56f7fe640 1 -- 172.21.15.28:0/3224282474 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff558003530 con 0x7ff570148fa0 2023-11-16T02:29:58.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff56f7fe640 1 -- 172.21.15.28:0/3224282474 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2820517294 0 0) 0x7ff558003530 con 0x7ff570148fa0 2023-11-16T02:29:58.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff56f7fe640 1 -- 172.21.15.28:0/3224282474 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff57006a170 msgr2=0x7ff5700b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:58.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff56f7fe640 1 --2- 172.21.15.28:0/3224282474 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff57006a170 0x7ff5700b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff56f7fe640 1 -- 172.21.15.28:0/3224282474 >> v2:172.21.15.70:3300/0 conn(0x7ff57006a550 msgr2=0x7ff570148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:58.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff56f7fe640 1 --2- 172.21.15.28:0/3224282474 >> v2:172.21.15.70:3300/0 conn(0x7ff57006a550 0x7ff570148a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff56f7fe640 1 -- 172.21.15.28:0/3224282474 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5700b5870 con 0x7ff570148fa0 2023-11-16T02:29:58.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff56f7fe640 1 -- 172.21.15.28:0/3224282474 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7ff568001b90 con 0x7ff570148fa0 2023-11-16T02:29:58.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff56f7fe640 1 -- 172.21.15.28:0/3224282474 >> v1:172.21.15.28:6789/0 conn(0x7ff570148fa0 legacy=0x7ff5700b7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:58.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff56f7fe640 1 --2- 172.21.15.28:0/3224282474 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff558003980 0x7ff558003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:58.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff56f7fe640 1 --2- 172.21.15.28:0/3224282474 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff57006a170 0x7ff5580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:58.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff56f7fe640 1 --2- 172.21.15.28:0/3224282474 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff558004d10 0x7ff558005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:58.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff56f7fe640 1 -- 172.21.15.28:0/3224282474 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5700b5ec0 con 0x7ff558003980 2023-11-16T02:29:58.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff56f7fe640 1 -- 172.21.15.28:0/3224282474 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5700b6350 con 0x7ff558004d10 2023-11-16T02:29:58.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff56f7fe640 1 -- 172.21.15.28:0/3224282474 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55800b990 con 0x7ff57006a170 2023-11-16T02:29:58.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff574ad5640 1 --2- 172.21.15.28:0/3224282474 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff558003980 0x7ff558003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:58.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff5752d6640 1 --2- 172.21.15.28:0/3224282474 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff558004d10 0x7ff558005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:58.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff56ffff640 1 --2- 172.21.15.28:0/3224282474 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff57006a170 0x7ff5580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:58.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff574ad5640 1 -- 172.21.15.28:0/3224282474 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff57006a170 msgr2=0x7ff5580047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:58.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff574ad5640 1 --2- 172.21.15.28:0/3224282474 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff57006a170 0x7ff5580047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff574ad5640 1 -- 172.21.15.28:0/3224282474 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff558004d10 msgr2=0x7ff558005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:58.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff574ad5640 1 --2- 172.21.15.28:0/3224282474 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff558004d10 0x7ff558005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff574ad5640 1 -- 172.21.15.28:0/3224282474 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff558003530 con 0x7ff558003980 2023-11-16T02:29:58.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff574ad5640 1 --2- 172.21.15.28:0/3224282474 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff558003980 0x7ff558003da0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff560009ae0 tx=0x7ff56001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5176d82fdcfc6809 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:58.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff56f7fe640 1 -- 172.21.15.28:0/3224282474 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5600a5530 con 0x7ff558003980 2023-11-16T02:29:58.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff56f7fe640 1 -- 172.21.15.28:0/3224282474 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5600a5690 con 0x7ff558003980 2023-11-16T02:29:58.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.297+0000 7ff56f7fe640 1 -- 172.21.15.28:0/3224282474 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5600a5a40 con 0x7ff558003980 2023-11-16T02:29:58.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff576d39640 1 -- 172.21.15.28:0/3224282474 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff558003980 msgr2=0x7ff558003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:58.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff576d39640 1 --2- 172.21.15.28:0/3224282474 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff558003980 0x7ff558003da0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff560009ae0 tx=0x7ff56001ca50 comp rx=0 tx=0).stop 2023-11-16T02:29:58.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff5752d6640 1 -- 172.21.15.28:0/3224282474 reap_dead start 2023-11-16T02:29:58.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff576d39640 1 -- 172.21.15.28:0/3224282474 shutdown_connections 2023-11-16T02:29:58.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff576d39640 1 -- 172.21.15.28:0/3224282474 >> 172.21.15.28:0/3224282474 conn(0x7ff5700bc5a0 msgr2=0x7ff5700bc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:58.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff576d39640 1 -- 172.21.15.28:0/3224282474 shutdown_connections 2023-11-16T02:29:58.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff576d39640 1 -- 172.21.15.28:0/3224282474 wait complete. 2023-11-16T02:29:58.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff576d39640 1 Processor -- start 2023-11-16T02:29:58.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff576d39640 1 -- start start 2023-11-16T02:29:58.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff576d39640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff558003980 0x7ff5701e1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:58.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff576d39640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff570138920 0x7ff57013b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:58.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff576d39640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff5701e4000 0x7ff5701e4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:58.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff576d39640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57013ad40 con 0x7ff570138920 2023-11-16T02:29:58.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff576d39640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5701e0e70 con 0x7ff558003980 2023-11-16T02:29:58.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff576d39640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff570139b60 con 0x7ff5701e4000 2023-11-16T02:29:58.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff56ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff570138920 0x7ff57013b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:58.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff56ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff570138920 0x7ff57013b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47472/0 (socket says 172.21.15.28:47472) 2023-11-16T02:29:58.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff56ffff640 1 -- 172.21.15.28:0/602345575 learned_addr learned my addr 172.21.15.28:0/602345575 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:58.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff574ad5640 1 --2- 172.21.15.28:0/602345575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff558003980 0x7ff5701e1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:58.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff5752d6640 1 --2- 172.21.15.28:0/602345575 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff5701e4000 0x7ff5701e4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:58.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff56ffff640 1 -- 172.21.15.28:0/602345575 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff5701e4000 msgr2=0x7ff5701e4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:58.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff56ffff640 1 --2- 172.21.15.28:0/602345575 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff5701e4000 0x7ff5701e4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff56ffff640 1 -- 172.21.15.28:0/602345575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff558003980 msgr2=0x7ff5701e1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:58.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff56ffff640 1 --2- 172.21.15.28:0/602345575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff558003980 0x7ff5701e1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff56ffff640 1 -- 172.21.15.28:0/602345575 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff570139e00 con 0x7ff570138920 2023-11-16T02:29:58.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff5752d6640 1 --2- 172.21.15.28:0/602345575 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff5701e4000 0x7ff5701e4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:58.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff56ffff640 1 --2- 172.21.15.28:0/602345575 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff570138920 0x7ff57013b180 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff564011690 tx=0x7ff564011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:58.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff56d7fa640 1 -- 172.21.15.28:0/602345575 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56400f960 con 0x7ff570138920 2023-11-16T02:29:58.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff56d7fa640 1 -- 172.21.15.28:0/602345575 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56400fac0 con 0x7ff570138920 2023-11-16T02:29:58.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff576d39640 1 -- 172.21.15.28:0/602345575 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff57014f7c0 con 0x7ff570138920 2023-11-16T02:29:58.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff56d7fa640 1 -- 172.21.15.28:0/602345575 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56400fe30 con 0x7ff570138920 2023-11-16T02:29:58.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.301+0000 7ff576d39640 1 -- 172.21.15.28:0/602345575 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5701e0ab0 con 0x7ff570138920 2023-11-16T02:29:58.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.305+0000 7ff576d39640 1 -- 172.21.15.28:0/602345575 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff57004e8a0 con 0x7ff570138920 2023-11-16T02:29:58.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.305+0000 7ff56d7fa640 1 -- 172.21.15.28:0/602345575 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff564015460 con 0x7ff570138920 2023-11-16T02:29:58.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.305+0000 7ff56d7fa640 1 --2- 172.21.15.28:0/602345575 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff55c065a60 0x7ff55c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:58.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.305+0000 7ff56d7fa640 1 -- 172.21.15.28:0/602345575 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff564083920 con 0x7ff570138920 2023-11-16T02:29:58.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.305+0000 7ff574ad5640 1 --2- 172.21.15.28:0/602345575 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff55c065a60 0x7ff55c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:58.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.305+0000 7ff574ad5640 1 --2- 172.21.15.28:0/602345575 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff55c065a60 0x7ff55c067f20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff5600af000 tx=0x7ff5600046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:58.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.309+0000 7ff56d7fa640 1 -- 172.21.15.28:0/602345575 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7ff564051370 con 0x7ff570138920 2023-11-16T02:29:58.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.465+0000 7ff576d39640 1 -- 172.21.15.28:0/602345575 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff57014ce90 con 0x7ff570138920 2023-11-16T02:29:58.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.465+0000 7ff56d7fa640 1 -- 172.21.15.28:0/602345575 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff564054990 con 0x7ff570138920 2023-11-16T02:29:58.469 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-11-16T02:29:58.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.469+0000 7ff576d39640 1 -- 172.21.15.28:0/602345575 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff55c065a60 msgr2=0x7ff55c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:58.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.469+0000 7ff576d39640 1 --2- 172.21.15.28:0/602345575 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff55c065a60 0x7ff55c067f20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff5600af000 tx=0x7ff5600046d0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.469+0000 7ff576d39640 1 -- 172.21.15.28:0/602345575 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff570138920 msgr2=0x7ff57013b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:58.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.469+0000 7ff576d39640 1 --2- 172.21.15.28:0/602345575 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff570138920 0x7ff57013b180 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff564011690 tx=0x7ff564011b50 comp rx=0 tx=0).stop 2023-11-16T02:29:58.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.469+0000 7ff576d39640 1 -- 172.21.15.28:0/602345575 shutdown_connections 2023-11-16T02:29:58.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.469+0000 7ff576d39640 1 --2- 172.21.15.28:0/602345575 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff55c065a60 0x7ff55c067f20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.469+0000 7ff576d39640 1 --2- 172.21.15.28:0/602345575 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff5701e4000 0x7ff5701e4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.469+0000 7ff576d39640 1 --2- 172.21.15.28:0/602345575 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff570138920 0x7ff57013b180 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.469+0000 7ff576d39640 1 --2- 172.21.15.28:0/602345575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff558003980 0x7ff5701e1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.469+0000 7ff576d39640 1 -- 172.21.15.28:0/602345575 >> 172.21.15.28:0/602345575 conn(0x7ff5700bc5a0 msgr2=0x7ff5700b2700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:58.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.469+0000 7ff576d39640 1 -- 172.21.15.28:0/602345575 shutdown_connections 2023-11-16T02:29:58.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.469+0000 7ff576d39640 1 -- 172.21.15.28:0/602345575 wait complete. 2023-11-16T02:29:58.488 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-16T02:29:58.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.609+0000 7f0d700ed640 1 Processor -- start 2023-11-16T02:29:58.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.609+0000 7f0d700ed640 1 -- start start 2023-11-16T02:29:58.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.609+0000 7f0d700ed640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0d6806a170 0x7f0d680b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:58.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.609+0000 7f0d700ed640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0d6806a550 0x7f0d68148a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:58.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.609+0000 7f0d700ed640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d68071800 con 0x7f0d68148fa0 2023-11-16T02:29:58.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.609+0000 7f0d700ed640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d680b5ec0 con 0x7f0d6806a170 2023-11-16T02:29:58.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.609+0000 7f0d700ed640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d680b6350 con 0x7f0d6806a550 2023-11-16T02:29:58.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.609+0000 7f0d6e68a640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f0d68148fa0 0x7f0d680b7c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:56016/0 (socket says 172.21.15.28:56016) 2023-11-16T02:29:58.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.609+0000 7f0d6e68a640 1 -- 172.21.15.28:0/2759142432 learned_addr learned my addr 172.21.15.28:0/2759142432 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:58.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6d688640 1 --2- 172.21.15.28:0/2759142432 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0d6806a550 0x7f0d68148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:58.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6de89640 1 --2- 172.21.15.28:0/2759142432 >> v2:172.21.15.70:3300/0 conn(0x7f0d6806a170 0x7f0d680b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:58.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6ce87640 1 -- 172.21.15.28:0/2759142432 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1854042972 0 0) 0x7f0d600014a0 con 0x7f0d68148fa0 2023-11-16T02:29:58.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6ce87640 1 -- 172.21.15.28:0/2759142432 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d54003530 con 0x7f0d68148fa0 2023-11-16T02:29:58.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6ce87640 1 -- 172.21.15.28:0/2759142432 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 438889488 0 0) 0x7f0d54003530 con 0x7f0d68148fa0 2023-11-16T02:29:58.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6ce87640 1 -- 172.21.15.28:0/2759142432 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0d6806a550 msgr2=0x7f0d68148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:58.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6ce87640 1 --2- 172.21.15.28:0/2759142432 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0d6806a550 0x7f0d68148a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6ce87640 1 -- 172.21.15.28:0/2759142432 >> v2:172.21.15.70:3300/0 conn(0x7f0d6806a170 msgr2=0x7f0d680b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:58.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6ce87640 1 --2- 172.21.15.28:0/2759142432 >> v2:172.21.15.70:3300/0 conn(0x7f0d6806a170 0x7f0d680b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6ce87640 1 -- 172.21.15.28:0/2759142432 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d680b5870 con 0x7f0d68148fa0 2023-11-16T02:29:58.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6ce87640 1 -- 172.21.15.28:0/2759142432 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7f0d60001b90 con 0x7f0d68148fa0 2023-11-16T02:29:58.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6ce87640 1 -- 172.21.15.28:0/2759142432 >> v1:172.21.15.28:6789/0 conn(0x7f0d68148fa0 legacy=0x7f0d680b7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:58.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6ce87640 1 --2- 172.21.15.28:0/2759142432 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d54003980 0x7f0d54003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:58.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6ce87640 1 --2- 172.21.15.28:0/2759142432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d540047d0 0x7f0d54004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:58.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6ce87640 1 --2- 172.21.15.28:0/2759142432 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0d6806a550 0x7f0d54005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:58.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6ce87640 1 -- 172.21.15.28:0/2759142432 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d680b5ec0 con 0x7f0d54003980 2023-11-16T02:29:58.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6ce87640 1 -- 172.21.15.28:0/2759142432 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d680b6350 con 0x7f0d540047d0 2023-11-16T02:29:58.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6ce87640 1 -- 172.21.15.28:0/2759142432 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5400b990 con 0x7f0d6806a550 2023-11-16T02:29:58.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6de89640 1 --2- 172.21.15.28:0/2759142432 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d54003980 0x7f0d54003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:58.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6de89640 1 -- 172.21.15.28:0/2759142432 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0d6806a550 msgr2=0x7f0d54005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:58.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6de89640 1 --2- 172.21.15.28:0/2759142432 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0d6806a550 0x7f0d54005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6d688640 1 --2- 172.21.15.28:0/2759142432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d540047d0 0x7f0d54004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:58.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6de89640 1 -- 172.21.15.28:0/2759142432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d540047d0 msgr2=0x7f0d54004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:58.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6de89640 1 --2- 172.21.15.28:0/2759142432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d540047d0 0x7f0d54004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6de89640 1 -- 172.21.15.28:0/2759142432 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d54003530 con 0x7f0d54003980 2023-11-16T02:29:58.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6de89640 1 --2- 172.21.15.28:0/2759142432 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d54003980 0x7f0d54003da0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0d64009b10 tx=0x7f0d6401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ecf55dd40dfee41 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:58.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6ce87640 1 -- 172.21.15.28:0/2759142432 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d640a64a0 con 0x7f0d54003980 2023-11-16T02:29:58.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6ce87640 1 -- 172.21.15.28:0/2759142432 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d640a6600 con 0x7f0d54003980 2023-11-16T02:29:58.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6ce87640 1 -- 172.21.15.28:0/2759142432 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d640a69b0 con 0x7f0d54003980 2023-11-16T02:29:58.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d700ed640 1 -- 172.21.15.28:0/2759142432 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d54003980 msgr2=0x7f0d54003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:58.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d700ed640 1 --2- 172.21.15.28:0/2759142432 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d54003980 0x7f0d54003da0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0d64009b10 tx=0x7f0d6401ca90 comp rx=0 tx=0).stop 2023-11-16T02:29:58.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.613+0000 7f0d6e68a640 1 -- 172.21.15.28:0/2759142432 reap_dead start 2023-11-16T02:29:58.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d700ed640 1 -- 172.21.15.28:0/2759142432 shutdown_connections 2023-11-16T02:29:58.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d700ed640 1 -- 172.21.15.28:0/2759142432 >> 172.21.15.28:0/2759142432 conn(0x7f0d680bc5a0 msgr2=0x7f0d680bc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:58.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d700ed640 1 -- 172.21.15.28:0/2759142432 shutdown_connections 2023-11-16T02:29:58.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d700ed640 1 -- 172.21.15.28:0/2759142432 wait complete. 2023-11-16T02:29:58.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d700ed640 1 Processor -- start 2023-11-16T02:29:58.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d700ed640 1 -- start start 2023-11-16T02:29:58.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d700ed640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0d54003980 0x7f0d6814e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:58.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d700ed640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d681472f0 0x7f0d680ba4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:58.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d700ed640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d680baa30 0x7f0d6813fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:58.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d700ed640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d681e73a0 con 0x7f0d680baa30 2023-11-16T02:29:58.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d700ed640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6814f1c0 con 0x7f0d681472f0 2023-11-16T02:29:58.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d700ed640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6814ec00 con 0x7f0d54003980 2023-11-16T02:29:58.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d6e68a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d680baa30 0x7f0d6813fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:58.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d6e68a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d680baa30 0x7f0d6813fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47496/0 (socket says 172.21.15.28:47496) 2023-11-16T02:29:58.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d6e68a640 1 -- 172.21.15.28:0/2627795008 learned_addr learned my addr 172.21.15.28:0/2627795008 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:58.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d6de89640 1 --2- 172.21.15.28:0/2627795008 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0d54003980 0x7f0d6814e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:58.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d6d688640 1 --2- 172.21.15.28:0/2627795008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d681472f0 0x7f0d680ba4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:58.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d6e68a640 1 -- 172.21.15.28:0/2627795008 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0d54003980 msgr2=0x7f0d6814e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:58.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d6e68a640 1 --2- 172.21.15.28:0/2627795008 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0d54003980 0x7f0d6814e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d6e68a640 1 -- 172.21.15.28:0/2627795008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d681472f0 msgr2=0x7f0d680ba4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:58.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d6e68a640 1 --2- 172.21.15.28:0/2627795008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d681472f0 0x7f0d680ba4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d6e68a640 1 -- 172.21.15.28:0/2627795008 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6814eee0 con 0x7f0d680baa30 2023-11-16T02:29:58.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d6e68a640 1 --2- 172.21.15.28:0/2627795008 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d680baa30 0x7f0d6813fda0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0d680b89d0 tx=0x7f0d6000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:58.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d5e7fc640 1 -- 172.21.15.28:0/2627795008 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6000ce50 con 0x7f0d680baa30 2023-11-16T02:29:58.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d5e7fc640 1 -- 172.21.15.28:0/2627795008 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6000a5b0 con 0x7f0d680baa30 2023-11-16T02:29:58.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d700ed640 1 -- 172.21.15.28:0/2627795008 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d680b9fd0 con 0x7f0d680baa30 2023-11-16T02:29:58.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d5e7fc640 1 -- 172.21.15.28:0/2627795008 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6000a960 con 0x7f0d680baa30 2023-11-16T02:29:58.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d700ed640 1 -- 172.21.15.28:0/2627795008 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d680bbcf0 con 0x7f0d680baa30 2023-11-16T02:29:58.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.617+0000 7f0d700ed640 1 -- 172.21.15.28:0/2627795008 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d680b9df0 con 0x7f0d680baa30 2023-11-16T02:29:58.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.621+0000 7f0d5e7fc640 1 -- 172.21.15.28:0/2627795008 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0d6000aac0 con 0x7f0d680baa30 2023-11-16T02:29:58.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.621+0000 7f0d5e7fc640 1 --2- 172.21.15.28:0/2627795008 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0d4c065a90 0x7f0d4c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:58.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.621+0000 7f0d6de89640 1 --2- 172.21.15.28:0/2627795008 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0d4c065a90 0x7f0d4c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:58.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.621+0000 7f0d5e7fc640 1 -- 172.21.15.28:0/2627795008 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d60082840 con 0x7f0d680baa30 2023-11-16T02:29:58.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.621+0000 7f0d6de89640 1 --2- 172.21.15.28:0/2627795008 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0d4c065a90 0x7f0d4c067f50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0d640ad000 tx=0x7f0d640b2040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:58.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.625+0000 7f0d5e7fc640 1 -- 172.21.15.28:0/2627795008 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f0d60050160 con 0x7f0d680baa30 2023-11-16T02:29:58.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.781+0000 7f0d700ed640 1 -- 172.21.15.28:0/2627795008 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0d68071800 con 0x7f0d680baa30 2023-11-16T02:29:58.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.781+0000 7f0d5e7fc640 1 -- 172.21.15.28:0/2627795008 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0d68071800 con 0x7f0d680baa30 2023-11-16T02:29:58.783 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-11-16T02:29:58.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.781+0000 7f0d700ed640 1 -- 172.21.15.28:0/2627795008 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0d4c065a90 msgr2=0x7f0d4c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:58.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.781+0000 7f0d700ed640 1 --2- 172.21.15.28:0/2627795008 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0d4c065a90 0x7f0d4c067f50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0d640ad000 tx=0x7f0d640b2040 comp rx=0 tx=0).stop 2023-11-16T02:29:58.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.781+0000 7f0d700ed640 1 -- 172.21.15.28:0/2627795008 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d680baa30 msgr2=0x7f0d6813fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:58.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.781+0000 7f0d700ed640 1 --2- 172.21.15.28:0/2627795008 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d680baa30 0x7f0d6813fda0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0d680b89d0 tx=0x7f0d6000cc00 comp rx=0 tx=0).stop 2023-11-16T02:29:58.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.781+0000 7f0d700ed640 1 -- 172.21.15.28:0/2627795008 shutdown_connections 2023-11-16T02:29:58.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.781+0000 7f0d700ed640 1 --2- 172.21.15.28:0/2627795008 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0d4c065a90 0x7f0d4c067f50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.781+0000 7f0d700ed640 1 --2- 172.21.15.28:0/2627795008 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0d680baa30 0x7f0d6813fda0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.781+0000 7f0d700ed640 1 --2- 172.21.15.28:0/2627795008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d681472f0 0x7f0d680ba4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.781+0000 7f0d700ed640 1 --2- 172.21.15.28:0/2627795008 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0d54003980 0x7f0d6814e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.781+0000 7f0d700ed640 1 -- 172.21.15.28:0/2627795008 >> 172.21.15.28:0/2627795008 conn(0x7f0d680bc5a0 msgr2=0x7f0d681d88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:58.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.781+0000 7f0d700ed640 1 -- 172.21.15.28:0/2627795008 shutdown_connections 2023-11-16T02:29:58.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.781+0000 7f0d700ed640 1 -- 172.21.15.28:0/2627795008 wait complete. 2023-11-16T02:29:58.804 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-16T02:29:58.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.921+0000 7f9cf11b4640 1 Processor -- start 2023-11-16T02:29:58.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.925+0000 7f9cf11b4640 1 -- start start 2023-11-16T02:29:58.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.925+0000 7f9cf11b4640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9cec0bae60 0x7f9cec06ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:58.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.925+0000 7f9cf11b4640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9cec0bb6f0 0x7f9cec0ba280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:58.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.925+0000 7f9cf11b4640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cec0b8b70 con 0x7f9cec14e760 2023-11-16T02:29:58.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.925+0000 7f9cf11b4640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cec0b8670 con 0x7f9cec0bae60 2023-11-16T02:29:58.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.925+0000 7f9cf11b4640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec06b3c0 con 0x7f9cec0bb6f0 2023-11-16T02:29:58.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.925+0000 7f9cead9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9cec0bae60 0x7f9cec06ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:58.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.925+0000 7f9cead9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9cec0bae60 0x7f9cec06ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47508/0 (socket says 172.21.15.28:47508) 2023-11-16T02:29:58.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.925+0000 7f9cead9d640 1 -- 172.21.15.28:0/671648809 learned_addr learned my addr 172.21.15.28:0/671648809 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:58.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.925+0000 7f9cea59c640 1 --2- 172.21.15.28:0/671648809 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9cec0bb6f0 0x7f9cec0ba280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:58.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.925+0000 7f9cead9d640 1 -- 172.21.15.28:0/671648809 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9cec0bb6f0 msgr2=0x7f9cec0ba280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:58.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.925+0000 7f9cead9d640 1 --2- 172.21.15.28:0/671648809 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9cec0bb6f0 0x7f9cec0ba280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.925+0000 7f9cead9d640 1 -- 172.21.15.28:0/671648809 >> v1:172.21.15.70:6789/0 conn(0x7f9cec14e760 legacy=0x7f9cec14ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:58.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.925+0000 7f9cead9d640 1 -- 172.21.15.28:0/671648809 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec06b680 con 0x7f9cec0bae60 2023-11-16T02:29:58.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.925+0000 7f9cea59c640 1 --2- 172.21.15.28:0/671648809 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9cec0bb6f0 0x7f9cec0ba280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:58.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.925+0000 7f9cead9d640 1 --2- 172.21.15.28:0/671648809 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9cec0bae60 0x7f9cec06ae80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0009870 tx=0x7f9ce001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abf031a21cd6fc62 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:58.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.925+0000 7f9ce9d9b640 1 -- 172.21.15.28:0/671648809 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce00a89b0 con 0x7f9cec0bae60 2023-11-16T02:29:58.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.925+0000 7f9ce9d9b640 1 -- 172.21.15.28:0/671648809 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce00a8b10 con 0x7f9cec0bae60 2023-11-16T02:29:58.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.925+0000 7f9ce9d9b640 1 -- 172.21.15.28:0/671648809 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce00a8ea0 con 0x7f9cec0bae60 2023-11-16T02:29:58.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cf11b4640 1 -- 172.21.15.28:0/671648809 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9cec0bae60 msgr2=0x7f9cec06ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:58.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cf11b4640 1 --2- 172.21.15.28:0/671648809 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9cec0bae60 0x7f9cec06ae80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0009870 tx=0x7f9ce001ecf0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cf11b4640 1 -- 172.21.15.28:0/671648809 shutdown_connections 2023-11-16T02:29:58.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cf11b4640 1 --2- 172.21.15.28:0/671648809 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9cec0bb6f0 0x7f9cec0ba280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cf11b4640 1 --2- 172.21.15.28:0/671648809 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9cec0bae60 0x7f9cec06ae80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cf11b4640 1 -- 172.21.15.28:0/671648809 >> 172.21.15.28:0/671648809 conn(0x7f9cec06eae0 msgr2=0x7f9cec06eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:58.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cf11b4640 1 -- 172.21.15.28:0/671648809 shutdown_connections 2023-11-16T02:29:58.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cf11b4640 1 -- 172.21.15.28:0/671648809 wait complete. 2023-11-16T02:29:58.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cf11b4640 1 Processor -- start 2023-11-16T02:29:58.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cf11b4640 1 -- start start 2023-11-16T02:29:58.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cf11b4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9cec0bae60 0x7f9cec14aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:58.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cf11b4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9cec0bb6f0 0x7f9cec0bd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:58.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cf11b4640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9cec14e760 0x7f9cec149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:58.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cf11b4640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec148ef0 con 0x7f9cec0bae60 2023-11-16T02:29:58.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cf11b4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec14a580 con 0x7f9cec0bb6f0 2023-11-16T02:29:58.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cf11b4640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec0bde80 con 0x7f9cec14e760 2023-11-16T02:29:58.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cead9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9cec0bae60 0x7f9cec14aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:58.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cead9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9cec0bae60 0x7f9cec14aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47510/0 (socket says 172.21.15.28:47510) 2023-11-16T02:29:58.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cead9d640 1 -- 172.21.15.28:0/462019710 learned_addr learned my addr 172.21.15.28:0/462019710 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:58.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cea59c640 1 --2- 172.21.15.28:0/462019710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9cec0bb6f0 0x7f9cec0bd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:58.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9ceb59e640 1 --2- 172.21.15.28:0/462019710 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9cec14e760 0x7f9cec149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:58.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cead9d640 1 -- 172.21.15.28:0/462019710 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9cec14e760 msgr2=0x7f9cec149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:58.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cead9d640 1 --2- 172.21.15.28:0/462019710 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9cec14e760 0x7f9cec149310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cead9d640 1 -- 172.21.15.28:0/462019710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9cec0bb6f0 msgr2=0x7f9cec0bd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:58.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cead9d640 1 --2- 172.21.15.28:0/462019710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9cec0bb6f0 0x7f9cec0bd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:58.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cead9d640 1 -- 172.21.15.28:0/462019710 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce00094d0 con 0x7f9cec0bae60 2023-11-16T02:29:58.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cea59c640 1 --2- 172.21.15.28:0/462019710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9cec0bb6f0 0x7f9cec0bd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:58.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9ceb59e640 1 --2- 172.21.15.28:0/462019710 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9cec14e760 0x7f9cec149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:58.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cead9d640 1 --2- 172.21.15.28:0/462019710 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9cec0bae60 0x7f9cec14aeb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9ce001f590 tx=0x7f9ce001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:58.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cd37fe640 1 -- 172.21.15.28:0/462019710 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce00c0070 con 0x7f9cec0bae60 2023-11-16T02:29:58.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cd37fe640 1 -- 172.21.15.28:0/462019710 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce00a87b0 con 0x7f9cec0bae60 2023-11-16T02:29:58.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cf11b4640 1 -- 172.21.15.28:0/462019710 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cec14a780 con 0x7f9cec0bae60 2023-11-16T02:29:58.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cd37fe640 1 -- 172.21.15.28:0/462019710 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce00b9650 con 0x7f9cec0bae60 2023-11-16T02:29:58.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.929+0000 7f9cf11b4640 1 -- 172.21.15.28:0/462019710 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cec0b4150 con 0x7f9cec0bae60 2023-11-16T02:29:58.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.933+0000 7f9cf11b4640 1 -- 172.21.15.28:0/462019710 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cec04e8a0 con 0x7f9cec0bae60 2023-11-16T02:29:58.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.933+0000 7f9cd37fe640 1 -- 172.21.15.28:0/462019710 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9ce00b7040 con 0x7f9cec0bae60 2023-11-16T02:29:58.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.933+0000 7f9cd37fe640 1 --2- 172.21.15.28:0/462019710 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f9cd8065a90 0x7f9cd8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:58.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.933+0000 7f9cd37fe640 1 -- 172.21.15.28:0/462019710 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ce0120550 con 0x7f9cec0bae60 2023-11-16T02:29:58.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.933+0000 7f9cea59c640 1 --2- 172.21.15.28:0/462019710 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f9cd8065a90 0x7f9cd8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:58.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.933+0000 7f9cea59c640 1 --2- 172.21.15.28:0/462019710 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f9cd8065a90 0x7f9cd8067f50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9cec1dd5f0 tx=0x7f9cdc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:58.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:58.937+0000 7f9cd37fe640 1 -- 172.21.15.28:0/462019710 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f9ce00edfa0 con 0x7f9cec0bae60 2023-11-16T02:29:59.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.093+0000 7f9cf11b4640 1 -- 172.21.15.28:0/462019710 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cec04e8a0 con 0x7f9cec0bae60 2023-11-16T02:29:59.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.097+0000 7f9cd37fe640 1 -- 172.21.15.28:0/462019710 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f9ce00f15c0 con 0x7f9cec0bae60 2023-11-16T02:29:59.099 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:29:59.099 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":22,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","created":"2023-11-16T02:29:13.710567+0000","modified":"2023-11-16T02:29:38.871066+0000","last_up_change":"2023-11-16T02:29:24.841087+0000","last_in_change":"2023-11-16T02:29:16.024490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-16T02:29:26.490910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-16T02:29:36.133224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-16T02:29:36.866156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dfa8b58d-3481-4e68-86e8-21873d31d0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":38722},{"type":"v1","addr":"172.21.15.28:6809","nonce":38722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":38722},{"type":"v1","addr":"172.21.15.28:6811","nonce":38722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":38722},{"type":"v1","addr":"172.21.15.28:6815","nonce":38722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":38722},{"type":"v1","addr":"172.21.15.28:6813","nonce":38722}]},"public_addr":"172.21.15.28:6809/38722","cluster_addr":"172.21.15.28:6811/38722","heartbeat_back_addr":"172.21.15.28:6815/38722","heartbeat_front_addr":"172.21.15.28:6813/38722","state":["exists","up"]},{"osd":1,"uuid":"1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":38724},{"type":"v1","addr":"172.21.15.28:6824","nonce":38724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":38724},{"type":"v1","addr":"172.21.15.28:6827","nonce":38724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":38724},{"type":"v1","addr":"172.21.15.28:6831","nonce":38724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":38724},{"type":"v1","addr":"172.21.15.28:6829","nonce":38724}]},"public_addr":"172.21.15.28:6824/38724","cluster_addr":"172.21.15.28:6827/38724","heartbeat_back_addr":"172.21.15.28:6831/38724","heartbeat_front_addr":"172.21.15.28:6829/38724","state":["exists","up"]},{"osd":2,"uuid":"e18f39cd-6a35-4d36-9eed-3877794bf2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":38723},{"type":"v1","addr":"172.21.15.28:6801","nonce":38723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":38723},{"type":"v1","addr":"172.21.15.28:6803","nonce":38723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":38723},{"type":"v1","addr":"172.21.15.28:6807","nonce":38723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":38723},{"type":"v1","addr":"172.21.15.28:6805","nonce":38723}]},"public_addr":"172.21.15.28:6801/38723","cluster_addr":"172.21.15.28:6803/38723","heartbeat_back_addr":"172.21.15.28:6807/38723","heartbeat_front_addr":"172.21.15.28:6805/38723","state":["exists","up"]},{"osd":3,"uuid":"303d0728-409d-47d7-b7a6-6eb273f602fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":38725},{"type":"v1","addr":"172.21.15.28:6817","nonce":38725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":38725},{"type":"v1","addr":"172.21.15.28:6819","nonce":38725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":38725},{"type":"v1","addr":"172.21.15.28:6825","nonce":38725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":38725},{"type":"v1","addr":"172.21.15.28:6821","nonce":38725}]},"public_addr":"172.21.15.28:6817/38725","cluster_addr":"172.21.15.28:6819/38725","heartbeat_back_addr":"172.21.15.28:6825/38725","heartbeat_front_addr":"172.21.15.28:6821/38725","state":["exists","up"]},{"osd":4,"uuid":"df0bf0ac-6efe-4964-ad27-7c1771a70c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":38828},{"type":"v1","addr":"172.21.15.70:6801","nonce":38828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":38828},{"type":"v1","addr":"172.21.15.70:6803","nonce":38828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":38828},{"type":"v1","addr":"172.21.15.70:6807","nonce":38828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":38828},{"type":"v1","addr":"172.21.15.70:6805","nonce":38828}]},"public_addr":"172.21.15.70:6801/38828","cluster_addr":"172.21.15.70:6803/38828","heartbeat_back_addr":"172.21.15.70:6807/38828","heartbeat_front_addr":"172.21.15.70:6805/38828","state":["exists","up"]},{"osd":5,"uuid":"84921219-65cb-4c4e-b9ed-a773db639034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":38830},{"type":"v1","addr":"172.21.15.70:6810","nonce":38830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6813","nonce":38830},{"type":"v1","addr":"172.21.15.70:6814","nonce":38830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":38830},{"type":"v1","addr":"172.21.15.70:6824","nonce":38830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":38830},{"type":"v1","addr":"172.21.15.70:6819","nonce":38830}]},"public_addr":"172.21.15.70:6810/38830","cluster_addr":"172.21.15.70:6814/38830","heartbeat_back_addr":"172.21.15.70:6824/38830","heartbeat_front_addr":"172.21.15.70:6819/38830","state":["exists","up"]},{"osd":6,"uuid":"c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":38829},{"type":"v1","addr":"172.21.15.70:6812","nonce":38829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":38829},{"type":"v1","addr":"172.21.15.70:6820","nonce":38829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":38829},{"type":"v1","addr":"172.21.15.70:6828","nonce":38829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":38829},{"type":"v1","addr":"172.21.15.70:6825","nonce":38829}]},"public_addr":"172.21.15.70:6812/38829","cluster_addr":"172.21.15.70:6820/38829","heartbeat_back_addr":"172.21.15.70:6828/38829","heartbeat_front_addr":"172.21.15.70:6825/38829","state":["exists","up"]},{"osd":7,"uuid":"e2cdd418-12ce-4eea-9b22-efdad83eb76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":38839},{"type":"v1","addr":"172.21.15.70:6815","nonce":38839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":38839},{"type":"v1","addr":"172.21.15.70:6823","nonce":38839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":38839},{"type":"v1","addr":"172.21.15.70:6831","nonce":38839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6827","nonce":38839},{"type":"v1","addr":"172.21.15.70:6829","nonce":38839}]},"public_addr":"172.21.15.70:6815/38839","cluster_addr":"172.21.15.70:6823/38839","heartbeat_back_addr":"172.21.15.70:6831/38839","heartbeat_front_addr":"172.21.15.70:6829/38839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.544240+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.637637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.352115+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.652916+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.624477+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.570247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.706468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.696574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-16T02:29:59.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.097+0000 7f9cf11b4640 1 -- 172.21.15.28:0/462019710 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f9cd8065a90 msgr2=0x7f9cd8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:59.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.097+0000 7f9cf11b4640 1 --2- 172.21.15.28:0/462019710 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f9cd8065a90 0x7f9cd8067f50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9cec1dd5f0 tx=0x7f9cdc008040 comp rx=0 tx=0).stop 2023-11-16T02:29:59.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.097+0000 7f9cf11b4640 1 -- 172.21.15.28:0/462019710 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9cec0bae60 msgr2=0x7f9cec14aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:59.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.097+0000 7f9cf11b4640 1 --2- 172.21.15.28:0/462019710 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9cec0bae60 0x7f9cec14aeb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9ce001f590 tx=0x7f9ce001ba90 comp rx=0 tx=0).stop 2023-11-16T02:29:59.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.097+0000 7f9cf11b4640 1 -- 172.21.15.28:0/462019710 shutdown_connections 2023-11-16T02:29:59.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.097+0000 7f9cf11b4640 1 --2- 172.21.15.28:0/462019710 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f9cd8065a90 0x7f9cd8067f50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.097+0000 7f9cf11b4640 1 --2- 172.21.15.28:0/462019710 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9cec14e760 0x7f9cec149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.097+0000 7f9cf11b4640 1 --2- 172.21.15.28:0/462019710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9cec0bb6f0 0x7f9cec0bd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.097+0000 7f9cf11b4640 1 --2- 172.21.15.28:0/462019710 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9cec0bae60 0x7f9cec14aeb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.097+0000 7f9cf11b4640 1 -- 172.21.15.28:0/462019710 >> 172.21.15.28:0/462019710 conn(0x7f9cec06eae0 msgr2=0x7f9cec06eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:59.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.097+0000 7f9cf11b4640 1 -- 172.21.15.28:0/462019710 shutdown_connections 2023-11-16T02:29:59.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.097+0000 7f9cf11b4640 1 -- 172.21.15.28:0/462019710 wait complete. 2023-11-16T02:29:59.117 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-16T02:29:26.490910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-16T02:29:36.133224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-16T02:29:36.866156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-16T02:29:59.118 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-16T02:29:59.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.233+0000 7f628cd26640 1 Processor -- start 2023-11-16T02:29:59.236 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.233+0000 7f628cd26640 1 -- start start 2023-11-16T02:29:59.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.233+0000 7f628cd26640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f628806d8c0 0x7f628814e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:59.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.233+0000 7f628cd26640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f62880ba600 0x7f628806b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:59.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.233+0000 7f628cd26640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f628806cc40 0x7f628814ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:59.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.233+0000 7f628cd26640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f628806bbd0 con 0x7f62880ba600 2023-11-16T02:29:59.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.233+0000 7f628cd26640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f628806b850 con 0x7f628806d8c0 2023-11-16T02:29:59.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.233+0000 7f628cd26640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f628806ae80 con 0x7f628806cc40 2023-11-16T02:29:59.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.233+0000 7f6285d9b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f62880ba600 0x7f628806b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:59.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.233+0000 7f6285d9b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f62880ba600 0x7f628806b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47526/0 (socket says 172.21.15.28:47526) 2023-11-16T02:29:59.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.233+0000 7f6285d9b640 1 -- 172.21.15.28:0/295305551 learned_addr learned my addr 172.21.15.28:0/295305551 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:59.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.233+0000 7f6286d9d640 1 --2- 172.21.15.28:0/295305551 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f628806cc40 0x7f628814ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:59.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.233+0000 7f628659c640 1 --2- 172.21.15.28:0/295305551 >> v2:172.21.15.70:3300/0 conn(0x7f628806d8c0 0x7f628814e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:59.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.233+0000 7f6285d9b640 1 -- 172.21.15.28:0/295305551 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f628806cc40 msgr2=0x7f628814ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:59.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.233+0000 7f6285d9b640 1 --2- 172.21.15.28:0/295305551 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f628806cc40 0x7f628814ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.233+0000 7f6285d9b640 1 -- 172.21.15.28:0/295305551 >> v2:172.21.15.70:3300/0 conn(0x7f628806d8c0 msgr2=0x7f628814e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:59.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.233+0000 7f6285d9b640 1 --2- 172.21.15.28:0/295305551 >> v2:172.21.15.70:3300/0 conn(0x7f628806d8c0 0x7f628814e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.233+0000 7f6285d9b640 1 -- 172.21.15.28:0/295305551 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62880b5340 con 0x7f62880ba600 2023-11-16T02:29:59.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.237+0000 7f6285d9b640 1 --2- 172.21.15.28:0/295305551 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62880ba600 0x7f628806b310 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6288070d40 tx=0x7f627c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2e3fe25c132152 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:59.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.237+0000 7f628559a640 1 -- 172.21.15.28:0/295305551 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c0a89b0 con 0x7f62880ba600 2023-11-16T02:29:59.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.237+0000 7f628559a640 1 -- 172.21.15.28:0/295305551 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627c0a8b10 con 0x7f62880ba600 2023-11-16T02:29:59.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.237+0000 7f628559a640 1 -- 172.21.15.28:0/295305551 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c0a8ea0 con 0x7f62880ba600 2023-11-16T02:29:59.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.237+0000 7f628cd26640 1 -- 172.21.15.28:0/295305551 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62880ba600 msgr2=0x7f628806b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:59.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.237+0000 7f628cd26640 1 --2- 172.21.15.28:0/295305551 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62880ba600 0x7f628806b310 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6288070d40 tx=0x7f627c01ecf0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.237+0000 7f628cd26640 1 -- 172.21.15.28:0/295305551 shutdown_connections 2023-11-16T02:29:59.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.237+0000 7f628cd26640 1 --2- 172.21.15.28:0/295305551 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f628806cc40 0x7f628814ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.237+0000 7f628cd26640 1 --2- 172.21.15.28:0/295305551 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62880ba600 0x7f628806b310 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.237+0000 7f628cd26640 1 --2- 172.21.15.28:0/295305551 >> v2:172.21.15.70:3300/0 conn(0x7f628806d8c0 0x7f628814e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.237+0000 7f628cd26640 1 -- 172.21.15.28:0/295305551 >> 172.21.15.28:0/295305551 conn(0x7f62880bac40 msgr2=0x7f62880bb050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:59.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.237+0000 7f628cd26640 1 -- 172.21.15.28:0/295305551 shutdown_connections 2023-11-16T02:29:59.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.237+0000 7f628cd26640 1 -- 172.21.15.28:0/295305551 wait complete. 2023-11-16T02:29:59.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f628cd26640 1 Processor -- start 2023-11-16T02:29:59.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f628cd26640 1 -- start start 2023-11-16T02:29:59.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f628cd26640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f628806cc40 0x7f628813bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:59.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f628cd26640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f628806d8c0 0x7f62880b6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:59.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f628cd26640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62880ba600 0x7f62880bd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:59.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f628cd26640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62880b7660 con 0x7f628806d8c0 2023-11-16T02:29:59.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f628cd26640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62880b5ef0 con 0x7f62880ba600 2023-11-16T02:29:59.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f628cd26640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62880b7890 con 0x7f628806cc40 2023-11-16T02:29:59.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f6285d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f628806d8c0 0x7f62880b6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:59.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f6285d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f628806d8c0 0x7f62880b6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47536/0 (socket says 172.21.15.28:47536) 2023-11-16T02:29:59.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f6285d9b640 1 -- 172.21.15.28:0/925269758 learned_addr learned my addr 172.21.15.28:0/925269758 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:59.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f628659c640 1 --2- 172.21.15.28:0/925269758 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f628806cc40 0x7f628813bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:59.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f6286d9d640 1 --2- 172.21.15.28:0/925269758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62880ba600 0x7f62880bd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:59.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f6285d9b640 1 -- 172.21.15.28:0/925269758 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f628806cc40 msgr2=0x7f628813bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:59.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f6285d9b640 1 --2- 172.21.15.28:0/925269758 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f628806cc40 0x7f628813bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f6285d9b640 1 -- 172.21.15.28:0/925269758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62880ba600 msgr2=0x7f62880bd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:59.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f6285d9b640 1 --2- 172.21.15.28:0/925269758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62880ba600 0x7f62880bd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f6285d9b640 1 -- 172.21.15.28:0/925269758 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627c0094d0 con 0x7f628806d8c0 2023-11-16T02:29:59.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f6285d9b640 1 --2- 172.21.15.28:0/925269758 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f628806d8c0 0x7f62880b6a10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f627c01d3a0 tx=0x7f627c01ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:59.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f6276ffd640 1 -- 172.21.15.28:0/925269758 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c0b0d40 con 0x7f628806d8c0 2023-11-16T02:29:59.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f6276ffd640 1 -- 172.21.15.28:0/925269758 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627c0bb460 con 0x7f628806d8c0 2023-11-16T02:29:59.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f628cd26640 1 -- 172.21.15.28:0/925269758 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62880b7b70 con 0x7f628806d8c0 2023-11-16T02:29:59.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f6276ffd640 1 -- 172.21.15.28:0/925269758 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627c0b0ea0 con 0x7f628806d8c0 2023-11-16T02:29:59.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f628cd26640 1 -- 172.21.15.28:0/925269758 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62880b6f50 con 0x7f628806d8c0 2023-11-16T02:29:59.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f628cd26640 1 -- 172.21.15.28:0/925269758 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f628804e8a0 con 0x7f628806d8c0 2023-11-16T02:29:59.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f6276ffd640 1 -- 172.21.15.28:0/925269758 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f627c0b83f0 con 0x7f628806d8c0 2023-11-16T02:29:59.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f6276ffd640 1 --2- 172.21.15.28:0/925269758 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f6268065a60 0x7f6268067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:59.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f6276ffd640 1 -- 172.21.15.28:0/925269758 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f627c120a50 con 0x7f628806d8c0 2023-11-16T02:29:59.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.241+0000 7f628659c640 1 --2- 172.21.15.28:0/925269758 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f6268065a60 0x7f6268067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:59.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.245+0000 7f628659c640 1 --2- 172.21.15.28:0/925269758 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f6268065a60 0x7f6268067f20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6278009af0 tx=0x7f6278008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:59.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.249+0000 7f6276ffd640 1 -- 172.21.15.28:0/925269758 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f627c0ee4a0 con 0x7f628806d8c0 2023-11-16T02:29:59.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.397+0000 7f628cd26640 1 -- 172.21.15.28:0/925269758 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f628813cd50 con 0x7f628806d8c0 2023-11-16T02:29:59.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.397+0000 7f6276ffd640 1 -- 172.21.15.28:0/925269758 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f627c0c00a0 con 0x7f628806d8c0 2023-11-16T02:29:59.402 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-11-16T02:29:59.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.401+0000 7f628cd26640 1 -- 172.21.15.28:0/925269758 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f6268065a60 msgr2=0x7f6268067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:59.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.401+0000 7f628cd26640 1 --2- 172.21.15.28:0/925269758 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f6268065a60 0x7f6268067f20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6278009af0 tx=0x7f6278008040 comp rx=0 tx=0).stop 2023-11-16T02:29:59.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.401+0000 7f628cd26640 1 -- 172.21.15.28:0/925269758 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f628806d8c0 msgr2=0x7f62880b6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:59.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.401+0000 7f628cd26640 1 --2- 172.21.15.28:0/925269758 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f628806d8c0 0x7f62880b6a10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f627c01d3a0 tx=0x7f627c01ba90 comp rx=0 tx=0).stop 2023-11-16T02:29:59.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.401+0000 7f628cd26640 1 -- 172.21.15.28:0/925269758 shutdown_connections 2023-11-16T02:29:59.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.401+0000 7f628cd26640 1 --2- 172.21.15.28:0/925269758 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f6268065a60 0x7f6268067f20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.401+0000 7f628cd26640 1 --2- 172.21.15.28:0/925269758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62880ba600 0x7f62880bd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.401+0000 7f628cd26640 1 --2- 172.21.15.28:0/925269758 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f628806d8c0 0x7f62880b6a10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.401+0000 7f628cd26640 1 --2- 172.21.15.28:0/925269758 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f628806cc40 0x7f628813bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.401+0000 7f628cd26640 1 -- 172.21.15.28:0/925269758 >> 172.21.15.28:0/925269758 conn(0x7f62880bac40 msgr2=0x7f62880bc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:59.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.401+0000 7f628cd26640 1 -- 172.21.15.28:0/925269758 shutdown_connections 2023-11-16T02:29:59.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.401+0000 7f628cd26640 1 -- 172.21.15.28:0/925269758 wait complete. 2023-11-16T02:29:59.420 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-16T02:29:59.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb378887640 1 Processor -- start 2023-11-16T02:29:59.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb378887640 1 -- start start 2023-11-16T02:29:59.542 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb378887640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb3741415b0 0x7fb3740ba410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:59.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb378887640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb37414e0f0 0x7fb37414e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:59.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb378887640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3740b78a0 con 0x7fb3740b8340 2023-11-16T02:29:59.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb378887640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3740ba060 con 0x7fb3741415b0 2023-11-16T02:29:59.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb378887640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3740b9390 con 0x7fb37414e0f0 2023-11-16T02:29:59.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb369d9b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fb3740b8340 0x7fb3740b87d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:56030/0 (socket says 172.21.15.28:56030) 2023-11-16T02:29:59.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb369d9b640 1 -- 172.21.15.28:0/1759071045 learned_addr learned my addr 172.21.15.28:0/1759071045 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:59.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb371d9b640 1 -- 172.21.15.28:0/1759071045 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850681182 0 0) 0x7fb3740b78a0 con 0x7fb3740b8340 2023-11-16T02:29:59.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb37259c640 1 --2- 172.21.15.28:0/1759071045 >> v2:172.21.15.70:3300/0 conn(0x7fb3741415b0 0x7fb3740ba410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:59.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb372d9d640 1 --2- 172.21.15.28:0/1759071045 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb37414e0f0 0x7fb37414e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:59.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb371d9b640 1 -- 172.21.15.28:0/1759071045 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb360003530 con 0x7fb3740b8340 2023-11-16T02:29:59.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb371d9b640 1 -- 172.21.15.28:0/1759071045 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1360652806 0 0) 0x7fb360003530 con 0x7fb3740b8340 2023-11-16T02:29:59.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb371d9b640 1 -- 172.21.15.28:0/1759071045 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb37414e0f0 msgr2=0x7fb37414e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:59.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb371d9b640 1 --2- 172.21.15.28:0/1759071045 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb37414e0f0 0x7fb37414e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb371d9b640 1 -- 172.21.15.28:0/1759071045 >> v2:172.21.15.70:3300/0 conn(0x7fb3741415b0 msgr2=0x7fb3740ba410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:59.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb371d9b640 1 --2- 172.21.15.28:0/1759071045 >> v2:172.21.15.70:3300/0 conn(0x7fb3741415b0 0x7fb3740ba410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb371d9b640 1 -- 172.21.15.28:0/1759071045 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37414f000 con 0x7fb3740b8340 2023-11-16T02:29:59.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb371d9b640 1 -- 172.21.15.28:0/1759071045 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7fb35c001680 con 0x7fb3740b8340 2023-11-16T02:29:59.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb372d9d640 1 --2- 172.21.15.28:0/1759071045 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb37414e0f0 0x7fb37414e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:29:59.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb371d9b640 1 -- 172.21.15.28:0/1759071045 >> v1:172.21.15.28:6789/0 conn(0x7fb3740b8340 legacy=0x7fb3740b87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:59.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb371d9b640 1 --2- 172.21.15.28:0/1759071045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb360003980 0x7fb360003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:59.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb371d9b640 1 --2- 172.21.15.28:0/1759071045 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3600047d0 0x7fb360004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:59.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb371d9b640 1 --2- 172.21.15.28:0/1759071045 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb37414e0f0 0x7fb360005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:59.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb371d9b640 1 -- 172.21.15.28:0/1759071045 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36000b990 con 0x7fb3600047d0 2023-11-16T02:29:59.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb371d9b640 1 -- 172.21.15.28:0/1759071045 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36000bad0 con 0x7fb360003980 2023-11-16T02:29:59.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb371d9b640 1 -- 172.21.15.28:0/1759071045 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb36000bc10 con 0x7fb37414e0f0 2023-11-16T02:29:59.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb369d9b640 1 --2- 172.21.15.28:0/1759071045 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3600047d0 0x7fb360004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:59.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb37259c640 1 --2- 172.21.15.28:0/1759071045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb360003980 0x7fb360003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:59.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb369d9b640 1 -- 172.21.15.28:0/1759071045 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb37414e0f0 msgr2=0x7fb360005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:59.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb372d9d640 1 --2- 172.21.15.28:0/1759071045 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb37414e0f0 0x7fb360005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:59.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb369d9b640 1 --2- 172.21.15.28:0/1759071045 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb37414e0f0 0x7fb360005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb369d9b640 1 -- 172.21.15.28:0/1759071045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb360003980 msgr2=0x7fb360003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:59.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb369d9b640 1 --2- 172.21.15.28:0/1759071045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb360003980 0x7fb360003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb369d9b640 1 -- 172.21.15.28:0/1759071045 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb360003530 con 0x7fb3600047d0 2023-11-16T02:29:59.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.537+0000 7fb37259c640 1 --2- 172.21.15.28:0/1759071045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb360003980 0x7fb360003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:59.551 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.541+0000 7fb369d9b640 1 --2- 172.21.15.28:0/1759071045 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3600047d0 0x7fb360004c50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb35c00c270 tx=0x7fb35c01f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a92ad997d3be2701 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:59.551 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.541+0000 7fb371d9b640 1 -- 172.21.15.28:0/1759071045 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35c0a8ce0 con 0x7fb3600047d0 2023-11-16T02:29:59.551 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.541+0000 7fb371d9b640 1 -- 172.21.15.28:0/1759071045 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35c0a8e40 con 0x7fb3600047d0 2023-11-16T02:29:59.551 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.541+0000 7fb371d9b640 1 -- 172.21.15.28:0/1759071045 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35c005b00 con 0x7fb3600047d0 2023-11-16T02:29:59.551 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.541+0000 7fb378887640 1 -- 172.21.15.28:0/1759071045 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3600047d0 msgr2=0x7fb360004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:59.551 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.541+0000 7fb378887640 1 --2- 172.21.15.28:0/1759071045 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3600047d0 0x7fb360004c50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb35c00c270 tx=0x7fb35c01f3b0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.551 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.541+0000 7fb372d9d640 1 -- 172.21.15.28:0/1759071045 reap_dead start 2023-11-16T02:29:59.551 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.541+0000 7fb378887640 1 -- 172.21.15.28:0/1759071045 shutdown_connections 2023-11-16T02:29:59.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.541+0000 7fb378887640 1 -- 172.21.15.28:0/1759071045 >> 172.21.15.28:0/1759071045 conn(0x7fb37406b7e0 msgr2=0x7fb37406bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:59.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.541+0000 7fb378887640 1 -- 172.21.15.28:0/1759071045 shutdown_connections 2023-11-16T02:29:59.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.541+0000 7fb378887640 1 -- 172.21.15.28:0/1759071045 wait complete. 2023-11-16T02:29:59.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.541+0000 7fb378887640 1 Processor -- start 2023-11-16T02:29:59.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.541+0000 7fb378887640 1 -- start start 2023-11-16T02:29:59.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb378887640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3600047d0 0x7fb3740bf670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:59.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb378887640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb374138be0 0x7fb374143a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:59.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb378887640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb374143f50 0x7fb3741dfc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:59.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb378887640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3740bfbb0 con 0x7fb3600047d0 2023-11-16T02:29:59.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb378887640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb374143580 con 0x7fb374138be0 2023-11-16T02:29:59.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb378887640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb374144ca0 con 0x7fb374143f50 2023-11-16T02:29:59.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb37259c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3600047d0 0x7fb3740bf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:59.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb37259c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3600047d0 0x7fb3740bf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47558/0 (socket says 172.21.15.28:47558) 2023-11-16T02:29:59.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb37259c640 1 -- 172.21.15.28:0/3123220398 learned_addr learned my addr 172.21.15.28:0/3123220398 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:59.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb369d9b640 1 --2- 172.21.15.28:0/3123220398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb374138be0 0x7fb374143a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:59.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb372d9d640 1 --2- 172.21.15.28:0/3123220398 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb374143f50 0x7fb3741dfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:59.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb37259c640 1 -- 172.21.15.28:0/3123220398 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb374143f50 msgr2=0x7fb3741dfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:59.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb37259c640 1 --2- 172.21.15.28:0/3123220398 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb374143f50 0x7fb3741dfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb37259c640 1 -- 172.21.15.28:0/3123220398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb374138be0 msgr2=0x7fb374143a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:59.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb37259c640 1 --2- 172.21.15.28:0/3123220398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb374138be0 0x7fb374143a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb37259c640 1 -- 172.21.15.28:0/3123220398 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37414a8f0 con 0x7fb3600047d0 2023-11-16T02:29:59.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb369d9b640 1 --2- 172.21.15.28:0/3123220398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb374138be0 0x7fb374143a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:29:59.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb37259c640 1 --2- 172.21.15.28:0/3123220398 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3600047d0 0x7fb3740bf670 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb364010950 tx=0x7fb364010e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:59.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb36b7fe640 1 -- 172.21.15.28:0/3123220398 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36400ec20 con 0x7fb3600047d0 2023-11-16T02:29:59.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb36b7fe640 1 -- 172.21.15.28:0/3123220398 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36400ed80 con 0x7fb3600047d0 2023-11-16T02:29:59.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb378887640 1 -- 172.21.15.28:0/3123220398 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb37414abd0 con 0x7fb3600047d0 2023-11-16T02:29:59.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb36b7fe640 1 -- 172.21.15.28:0/3123220398 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb364004220 con 0x7fb3600047d0 2023-11-16T02:29:59.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb378887640 1 -- 172.21.15.28:0/3123220398 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb37414b190 con 0x7fb3600047d0 2023-11-16T02:29:59.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb378887640 1 -- 172.21.15.28:0/3123220398 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb37404e8a0 con 0x7fb3600047d0 2023-11-16T02:29:59.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb36b7fe640 1 -- 172.21.15.28:0/3123220398 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb364004380 con 0x7fb3600047d0 2023-11-16T02:29:59.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb36b7fe640 1 --2- 172.21.15.28:0/3123220398 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb354065a90 0x7fb354067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:59.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb36b7fe640 1 -- 172.21.15.28:0/3123220398 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3640839c0 con 0x7fb3600047d0 2023-11-16T02:29:59.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb369d9b640 1 --2- 172.21.15.28:0/3123220398 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb354065a90 0x7fb354067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:59.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.545+0000 7fb369d9b640 1 --2- 172.21.15.28:0/3123220398 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb354065a90 0x7fb354067f50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb35c0ad000 tx=0x7fb35c001a80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:59.555 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.549+0000 7fb36b7fe640 1 -- 172.21.15.28:0/3123220398 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fb364051360 con 0x7fb3600047d0 2023-11-16T02:29:59.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.705+0000 7fb378887640 1 -- 172.21.15.28:0/3123220398 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb37413e270 con 0x7fb3600047d0 2023-11-16T02:29:59.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.705+0000 7fb36b7fe640 1 -- 172.21.15.28:0/3123220398 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb364054980 con 0x7fb3600047d0 2023-11-16T02:29:59.709 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-11-16T02:29:59.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.705+0000 7fb378887640 1 -- 172.21.15.28:0/3123220398 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb354065a90 msgr2=0x7fb354067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:59.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.705+0000 7fb378887640 1 --2- 172.21.15.28:0/3123220398 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb354065a90 0x7fb354067f50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb35c0ad000 tx=0x7fb35c001a80 comp rx=0 tx=0).stop 2023-11-16T02:29:59.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.705+0000 7fb378887640 1 -- 172.21.15.28:0/3123220398 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3600047d0 msgr2=0x7fb3740bf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:59.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.705+0000 7fb378887640 1 --2- 172.21.15.28:0/3123220398 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3600047d0 0x7fb3740bf670 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb364010950 tx=0x7fb364010e10 comp rx=0 tx=0).stop 2023-11-16T02:29:59.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.705+0000 7fb378887640 1 -- 172.21.15.28:0/3123220398 shutdown_connections 2023-11-16T02:29:59.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.705+0000 7fb378887640 1 --2- 172.21.15.28:0/3123220398 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb354065a90 0x7fb354067f50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.705+0000 7fb378887640 1 --2- 172.21.15.28:0/3123220398 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb374143f50 0x7fb3741dfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.705+0000 7fb378887640 1 --2- 172.21.15.28:0/3123220398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb374138be0 0x7fb374143a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.705+0000 7fb378887640 1 --2- 172.21.15.28:0/3123220398 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3600047d0 0x7fb3740bf670 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.705+0000 7fb378887640 1 -- 172.21.15.28:0/3123220398 >> 172.21.15.28:0/3123220398 conn(0x7fb37406b7e0 msgr2=0x7fb37413faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:59.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.705+0000 7fb378887640 1 -- 172.21.15.28:0/3123220398 shutdown_connections 2023-11-16T02:29:59.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.709+0000 7fb378887640 1 -- 172.21.15.28:0/3123220398 wait complete. 2023-11-16T02:29:59.727 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-16T02:29:59.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.841+0000 7f834a48c640 1 Processor -- start 2023-11-16T02:29:59.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.841+0000 7f834a48c640 1 -- start start 2023-11-16T02:29:59.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.841+0000 7f834a48c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f834406a170 0x7f83440b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:59.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.845+0000 7f834a48c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f83440b7c60 0x7f83440b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:59.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.845+0000 7f834a48c640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8344071800 con 0x7f834406a550 2023-11-16T02:29:59.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.845+0000 7f834a48c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83440b5ec0 con 0x7f834406a170 2023-11-16T02:29:59.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.845+0000 7f834a48c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83440b6350 con 0x7f83440b7c60 2023-11-16T02:29:59.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.845+0000 7f83437fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f834406a550 0x7f8344148a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:56040/0 (socket says 172.21.15.28:56040) 2023-11-16T02:29:59.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.845+0000 7f83437fe640 1 -- 172.21.15.28:0/651371918 learned_addr learned my addr 172.21.15.28:0/651371918 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:29:59.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.845+0000 7f8348a29640 1 --2- 172.21.15.28:0/651371918 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f83440b7c60 0x7f83440b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:59.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.845+0000 7f8343fff640 1 --2- 172.21.15.28:0/651371918 >> v2:172.21.15.70:3300/0 conn(0x7f834406a170 0x7f83440b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:59.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.845+0000 7f8342ffd640 1 -- 172.21.15.28:0/651371918 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774142667 0 0) 0x7f83380014a0 con 0x7f834406a550 2023-11-16T02:29:59.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.845+0000 7f8342ffd640 1 -- 172.21.15.28:0/651371918 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f832c003530 con 0x7f834406a550 2023-11-16T02:29:59.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.845+0000 7f8342ffd640 1 -- 172.21.15.28:0/651371918 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2075163497 0 0) 0x7f832c003530 con 0x7f834406a550 2023-11-16T02:29:59.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.845+0000 7f8348a29640 1 -- 172.21.15.28:0/651371918 >> v2:172.21.15.70:3300/0 conn(0x7f834406a170 msgr2=0x7f83440b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:29:59.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.845+0000 7f8348a29640 1 --2- 172.21.15.28:0/651371918 >> v2:172.21.15.70:3300/0 conn(0x7f834406a170 0x7f83440b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.845+0000 7f8348a29640 1 -- 172.21.15.28:0/651371918 >> v1:172.21.15.28:6789/0 conn(0x7f834406a550 legacy=0x7f8344148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:59.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.845+0000 7f8348a29640 1 -- 172.21.15.28:0/651371918 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83440b5870 con 0x7f83440b7c60 2023-11-16T02:29:59.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.845+0000 7f8348a29640 1 --2- 172.21.15.28:0/651371918 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f83440b7c60 0x7f83440b80d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f833c0097c0 tx=0x7f833c01c310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c034bdea0c70f949 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:59.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.845+0000 7f8342ffd640 1 -- 172.21.15.28:0/651371918 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8338001b90 con 0x7f83440b7c60 2023-11-16T02:29:59.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.845+0000 7f8342ffd640 1 -- 172.21.15.28:0/651371918 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833c0a7050 con 0x7f83440b7c60 2023-11-16T02:29:59.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.845+0000 7f8342ffd640 1 -- 172.21.15.28:0/651371918 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c0ab600 con 0x7f83440b7c60 2023-11-16T02:29:59.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f834a48c640 1 -- 172.21.15.28:0/651371918 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f83440b7c60 msgr2=0x7f83440b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:59.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f834a48c640 1 --2- 172.21.15.28:0/651371918 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f83440b7c60 0x7f83440b80d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f833c0097c0 tx=0x7f833c01c310 comp rx=0 tx=0).stop 2023-11-16T02:29:59.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f834a48c640 1 -- 172.21.15.28:0/651371918 shutdown_connections 2023-11-16T02:29:59.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f834a48c640 1 --2- 172.21.15.28:0/651371918 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f83440b7c60 0x7f83440b80d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f834a48c640 1 --2- 172.21.15.28:0/651371918 >> v2:172.21.15.70:3300/0 conn(0x7f834406a170 0x7f83440b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f834a48c640 1 -- 172.21.15.28:0/651371918 >> 172.21.15.28:0/651371918 conn(0x7f83440bc5a0 msgr2=0x7f83440bc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:29:59.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f834a48c640 1 -- 172.21.15.28:0/651371918 shutdown_connections 2023-11-16T02:29:59.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f834a48c640 1 -- 172.21.15.28:0/651371918 wait complete. 2023-11-16T02:29:59.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f834a48c640 1 Processor -- start 2023-11-16T02:29:59.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f834a48c640 1 -- start start 2023-11-16T02:29:59.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f834a48c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f834406a170 0x7f834414c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:59.854 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f834a48c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f834406a550 0x7f834414bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:59.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f834a48c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f83440b7c60 0x7f83441e0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:59.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f834a48c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834414c000 con 0x7f834406a550 2023-11-16T02:29:59.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f834a48c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8344141ed0 con 0x7f834406a170 2023-11-16T02:29:59.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f834a48c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83441437c0 con 0x7f83440b7c60 2023-11-16T02:29:59.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f83437fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f834406a550 0x7f834414bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:59.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f83437fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f834406a550 0x7f834414bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:47562/0 (socket says 172.21.15.28:47562) 2023-11-16T02:29:59.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f83437fe640 1 -- 172.21.15.28:0/3130979880 learned_addr learned my addr 172.21.15.28:0/3130979880 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:29:59.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f8348a29640 1 --2- 172.21.15.28:0/3130979880 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f83440b7c60 0x7f83441e0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:59.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f8343fff640 1 --2- 172.21.15.28:0/3130979880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f834406a170 0x7f834414c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:59.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f83437fe640 1 -- 172.21.15.28:0/3130979880 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f83440b7c60 msgr2=0x7f83441e0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:59.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f83437fe640 1 --2- 172.21.15.28:0/3130979880 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f83440b7c60 0x7f83441e0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f83437fe640 1 -- 172.21.15.28:0/3130979880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f834406a170 msgr2=0x7f834414c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:29:59.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f83437fe640 1 --2- 172.21.15.28:0/3130979880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f834406a170 0x7f834414c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:29:59.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f83437fe640 1 -- 172.21.15.28:0/3130979880 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833c009420 con 0x7f834406a550 2023-11-16T02:29:59.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f8343fff640 1 --2- 172.21.15.28:0/3130979880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f834406a170 0x7f834414c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:29:59.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f83437fe640 1 --2- 172.21.15.28:0/3130979880 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f834406a550 0x7f834414bac0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f833800cc90 tx=0x7f833800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:59.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f8340ff9640 1 -- 172.21.15.28:0/3130979880 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833800cea0 con 0x7f834406a550 2023-11-16T02:29:59.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f8340ff9640 1 -- 172.21.15.28:0/3130979880 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8338012400 con 0x7f834406a550 2023-11-16T02:29:59.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f8340ff9640 1 -- 172.21.15.28:0/3130979880 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83380127f0 con 0x7f834406a550 2023-11-16T02:29:59.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f834a48c640 1 -- 172.21.15.28:0/3130979880 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f834414a850 con 0x7f834406a550 2023-11-16T02:29:59.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f834a48c640 1 -- 172.21.15.28:0/3130979880 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8344073930 con 0x7f834406a550 2023-11-16T02:29:59.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.849+0000 7f834a48c640 1 -- 172.21.15.28:0/3130979880 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f834414aa70 con 0x7f834406a550 2023-11-16T02:29:59.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.853+0000 7f8340ff9640 1 -- 172.21.15.28:0/3130979880 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8338012950 con 0x7f834406a550 2023-11-16T02:29:59.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.853+0000 7f8340ff9640 1 --2- 172.21.15.28:0/3130979880 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8330065a60 0x7f8330067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:29:59.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.853+0000 7f8340ff9640 1 -- 172.21.15.28:0/3130979880 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8338083760 con 0x7f834406a550 2023-11-16T02:29:59.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.853+0000 7f8343fff640 1 --2- 172.21.15.28:0/3130979880 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8330065a60 0x7f8330067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:29:59.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.853+0000 7f8343fff640 1 --2- 172.21.15.28:0/3130979880 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8330065a60 0x7f8330067f20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8334009b10 tx=0x7f8334008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:29:59.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:29:59.857+0000 7f8340ff9640 1 -- 172.21.15.28:0/3130979880 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f8338051110 con 0x7f834406a550 2023-11-16T02:30:00.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.009+0000 7f834a48c640 1 -- 172.21.15.28:0/3130979880 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8344071800 con 0x7f834406a550 2023-11-16T02:30:00.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.009+0000 7f8340ff9640 1 -- 172.21.15.28:0/3130979880 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8344071800 con 0x7f834406a550 2023-11-16T02:30:00.014 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-11-16T02:30:00.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.013+0000 7f834a48c640 1 -- 172.21.15.28:0/3130979880 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8330065a60 msgr2=0x7f8330067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:00.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.013+0000 7f834a48c640 1 --2- 172.21.15.28:0/3130979880 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8330065a60 0x7f8330067f20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8334009b10 tx=0x7f8334008040 comp rx=0 tx=0).stop 2023-11-16T02:30:00.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.013+0000 7f834a48c640 1 -- 172.21.15.28:0/3130979880 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f834406a550 msgr2=0x7f834414bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:00.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.013+0000 7f834a48c640 1 --2- 172.21.15.28:0/3130979880 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f834406a550 0x7f834414bac0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f833800cc90 tx=0x7f833800a430 comp rx=0 tx=0).stop 2023-11-16T02:30:00.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.013+0000 7f834a48c640 1 -- 172.21.15.28:0/3130979880 shutdown_connections 2023-11-16T02:30:00.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.013+0000 7f834a48c640 1 --2- 172.21.15.28:0/3130979880 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8330065a60 0x7f8330067f20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.013+0000 7f834a48c640 1 --2- 172.21.15.28:0/3130979880 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f83440b7c60 0x7f83441e0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.013+0000 7f834a48c640 1 --2- 172.21.15.28:0/3130979880 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f834406a550 0x7f834414bac0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.013+0000 7f834a48c640 1 --2- 172.21.15.28:0/3130979880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f834406a170 0x7f834414c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.013+0000 7f834a48c640 1 -- 172.21.15.28:0/3130979880 >> 172.21.15.28:0/3130979880 conn(0x7f83440bc5a0 msgr2=0x7f834413e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:00.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.013+0000 7f834a48c640 1 -- 172.21.15.28:0/3130979880 shutdown_connections 2023-11-16T02:30:00.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.013+0000 7f834a48c640 1 -- 172.21.15.28:0/3130979880 wait complete. 2023-11-16T02:30:00.033 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-16T02:30:00.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.153+0000 7f4b2af1c640 1 Processor -- start 2023-11-16T02:30:00.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.153+0000 7f4b2af1c640 1 -- start start 2023-11-16T02:30:00.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.153+0000 7f4b2af1c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4b240b8240 0x7f4b240bc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:00.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.153+0000 7f4b2af1c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4b24148960 0x7f4b240b3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:00.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.153+0000 7f4b2af1c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b240b52b0 con 0x7f4b24148df0 2023-11-16T02:30:00.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.153+0000 7f4b2af1c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b240b6220 con 0x7f4b240b8240 2023-11-16T02:30:00.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.153+0000 7f4b2af1c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b240b4040 con 0x7f4b24148960 2023-11-16T02:30:00.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.153+0000 7f4b28cb8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4b240b8240 0x7f4b240bc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:00.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.153+0000 7f4b28cb8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4b240b8240 0x7f4b240bc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50046/0 (socket says 172.21.15.28:50046) 2023-11-16T02:30:00.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.153+0000 7f4b28cb8640 1 -- 172.21.15.28:0/1697271690 learned_addr learned my addr 172.21.15.28:0/1697271690 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:00.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.153+0000 7f4b28cb8640 1 -- 172.21.15.28:0/1697271690 >> v2:172.21.15.70:3300/0 conn(0x7f4b24148960 msgr2=0x7f4b240b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:00.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.153+0000 7f4b28cb8640 1 --2- 172.21.15.28:0/1697271690 >> v2:172.21.15.70:3300/0 conn(0x7f4b24148960 0x7f4b240b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.153+0000 7f4b28cb8640 1 -- 172.21.15.28:0/1697271690 >> v1:172.21.15.70:6789/0 conn(0x7f4b24148df0 legacy=0x7f4b2414bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:00.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.153+0000 7f4b28cb8640 1 -- 172.21.15.28:0/1697271690 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b240b5a20 con 0x7f4b240b8240 2023-11-16T02:30:00.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.153+0000 7f4b28cb8640 1 --2- 172.21.15.28:0/1697271690 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b240b8240 0x7f4b240bc6a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4b240bd040 tx=0x7f4b1801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d877fdcdf9ab52 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:00.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b237fe640 1 -- 172.21.15.28:0/1697271690 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b180ac600 con 0x7f4b240b8240 2023-11-16T02:30:00.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b237fe640 1 -- 172.21.15.28:0/1697271690 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b180a8050 con 0x7f4b240b8240 2023-11-16T02:30:00.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b237fe640 1 -- 172.21.15.28:0/1697271690 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b180ac980 con 0x7f4b240b8240 2023-11-16T02:30:00.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b2af1c640 1 -- 172.21.15.28:0/1697271690 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b240b8240 msgr2=0x7f4b240bc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:00.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b2af1c640 1 --2- 172.21.15.28:0/1697271690 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b240b8240 0x7f4b240bc6a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4b240bd040 tx=0x7f4b1801c490 comp rx=0 tx=0).stop 2023-11-16T02:30:00.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b2af1c640 1 -- 172.21.15.28:0/1697271690 shutdown_connections 2023-11-16T02:30:00.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b2af1c640 1 --2- 172.21.15.28:0/1697271690 >> v2:172.21.15.70:3300/0 conn(0x7f4b24148960 0x7f4b240b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b2af1c640 1 --2- 172.21.15.28:0/1697271690 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b240b8240 0x7f4b240bc6a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b2af1c640 1 -- 172.21.15.28:0/1697271690 >> 172.21.15.28:0/1697271690 conn(0x7f4b240b9050 msgr2=0x7f4b240bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:00.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b2af1c640 1 -- 172.21.15.28:0/1697271690 shutdown_connections 2023-11-16T02:30:00.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b2af1c640 1 -- 172.21.15.28:0/1697271690 wait complete. 2023-11-16T02:30:00.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b2af1c640 1 Processor -- start 2023-11-16T02:30:00.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b2af1c640 1 -- start start 2023-11-16T02:30:00.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b2af1c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b240b8240 0x7f4b241433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:00.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b2af1c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b24148960 0x7f4b24145430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:00.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b2af1c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4b24148df0 0x7f4b241e3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:00.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b2af1c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b24143e80 con 0x7f4b240b8240 2023-11-16T02:30:00.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b2af1c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b24143910 con 0x7f4b24148960 2023-11-16T02:30:00.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b2af1c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2413e050 con 0x7f4b24148df0 2023-11-16T02:30:00.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b28cb8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b240b8240 0x7f4b241433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:00.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b28cb8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b240b8240 0x7f4b241433d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50060/0 (socket says 172.21.15.28:50060) 2023-11-16T02:30:00.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b28cb8640 1 -- 172.21.15.28:0/1280939746 learned_addr learned my addr 172.21.15.28:0/1280939746 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:00.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b23fff640 1 --2- 172.21.15.28:0/1280939746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b24148960 0x7f4b24145430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:00.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b294b9640 1 --2- 172.21.15.28:0/1280939746 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4b24148df0 0x7f4b241e3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:00.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b28cb8640 1 -- 172.21.15.28:0/1280939746 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4b24148df0 msgr2=0x7f4b241e3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:00.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b28cb8640 1 --2- 172.21.15.28:0/1280939746 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4b24148df0 0x7f4b241e3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b28cb8640 1 -- 172.21.15.28:0/1280939746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b24148960 msgr2=0x7f4b24145430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:00.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b28cb8640 1 --2- 172.21.15.28:0/1280939746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b24148960 0x7f4b24145430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b28cb8640 1 -- 172.21.15.28:0/1280939746 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b180094d0 con 0x7f4b240b8240 2023-11-16T02:30:00.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b28cb8640 1 --2- 172.21.15.28:0/1280939746 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b240b8240 0x7f4b241433d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4b1801a0c0 tx=0x7f4b1801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:00.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b217fa640 1 -- 172.21.15.28:0/1280939746 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b180b7620 con 0x7f4b240b8240 2023-11-16T02:30:00.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b217fa640 1 -- 172.21.15.28:0/1280939746 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b180b7780 con 0x7f4b240b8240 2023-11-16T02:30:00.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b2af1c640 1 -- 172.21.15.28:0/1280939746 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b24144f00 con 0x7f4b240b8240 2023-11-16T02:30:00.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b217fa640 1 -- 172.21.15.28:0/1280939746 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b180b7af0 con 0x7f4b240b8240 2023-11-16T02:30:00.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.157+0000 7f4b2af1c640 1 -- 172.21.15.28:0/1280939746 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2413dce0 con 0x7f4b240b8240 2023-11-16T02:30:00.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.161+0000 7f4b2af1c640 1 -- 172.21.15.28:0/1280939746 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2413dae0 con 0x7f4b240b8240 2023-11-16T02:30:00.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.161+0000 7f4b217fa640 1 -- 172.21.15.28:0/1280939746 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4b180b3040 con 0x7f4b240b8240 2023-11-16T02:30:00.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.161+0000 7f4b217fa640 1 --2- 172.21.15.28:0/1280939746 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4b08065a60 0x7f4b08067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:00.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.161+0000 7f4b217fa640 1 -- 172.21.15.28:0/1280939746 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b1811d360 con 0x7f4b240b8240 2023-11-16T02:30:00.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.161+0000 7f4b23fff640 1 --2- 172.21.15.28:0/1280939746 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4b08065a60 0x7f4b08067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:00.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.161+0000 7f4b23fff640 1 --2- 172.21.15.28:0/1280939746 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4b08065a60 0x7f4b08067f20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4b10006fd0 tx=0x7f4b10008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:00.168 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.165+0000 7f4b217fa640 1 -- 172.21.15.28:0/1280939746 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f4b180eadb0 con 0x7f4b240b8240 2023-11-16T02:30:00.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.317+0000 7f4b2af1c640 1 -- 172.21.15.28:0/1280939746 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b2404e8a0 con 0x7f4b240b8240 2023-11-16T02:30:00.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.317+0000 7f4b217fa640 1 -- 172.21.15.28:0/1280939746 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f4b180ee3d0 con 0x7f4b240b8240 2023-11-16T02:30:00.322 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:30:00.323 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":22,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","created":"2023-11-16T02:29:13.710567+0000","modified":"2023-11-16T02:29:38.871066+0000","last_up_change":"2023-11-16T02:29:24.841087+0000","last_in_change":"2023-11-16T02:29:16.024490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-16T02:29:26.490910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-16T02:29:36.133224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-16T02:29:36.866156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dfa8b58d-3481-4e68-86e8-21873d31d0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":38722},{"type":"v1","addr":"172.21.15.28:6809","nonce":38722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":38722},{"type":"v1","addr":"172.21.15.28:6811","nonce":38722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":38722},{"type":"v1","addr":"172.21.15.28:6815","nonce":38722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":38722},{"type":"v1","addr":"172.21.15.28:6813","nonce":38722}]},"public_addr":"172.21.15.28:6809/38722","cluster_addr":"172.21.15.28:6811/38722","heartbeat_back_addr":"172.21.15.28:6815/38722","heartbeat_front_addr":"172.21.15.28:6813/38722","state":["exists","up"]},{"osd":1,"uuid":"1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":38724},{"type":"v1","addr":"172.21.15.28:6824","nonce":38724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":38724},{"type":"v1","addr":"172.21.15.28:6827","nonce":38724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":38724},{"type":"v1","addr":"172.21.15.28:6831","nonce":38724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":38724},{"type":"v1","addr":"172.21.15.28:6829","nonce":38724}]},"public_addr":"172.21.15.28:6824/38724","cluster_addr":"172.21.15.28:6827/38724","heartbeat_back_addr":"172.21.15.28:6831/38724","heartbeat_front_addr":"172.21.15.28:6829/38724","state":["exists","up"]},{"osd":2,"uuid":"e18f39cd-6a35-4d36-9eed-3877794bf2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":38723},{"type":"v1","addr":"172.21.15.28:6801","nonce":38723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":38723},{"type":"v1","addr":"172.21.15.28:6803","nonce":38723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":38723},{"type":"v1","addr":"172.21.15.28:6807","nonce":38723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":38723},{"type":"v1","addr":"172.21.15.28:6805","nonce":38723}]},"public_addr":"172.21.15.28:6801/38723","cluster_addr":"172.21.15.28:6803/38723","heartbeat_back_addr":"172.21.15.28:6807/38723","heartbeat_front_addr":"172.21.15.28:6805/38723","state":["exists","up"]},{"osd":3,"uuid":"303d0728-409d-47d7-b7a6-6eb273f602fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":38725},{"type":"v1","addr":"172.21.15.28:6817","nonce":38725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":38725},{"type":"v1","addr":"172.21.15.28:6819","nonce":38725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":38725},{"type":"v1","addr":"172.21.15.28:6825","nonce":38725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":38725},{"type":"v1","addr":"172.21.15.28:6821","nonce":38725}]},"public_addr":"172.21.15.28:6817/38725","cluster_addr":"172.21.15.28:6819/38725","heartbeat_back_addr":"172.21.15.28:6825/38725","heartbeat_front_addr":"172.21.15.28:6821/38725","state":["exists","up"]},{"osd":4,"uuid":"df0bf0ac-6efe-4964-ad27-7c1771a70c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":38828},{"type":"v1","addr":"172.21.15.70:6801","nonce":38828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":38828},{"type":"v1","addr":"172.21.15.70:6803","nonce":38828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":38828},{"type":"v1","addr":"172.21.15.70:6807","nonce":38828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":38828},{"type":"v1","addr":"172.21.15.70:6805","nonce":38828}]},"public_addr":"172.21.15.70:6801/38828","cluster_addr":"172.21.15.70:6803/38828","heartbeat_back_addr":"172.21.15.70:6807/38828","heartbeat_front_addr":"172.21.15.70:6805/38828","state":["exists","up"]},{"osd":5,"uuid":"84921219-65cb-4c4e-b9ed-a773db639034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":38830},{"type":"v1","addr":"172.21.15.70:6810","nonce":38830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6813","nonce":38830},{"type":"v1","addr":"172.21.15.70:6814","nonce":38830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":38830},{"type":"v1","addr":"172.21.15.70:6824","nonce":38830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":38830},{"type":"v1","addr":"172.21.15.70:6819","nonce":38830}]},"public_addr":"172.21.15.70:6810/38830","cluster_addr":"172.21.15.70:6814/38830","heartbeat_back_addr":"172.21.15.70:6824/38830","heartbeat_front_addr":"172.21.15.70:6819/38830","state":["exists","up"]},{"osd":6,"uuid":"c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":38829},{"type":"v1","addr":"172.21.15.70:6812","nonce":38829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":38829},{"type":"v1","addr":"172.21.15.70:6820","nonce":38829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":38829},{"type":"v1","addr":"172.21.15.70:6828","nonce":38829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":38829},{"type":"v1","addr":"172.21.15.70:6825","nonce":38829}]},"public_addr":"172.21.15.70:6812/38829","cluster_addr":"172.21.15.70:6820/38829","heartbeat_back_addr":"172.21.15.70:6828/38829","heartbeat_front_addr":"172.21.15.70:6825/38829","state":["exists","up"]},{"osd":7,"uuid":"e2cdd418-12ce-4eea-9b22-efdad83eb76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":38839},{"type":"v1","addr":"172.21.15.70:6815","nonce":38839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":38839},{"type":"v1","addr":"172.21.15.70:6823","nonce":38839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":38839},{"type":"v1","addr":"172.21.15.70:6831","nonce":38839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6827","nonce":38839},{"type":"v1","addr":"172.21.15.70:6829","nonce":38839}]},"public_addr":"172.21.15.70:6815/38839","cluster_addr":"172.21.15.70:6823/38839","heartbeat_back_addr":"172.21.15.70:6831/38839","heartbeat_front_addr":"172.21.15.70:6829/38839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.544240+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.637637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.352115+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.652916+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.624477+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.570247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.706468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.696574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-16T02:30:00.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.321+0000 7f4b2af1c640 1 -- 172.21.15.28:0/1280939746 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4b08065a60 msgr2=0x7f4b08067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:00.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.321+0000 7f4b2af1c640 1 --2- 172.21.15.28:0/1280939746 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4b08065a60 0x7f4b08067f20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4b10006fd0 tx=0x7f4b10008040 comp rx=0 tx=0).stop 2023-11-16T02:30:00.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.321+0000 7f4b2af1c640 1 -- 172.21.15.28:0/1280939746 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b240b8240 msgr2=0x7f4b241433d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:00.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.321+0000 7f4b2af1c640 1 --2- 172.21.15.28:0/1280939746 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b240b8240 0x7f4b241433d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4b1801a0c0 tx=0x7f4b1801acd0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.321+0000 7f4b2af1c640 1 -- 172.21.15.28:0/1280939746 shutdown_connections 2023-11-16T02:30:00.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.321+0000 7f4b2af1c640 1 --2- 172.21.15.28:0/1280939746 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4b08065a60 0x7f4b08067f20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.321+0000 7f4b2af1c640 1 --2- 172.21.15.28:0/1280939746 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4b24148df0 0x7f4b241e3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.321+0000 7f4b2af1c640 1 --2- 172.21.15.28:0/1280939746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b24148960 0x7f4b24145430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.321+0000 7f4b2af1c640 1 --2- 172.21.15.28:0/1280939746 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4b240b8240 0x7f4b241433d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.321+0000 7f4b2af1c640 1 -- 172.21.15.28:0/1280939746 >> 172.21.15.28:0/1280939746 conn(0x7f4b240b9050 msgr2=0x7f4b240ba040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:00.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.321+0000 7f4b2af1c640 1 -- 172.21.15.28:0/1280939746 shutdown_connections 2023-11-16T02:30:00.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.321+0000 7f4b2af1c640 1 -- 172.21.15.28:0/1280939746 wait complete. 2023-11-16T02:30:00.339 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-16T02:29:26.490910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-16T02:29:36.133224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-16T02:29:36.866156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-16T02:30:00.340 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-16T02:30:00.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.457+0000 7fc5aefe4640 1 Processor -- start 2023-11-16T02:30:00.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.457+0000 7fc5aefe4640 1 -- start start 2023-11-16T02:30:00.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5aefe4640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc5a806a3d0 0x7fc5a8071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:00.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5aefe4640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a814b1f0 con 0x7fc5a80702d0 2023-11-16T02:30:00.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5aefe4640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a814aec0 con 0x7fc5a81417e0 2023-11-16T02:30:00.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5aefe4640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5a814bd90 con 0x7fc5a806a3d0 2023-11-16T02:30:00.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5a7fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc5a80702d0 0x7fc5a814b680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37184/0 (socket says 172.21.15.28:37184) 2023-11-16T02:30:00.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5a7fff640 1 -- 172.21.15.28:0/2314710518 learned_addr learned my addr 172.21.15.28:0/2314710518 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:00.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5acd80640 1 --2- 172.21.15.28:0/2314710518 >> v2:172.21.15.70:3300/0 conn(0x7fc5a806a3d0 0x7fc5a8071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:00.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5a77fe640 1 -- 172.21.15.28:0/2314710518 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1051582327 0 0) 0x7fc5a814b1f0 con 0x7fc5a80702d0 2023-11-16T02:30:00.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5a77fe640 1 -- 172.21.15.28:0/2314710518 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc594003530 con 0x7fc5a80702d0 2023-11-16T02:30:00.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5a77fe640 1 -- 172.21.15.28:0/2314710518 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2235837962 0 0) 0x7fc594003530 con 0x7fc5a80702d0 2023-11-16T02:30:00.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5a77fe640 1 -- 172.21.15.28:0/2314710518 >> v2:172.21.15.70:3300/0 conn(0x7fc5a806a3d0 msgr2=0x7fc5a8071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:00.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5a77fe640 1 --2- 172.21.15.28:0/2314710518 >> v2:172.21.15.70:3300/0 conn(0x7fc5a806a3d0 0x7fc5a8071090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5a77fe640 1 -- 172.21.15.28:0/2314710518 >> v1:172.21.15.70:6789/0 conn(0x7fc5a81417e0 legacy=0x7fc5a81521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:00.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5a77fe640 1 -- 172.21.15.28:0/2314710518 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a80716b0 con 0x7fc5a80702d0 2023-11-16T02:30:00.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5a77fe640 1 -- 172.21.15.28:0/2314710518 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7fc598001680 con 0x7fc5a80702d0 2023-11-16T02:30:00.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5a77fe640 1 -- 172.21.15.28:0/2314710518 >> v1:172.21.15.28:6789/0 conn(0x7fc5a80702d0 legacy=0x7fc5a814b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:00.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5a77fe640 1 --2- 172.21.15.28:0/2314710518 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc594003980 0x7fc594003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:00.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5a77fe640 1 --2- 172.21.15.28:0/2314710518 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc5940047d0 0x7fc594004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:00.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5a77fe640 1 --2- 172.21.15.28:0/2314710518 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc594005190 0x7fc59400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:00.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5a77fe640 1 -- 172.21.15.28:0/2314710518 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a814bd90 con 0x7fc594003980 2023-11-16T02:30:00.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5a77fe640 1 -- 172.21.15.28:0/2314710518 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59400c030 con 0x7fc594005190 2023-11-16T02:30:00.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5a77fe640 1 -- 172.21.15.28:0/2314710518 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59400c1f0 con 0x7fc5940047d0 2023-11-16T02:30:00.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5acd80640 1 --2- 172.21.15.28:0/2314710518 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc594003980 0x7fc594003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:00.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5a7fff640 1 --2- 172.21.15.28:0/2314710518 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc5940047d0 0x7fc594004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:00.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5acd80640 1 -- 172.21.15.28:0/2314710518 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc5940047d0 msgr2=0x7fc594004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:00.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5acd80640 1 --2- 172.21.15.28:0/2314710518 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc5940047d0 0x7fc594004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5acd80640 1 -- 172.21.15.28:0/2314710518 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc594005190 msgr2=0x7fc59400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:00.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5ad581640 1 --2- 172.21.15.28:0/2314710518 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc594005190 0x7fc59400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:00.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5acd80640 1 --2- 172.21.15.28:0/2314710518 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc594005190 0x7fc59400b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5acd80640 1 -- 172.21.15.28:0/2314710518 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc594003530 con 0x7fc594003980 2023-11-16T02:30:00.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.461+0000 7fc5ad581640 1 -- 172.21.15.28:0/2314710518 reap_dead start 2023-11-16T02:30:00.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5acd80640 1 --2- 172.21.15.28:0/2314710518 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc594003980 0x7fc594003da0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0009fc0 tx=0x7fc5a001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c94846b82c9611 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:00.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5a77fe640 1 -- 172.21.15.28:0/2314710518 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a00a5b70 con 0x7fc594003980 2023-11-16T02:30:00.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5a77fe640 1 -- 172.21.15.28:0/2314710518 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a000f040 con 0x7fc594003980 2023-11-16T02:30:00.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5a77fe640 1 -- 172.21.15.28:0/2314710518 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a00ad440 con 0x7fc594003980 2023-11-16T02:30:00.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5aefe4640 1 -- 172.21.15.28:0/2314710518 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc594003980 msgr2=0x7fc594003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:00.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5aefe4640 1 --2- 172.21.15.28:0/2314710518 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc594003980 0x7fc594003da0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0009fc0 tx=0x7fc5a001cc10 comp rx=0 tx=0).stop 2023-11-16T02:30:00.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5aefe4640 1 -- 172.21.15.28:0/2314710518 shutdown_connections 2023-11-16T02:30:00.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5aefe4640 1 --2- 172.21.15.28:0/2314710518 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc594003980 0x7fc594003da0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5aefe4640 1 -- 172.21.15.28:0/2314710518 >> 172.21.15.28:0/2314710518 conn(0x7fc5a80bc5a0 msgr2=0x7fc5a80bc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:00.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5aefe4640 1 -- 172.21.15.28:0/2314710518 shutdown_connections 2023-11-16T02:30:00.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5aefe4640 1 -- 172.21.15.28:0/2314710518 wait complete. 2023-11-16T02:30:00.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5aefe4640 1 Processor -- start 2023-11-16T02:30:00.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5aefe4640 1 -- start start 2023-11-16T02:30:00.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5aefe4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc594003980 0x7fc5a80bb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:00.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5aefe4640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc5a80b5b70 0x7fc5a81e2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:00.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5aefe4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5a81e2d70 0x7fc5a81365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:00.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5aefe4640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a80bbbb0 con 0x7fc594003980 2023-11-16T02:30:00.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5aefe4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a80b4a30 con 0x7fc5a81e2d70 2023-11-16T02:30:00.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5aefe4640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a81e31f0 con 0x7fc5a80b5b70 2023-11-16T02:30:00.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5acd80640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc594003980 0x7fc5a80bb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:00.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5acd80640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc594003980 0x7fc5a80bb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50078/0 (socket says 172.21.15.28:50078) 2023-11-16T02:30:00.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5acd80640 1 -- 172.21.15.28:0/3022674348 learned_addr learned my addr 172.21.15.28:0/3022674348 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:00.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5a7fff640 1 --2- 172.21.15.28:0/3022674348 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc5a80b5b70 0x7fc5a81e2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:00.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5acd80640 1 -- 172.21.15.28:0/3022674348 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc5a80b5b70 msgr2=0x7fc5a81e2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:00.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5acd80640 1 --2- 172.21.15.28:0/3022674348 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc5a80b5b70 0x7fc5a81e2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5acd80640 1 -- 172.21.15.28:0/3022674348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5a81e2d70 msgr2=0x7fc5a81365a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:00.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5acd80640 1 --2- 172.21.15.28:0/3022674348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5a81e2d70 0x7fc5a81365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5acd80640 1 -- 172.21.15.28:0/3022674348 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a813f3b0 con 0x7fc594003980 2023-11-16T02:30:00.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5acd80640 1 --2- 172.21.15.28:0/3022674348 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc594003980 0x7fc5a80bb670 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc5a00b0040 tx=0x7fc5a0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:00.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5a57fa640 1 -- 172.21.15.28:0/3022674348 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0003ba0 con 0x7fc594003980 2023-11-16T02:30:00.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5a57fa640 1 -- 172.21.15.28:0/3022674348 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a0003d00 con 0x7fc594003980 2023-11-16T02:30:00.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5aefe4640 1 -- 172.21.15.28:0/3022674348 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a80b4c80 con 0x7fc594003980 2023-11-16T02:30:00.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5a57fa640 1 -- 172.21.15.28:0/3022674348 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0004240 con 0x7fc594003980 2023-11-16T02:30:00.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.465+0000 7fc5aefe4640 1 -- 172.21.15.28:0/3022674348 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a80b6330 con 0x7fc594003980 2023-11-16T02:30:00.474 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.469+0000 7fc5aefe4640 1 -- 172.21.15.28:0/3022674348 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a804e8a0 con 0x7fc594003980 2023-11-16T02:30:00.474 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.469+0000 7fc5a57fa640 1 -- 172.21.15.28:0/3022674348 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc5a00b4040 con 0x7fc594003980 2023-11-16T02:30:00.474 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.469+0000 7fc5a57fa640 1 --2- 172.21.15.28:0/3022674348 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc588065a60 0x7fc588067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:00.474 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.469+0000 7fc5a57fa640 1 -- 172.21.15.28:0/3022674348 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5a011d760 con 0x7fc594003980 2023-11-16T02:30:00.475 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.469+0000 7fc5a7fff640 1 --2- 172.21.15.28:0/3022674348 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc588065a60 0x7fc588067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:00.475 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.469+0000 7fc5a7fff640 1 --2- 172.21.15.28:0/3022674348 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc588065a60 0x7fc588067f20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc598001c90 tx=0x7fc598009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:00.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.473+0000 7fc5a57fa640 1 -- 172.21.15.28:0/3022674348 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fc5a00eb380 con 0x7fc594003980 2023-11-16T02:30:00.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.629+0000 7fc5aefe4640 1 -- 172.21.15.28:0/3022674348 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc5a8073590 con 0x7fc594003980 2023-11-16T02:30:00.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.629+0000 7fc5a57fa640 1 -- 172.21.15.28:0/3022674348 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc5a00ee9a0 con 0x7fc594003980 2023-11-16T02:30:00.633 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-11-16T02:30:00.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.633+0000 7fc5aefe4640 1 -- 172.21.15.28:0/3022674348 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc588065a60 msgr2=0x7fc588067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:00.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.633+0000 7fc5aefe4640 1 --2- 172.21.15.28:0/3022674348 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc588065a60 0x7fc588067f20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc598001c90 tx=0x7fc598009040 comp rx=0 tx=0).stop 2023-11-16T02:30:00.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.633+0000 7fc5aefe4640 1 -- 172.21.15.28:0/3022674348 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc594003980 msgr2=0x7fc5a80bb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:00.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.633+0000 7fc5aefe4640 1 --2- 172.21.15.28:0/3022674348 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc594003980 0x7fc5a80bb670 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc5a00b0040 tx=0x7fc5a0009750 comp rx=0 tx=0).stop 2023-11-16T02:30:00.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.633+0000 7fc5aefe4640 1 -- 172.21.15.28:0/3022674348 shutdown_connections 2023-11-16T02:30:00.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.633+0000 7fc5aefe4640 1 --2- 172.21.15.28:0/3022674348 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc588065a60 0x7fc588067f20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.633+0000 7fc5aefe4640 1 --2- 172.21.15.28:0/3022674348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5a81e2d70 0x7fc5a81365a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.633+0000 7fc5aefe4640 1 --2- 172.21.15.28:0/3022674348 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc5a80b5b70 0x7fc5a81e2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.633+0000 7fc5aefe4640 1 --2- 172.21.15.28:0/3022674348 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc594003980 0x7fc5a80bb670 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.633+0000 7fc5aefe4640 1 -- 172.21.15.28:0/3022674348 >> 172.21.15.28:0/3022674348 conn(0x7fc5a80bc5a0 msgr2=0x7fc5a806ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:00.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.633+0000 7fc5aefe4640 1 -- 172.21.15.28:0/3022674348 shutdown_connections 2023-11-16T02:30:00.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.633+0000 7fc5aefe4640 1 -- 172.21.15.28:0/3022674348 wait complete. 2023-11-16T02:30:00.652 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-16T02:30:00.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.769+0000 7fd0fd1f3640 1 Processor -- start 2023-11-16T02:30:00.773 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.769+0000 7fd0fd1f3640 1 -- start start 2023-11-16T02:30:00.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.769+0000 7fd0fd1f3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd0f80ba410 0x7fd0f814e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:00.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.769+0000 7fd0fd1f3640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f80ba840 con 0x7fd0f80b8a50 2023-11-16T02:30:00.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.769+0000 7fd0fd1f3640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f80b78a0 con 0x7fd0f81415b0 2023-11-16T02:30:00.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.769+0000 7fd0fd1f3640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0f80ba060 con 0x7fd0f80ba410 2023-11-16T02:30:00.775 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.769+0000 7fd0f659c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd0f80b8a50 0x7fd0f814e0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37192/0 (socket says 172.21.15.28:37192) 2023-11-16T02:30:00.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.769+0000 7fd0f659c640 1 -- 172.21.15.28:0/3127818824 learned_addr learned my addr 172.21.15.28:0/3127818824 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:00.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.769+0000 7fd0f759e640 1 --2- 172.21.15.28:0/3127818824 >> v2:172.21.15.70:3300/0 conn(0x7fd0f80ba410 0x7fd0f814e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:00.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.769+0000 7fd0f5d9b640 1 -- 172.21.15.28:0/3127818824 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1838142338 0 0) 0x7fd0f80ba840 con 0x7fd0f80b8a50 2023-11-16T02:30:00.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.769+0000 7fd0f5d9b640 1 -- 172.21.15.28:0/3127818824 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0e0003530 con 0x7fd0f80b8a50 2023-11-16T02:30:00.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.769+0000 7fd0f5d9b640 1 -- 172.21.15.28:0/3127818824 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4145081033 0 0) 0x7fd0e0003530 con 0x7fd0f80b8a50 2023-11-16T02:30:00.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.769+0000 7fd0f5d9b640 1 -- 172.21.15.28:0/3127818824 >> v2:172.21.15.70:3300/0 conn(0x7fd0f80ba410 msgr2=0x7fd0f814e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:00.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.769+0000 7fd0f5d9b640 1 --2- 172.21.15.28:0/3127818824 >> v2:172.21.15.70:3300/0 conn(0x7fd0f80ba410 0x7fd0f814e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.769+0000 7fd0f5d9b640 1 -- 172.21.15.28:0/3127818824 >> v1:172.21.15.70:6789/0 conn(0x7fd0f81415b0 legacy=0x7fd0f80b8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:00.776 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.769+0000 7fd0f5d9b640 1 -- 172.21.15.28:0/3127818824 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f814f000 con 0x7fd0f80b8a50 2023-11-16T02:30:00.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.769+0000 7fd0f5d9b640 1 -- 172.21.15.28:0/3127818824 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7fd0ec001680 con 0x7fd0f80b8a50 2023-11-16T02:30:00.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.769+0000 7fd0f5d9b640 1 -- 172.21.15.28:0/3127818824 >> v1:172.21.15.28:6789/0 conn(0x7fd0f80b8a50 legacy=0x7fd0f814e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:00.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.769+0000 7fd0f5d9b640 1 --2- 172.21.15.28:0/3127818824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0e00039d0 0x7fd0e0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:00.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.769+0000 7fd0f5d9b640 1 --2- 172.21.15.28:0/3127818824 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd0e00047d0 0x7fd0e0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:00.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.769+0000 7fd0f5d9b640 1 --2- 172.21.15.28:0/3127818824 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0e0005190 0x7fd0e000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:00.777 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.769+0000 7fd0f5d9b640 1 -- 172.21.15.28:0/3127818824 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e000c060 con 0x7fd0e0005190 2023-11-16T02:30:00.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.769+0000 7fd0f5d9b640 1 -- 172.21.15.28:0/3127818824 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e000c1d0 con 0x7fd0e00039d0 2023-11-16T02:30:00.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.769+0000 7fd0f5d9b640 1 -- 172.21.15.28:0/3127818824 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e000c390 con 0x7fd0e00047d0 2023-11-16T02:30:00.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.773+0000 7fd0f759e640 1 --2- 172.21.15.28:0/3127818824 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0e0005190 0x7fd0e000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:00.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.773+0000 7fd0f6d9d640 1 --2- 172.21.15.28:0/3127818824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0e00039d0 0x7fd0e0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:00.779 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.773+0000 7fd0f659c640 1 --2- 172.21.15.28:0/3127818824 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd0e00047d0 0x7fd0e0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:00.779 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.773+0000 7fd0f759e640 1 -- 172.21.15.28:0/3127818824 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd0e00047d0 msgr2=0x7fd0e0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:00.779 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.773+0000 7fd0f759e640 1 --2- 172.21.15.28:0/3127818824 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd0e00047d0 0x7fd0e0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.779 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.773+0000 7fd0f759e640 1 -- 172.21.15.28:0/3127818824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0e00039d0 msgr2=0x7fd0e0003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:00.779 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.773+0000 7fd0f759e640 1 --2- 172.21.15.28:0/3127818824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0e00039d0 0x7fd0e0003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.779 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.773+0000 7fd0f759e640 1 -- 172.21.15.28:0/3127818824 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e0003530 con 0x7fd0e0005190 2023-11-16T02:30:00.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.773+0000 7fd0f759e640 1 -- 172.21.15.28:0/3127818824 reap_dead start 2023-11-16T02:30:00.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.773+0000 7fd0f759e640 1 --2- 172.21.15.28:0/3127818824 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0e0005190 0x7fd0e000b990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0009fc0 tx=0x7fd0f001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f6a7ffe14489cf2 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:00.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.773+0000 7fd0f5d9b640 1 -- 172.21.15.28:0/3127818824 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f00a5cb0 con 0x7fd0e0005190 2023-11-16T02:30:00.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.773+0000 7fd0f5d9b640 1 -- 172.21.15.28:0/3127818824 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f000f040 con 0x7fd0e0005190 2023-11-16T02:30:00.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.773+0000 7fd0f5d9b640 1 -- 172.21.15.28:0/3127818824 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0003be0 con 0x7fd0e0005190 2023-11-16T02:30:00.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.773+0000 7fd0fd1f3640 1 -- 172.21.15.28:0/3127818824 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0e0005190 msgr2=0x7fd0e000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:00.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.773+0000 7fd0fd1f3640 1 --2- 172.21.15.28:0/3127818824 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0e0005190 0x7fd0e000b990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd0f0009fc0 tx=0x7fd0f001cca0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.773+0000 7fd0fd1f3640 1 -- 172.21.15.28:0/3127818824 shutdown_connections 2023-11-16T02:30:00.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.773+0000 7fd0fd1f3640 1 --2- 172.21.15.28:0/3127818824 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0e0005190 0x7fd0e000b990 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.773+0000 7fd0fd1f3640 1 -- 172.21.15.28:0/3127818824 >> 172.21.15.28:0/3127818824 conn(0x7fd0f806b7e0 msgr2=0x7fd0f806bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:00.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.773+0000 7fd0fd1f3640 1 -- 172.21.15.28:0/3127818824 shutdown_connections 2023-11-16T02:30:00.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.773+0000 7fd0fd1f3640 1 -- 172.21.15.28:0/3127818824 wait complete. 2023-11-16T02:30:00.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0fd1f3640 1 Processor -- start 2023-11-16T02:30:00.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0fd1f3640 1 -- start start 2023-11-16T02:30:00.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0fd1f3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0e0005190 0x7fd0f813c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:00.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0fd1f3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0f8147820 0x7fd0f81e35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:00.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0fd1f3640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd0f81446e0 0x7fd0f813ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:00.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0fd1f3640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f813c600 con 0x7fd0e0005190 2023-11-16T02:30:00.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0fd1f3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f81e2e60 con 0x7fd0f8147820 2023-11-16T02:30:00.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0fd1f3640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f8147ce0 con 0x7fd0f81446e0 2023-11-16T02:30:00.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0f6d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0e0005190 0x7fd0f813c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:00.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0f6d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0e0005190 0x7fd0f813c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50090/0 (socket says 172.21.15.28:50090) 2023-11-16T02:30:00.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0f6d9d640 1 -- 172.21.15.28:0/545006965 learned_addr learned my addr 172.21.15.28:0/545006965 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:00.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0f659c640 1 --2- 172.21.15.28:0/545006965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0f8147820 0x7fd0f81e35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:00.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0f759e640 1 --2- 172.21.15.28:0/545006965 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd0f81446e0 0x7fd0f813ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:00.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0f6d9d640 1 -- 172.21.15.28:0/545006965 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd0f81446e0 msgr2=0x7fd0f813ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:00.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0f6d9d640 1 --2- 172.21.15.28:0/545006965 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd0f81446e0 0x7fd0f813ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0f6d9d640 1 -- 172.21.15.28:0/545006965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0f8147820 msgr2=0x7fd0f81e35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:00.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0f6d9d640 1 --2- 172.21.15.28:0/545006965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0f8147820 0x7fd0f81e35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0f6d9d640 1 -- 172.21.15.28:0/545006965 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f8144bc0 con 0x7fd0e0005190 2023-11-16T02:30:00.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0f659c640 1 --2- 172.21.15.28:0/545006965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0f8147820 0x7fd0f81e35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:30:00.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0f6d9d640 1 --2- 172.21.15.28:0/545006965 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0e0005190 0x7fd0f813c0c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd0e800f620 tx=0x7fd0e800fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:00.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0df7fe640 1 -- 172.21.15.28:0/545006965 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e80052e0 con 0x7fd0e0005190 2023-11-16T02:30:00.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0df7fe640 1 -- 172.21.15.28:0/545006965 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e8005440 con 0x7fd0e0005190 2023-11-16T02:30:00.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0fd1f3640 1 -- 172.21.15.28:0/545006965 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0f81e30d0 con 0x7fd0e0005190 2023-11-16T02:30:00.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0df7fe640 1 -- 172.21.15.28:0/545006965 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e8003820 con 0x7fd0e0005190 2023-11-16T02:30:00.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0fd1f3640 1 -- 172.21.15.28:0/545006965 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f8144ea0 con 0x7fd0e0005190 2023-11-16T02:30:00.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0fd1f3640 1 -- 172.21.15.28:0/545006965 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0f81450c0 con 0x7fd0e0005190 2023-11-16T02:30:00.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.777+0000 7fd0df7fe640 1 -- 172.21.15.28:0/545006965 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd0e8003980 con 0x7fd0e0005190 2023-11-16T02:30:00.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.781+0000 7fd0df7fe640 1 --2- 172.21.15.28:0/545006965 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fd0e4065a60 0x7fd0e4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:00.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.781+0000 7fd0df7fe640 1 -- 172.21.15.28:0/545006965 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0e8083070 con 0x7fd0e0005190 2023-11-16T02:30:00.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.781+0000 7fd0f659c640 1 --2- 172.21.15.28:0/545006965 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fd0e4065a60 0x7fd0e4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:00.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.781+0000 7fd0f659c640 1 --2- 172.21.15.28:0/545006965 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fd0e4065a60 0x7fd0e4067f20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd0f813e440 tx=0x7fd0ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:00.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.785+0000 7fd0df7fe640 1 -- 172.21.15.28:0/545006965 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fd0f81450c0 con 0x7fd0e0005190 2023-11-16T02:30:00.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.933+0000 7fd0fd1f3640 1 -- 172.21.15.28:0/545006965 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd0f81450c0 con 0x7fd0e0005190 2023-11-16T02:30:00.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.933+0000 7fd0df7fe640 1 -- 172.21.15.28:0/545006965 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd0f81450c0 con 0x7fd0e0005190 2023-11-16T02:30:00.936 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-11-16T02:30:00.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.933+0000 7fd0fd1f3640 1 -- 172.21.15.28:0/545006965 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fd0e4065a60 msgr2=0x7fd0e4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:00.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.933+0000 7fd0fd1f3640 1 --2- 172.21.15.28:0/545006965 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fd0e4065a60 0x7fd0e4067f20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd0f813e440 tx=0x7fd0ec009040 comp rx=0 tx=0).stop 2023-11-16T02:30:00.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.933+0000 7fd0fd1f3640 1 -- 172.21.15.28:0/545006965 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0e0005190 msgr2=0x7fd0f813c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:00.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.933+0000 7fd0fd1f3640 1 --2- 172.21.15.28:0/545006965 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0e0005190 0x7fd0f813c0c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd0e800f620 tx=0x7fd0e800fae0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.933+0000 7fd0fd1f3640 1 -- 172.21.15.28:0/545006965 shutdown_connections 2023-11-16T02:30:00.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.933+0000 7fd0fd1f3640 1 --2- 172.21.15.28:0/545006965 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fd0e4065a60 0x7fd0e4067f20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.933+0000 7fd0fd1f3640 1 --2- 172.21.15.28:0/545006965 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd0f81446e0 0x7fd0f813ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.933+0000 7fd0fd1f3640 1 --2- 172.21.15.28:0/545006965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0f8147820 0x7fd0f81e35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.933+0000 7fd0fd1f3640 1 --2- 172.21.15.28:0/545006965 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd0e0005190 0x7fd0f813c0c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:00.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.933+0000 7fd0fd1f3640 1 -- 172.21.15.28:0/545006965 >> 172.21.15.28:0/545006965 conn(0x7fd0f806b7e0 msgr2=0x7fd0f80baa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:00.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.933+0000 7fd0fd1f3640 1 -- 172.21.15.28:0/545006965 shutdown_connections 2023-11-16T02:30:00.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:00.933+0000 7fd0fd1f3640 1 -- 172.21.15.28:0/545006965 wait complete. 2023-11-16T02:30:00.953 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-16T02:30:01.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.077+0000 7f9fe7788640 1 Processor -- start 2023-11-16T02:30:01.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.077+0000 7f9fe7788640 1 -- start start 2023-11-16T02:30:01.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.077+0000 7f9fe7788640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9fe006a3d0 0x7f9fe0071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:01.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.077+0000 7f9fe7788640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9fe00702d0 0x7f9fe014b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:01.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.077+0000 7f9fe7788640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f9fe01417e0 0x7f9fe0141c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:01.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.077+0000 7f9fe7788640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe014b1f0 con 0x7f9fe00702d0 2023-11-16T02:30:01.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.077+0000 7f9fe7788640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe014aec0 con 0x7f9fe01417e0 2023-11-16T02:30:01.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.077+0000 7f9fe7788640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe00716b0 con 0x7f9fe006a3d0 2023-11-16T02:30:01.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.077+0000 7f9fe4d23640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9fe00702d0 0x7f9fe014b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:01.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.077+0000 7f9fe4d23640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9fe00702d0 0x7f9fe014b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50092/0 (socket says 172.21.15.28:50092) 2023-11-16T02:30:01.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.077+0000 7f9fe4d23640 1 -- 172.21.15.28:0/4179995337 learned_addr learned my addr 172.21.15.28:0/4179995337 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:01.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.077+0000 7f9fe5d25640 1 --2- 172.21.15.28:0/4179995337 >> v2:172.21.15.70:3300/0 conn(0x7f9fe01417e0 0x7f9fe0141c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:01.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.077+0000 7f9fe5524640 1 --2- 172.21.15.28:0/4179995337 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9fe006a3d0 0x7f9fe0071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:01.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.077+0000 7f9fe4d23640 1 -- 172.21.15.28:0/4179995337 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9fe006a3d0 msgr2=0x7f9fe0071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:01.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.077+0000 7f9fe4d23640 1 --2- 172.21.15.28:0/4179995337 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9fe006a3d0 0x7f9fe0071090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.077+0000 7f9fe4d23640 1 -- 172.21.15.28:0/4179995337 >> v2:172.21.15.70:3300/0 conn(0x7f9fe01417e0 msgr2=0x7f9fe0141c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:01.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.077+0000 7f9fe4d23640 1 --2- 172.21.15.28:0/4179995337 >> v2:172.21.15.70:3300/0 conn(0x7f9fe01417e0 0x7f9fe0141c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.077+0000 7f9fe4d23640 1 -- 172.21.15.28:0/4179995337 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe006a7b0 con 0x7f9fe00702d0 2023-11-16T02:30:01.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.081+0000 7f9fe4d23640 1 --2- 172.21.15.28:0/4179995337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fe00702d0 0x7f9fe014b680 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9fe006b520 tx=0x7f9fd001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8471e4ba91376c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:01.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.081+0000 7f9fd7fff640 1 -- 172.21.15.28:0/4179995337 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd00ad640 con 0x7f9fe00702d0 2023-11-16T02:30:01.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.081+0000 7f9fd7fff640 1 -- 172.21.15.28:0/4179995337 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd00ad7a0 con 0x7f9fe00702d0 2023-11-16T02:30:01.084 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.081+0000 7f9fd7fff640 1 -- 172.21.15.28:0/4179995337 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd00adb30 con 0x7f9fe00702d0 2023-11-16T02:30:01.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.081+0000 7f9fe7788640 1 -- 172.21.15.28:0/4179995337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fe00702d0 msgr2=0x7f9fe014b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:01.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.081+0000 7f9fe7788640 1 --2- 172.21.15.28:0/4179995337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fe00702d0 0x7f9fe014b680 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9fe006b520 tx=0x7f9fd001c500 comp rx=0 tx=0).stop 2023-11-16T02:30:01.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.081+0000 7f9fe7788640 1 -- 172.21.15.28:0/4179995337 shutdown_connections 2023-11-16T02:30:01.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.081+0000 7f9fe7788640 1 --2- 172.21.15.28:0/4179995337 >> v2:172.21.15.70:3300/0 conn(0x7f9fe01417e0 0x7f9fe0141c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.081+0000 7f9fe7788640 1 --2- 172.21.15.28:0/4179995337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fe00702d0 0x7f9fe014b680 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.081+0000 7f9fe7788640 1 --2- 172.21.15.28:0/4179995337 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9fe006a3d0 0x7f9fe0071090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.081+0000 7f9fe7788640 1 -- 172.21.15.28:0/4179995337 >> 172.21.15.28:0/4179995337 conn(0x7f9fe00bc5a0 msgr2=0x7f9fe00bc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:01.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.081+0000 7f9fe7788640 1 -- 172.21.15.28:0/4179995337 shutdown_connections 2023-11-16T02:30:01.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.081+0000 7f9fe7788640 1 -- 172.21.15.28:0/4179995337 wait complete. 2023-11-16T02:30:01.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.081+0000 7f9fe7788640 1 Processor -- start 2023-11-16T02:30:01.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.081+0000 7f9fe7788640 1 -- start start 2023-11-16T02:30:01.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.081+0000 7f9fe7788640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9fe006a3d0 0x7f9fe00b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:01.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.081+0000 7f9fe7788640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fe00702d0 0x7f9fe01e32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:01.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.081+0000 7f9fe7788640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9fe01417e0 0x7f9fe0150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:01.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.081+0000 7f9fe7788640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe00ba670 con 0x7f9fe00702d0 2023-11-16T02:30:01.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.081+0000 7f9fe7788640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe00b60e0 con 0x7f9fe01417e0 2023-11-16T02:30:01.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.081+0000 7f9fe7788640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe00bbda0 con 0x7f9fe006a3d0 2023-11-16T02:30:01.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.081+0000 7f9fe4d23640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fe00702d0 0x7f9fe01e32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:01.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.081+0000 7f9fe4d23640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fe00702d0 0x7f9fe01e32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50106/0 (socket says 172.21.15.28:50106) 2023-11-16T02:30:01.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.081+0000 7f9fe4d23640 1 -- 172.21.15.28:0/736112119 learned_addr learned my addr 172.21.15.28:0/736112119 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:01.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.081+0000 7f9fe5524640 1 --2- 172.21.15.28:0/736112119 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9fe006a3d0 0x7f9fe00b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:01.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.081+0000 7f9fe5d25640 1 --2- 172.21.15.28:0/736112119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9fe01417e0 0x7f9fe0150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:01.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.085+0000 7f9fe4d23640 1 -- 172.21.15.28:0/736112119 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9fe006a3d0 msgr2=0x7f9fe00b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:01.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.085+0000 7f9fe4d23640 1 --2- 172.21.15.28:0/736112119 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9fe006a3d0 0x7f9fe00b5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.085+0000 7f9fe4d23640 1 -- 172.21.15.28:0/736112119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9fe01417e0 msgr2=0x7f9fe0150b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:01.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.085+0000 7f9fe4d23640 1 --2- 172.21.15.28:0/736112119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9fe01417e0 0x7f9fe0150b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.085+0000 7f9fe4d23640 1 -- 172.21.15.28:0/736112119 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd00094d0 con 0x7f9fe00702d0 2023-11-16T02:30:01.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.085+0000 7f9fe5d25640 1 --2- 172.21.15.28:0/736112119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9fe01417e0 0x7f9fe0150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:30:01.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.085+0000 7f9fe4d23640 1 --2- 172.21.15.28:0/736112119 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fe00702d0 0x7f9fe01e32a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0000c10 tx=0x7f9fd00192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:01.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.085+0000 7f9fd5ffb640 1 -- 172.21.15.28:0/736112119 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd00b6630 con 0x7f9fe00702d0 2023-11-16T02:30:01.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.085+0000 7f9fd5ffb640 1 -- 172.21.15.28:0/736112119 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd00a6050 con 0x7f9fe00702d0 2023-11-16T02:30:01.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.085+0000 7f9fe7788640 1 -- 172.21.15.28:0/736112119 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe00bbac0 con 0x7f9fe00702d0 2023-11-16T02:30:01.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.085+0000 7f9fd5ffb640 1 -- 172.21.15.28:0/736112119 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd00b69b0 con 0x7f9fe00702d0 2023-11-16T02:30:01.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.085+0000 7f9fe7788640 1 -- 172.21.15.28:0/736112119 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe01e2d80 con 0x7f9fe00702d0 2023-11-16T02:30:01.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.085+0000 7f9fe7788640 1 -- 172.21.15.28:0/736112119 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe01e2f70 con 0x7f9fe00702d0 2023-11-16T02:30:01.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.085+0000 7f9fd5ffb640 1 -- 172.21.15.28:0/736112119 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9fd00b4040 con 0x7f9fe00702d0 2023-11-16T02:30:01.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.085+0000 7f9fd5ffb640 1 --2- 172.21.15.28:0/736112119 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f9fc4065a90 0x7f9fc4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:01.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.085+0000 7f9fd5ffb640 1 -- 172.21.15.28:0/736112119 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9fd011d1e0 con 0x7f9fe00702d0 2023-11-16T02:30:01.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.085+0000 7f9fe5524640 1 --2- 172.21.15.28:0/736112119 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f9fc4065a90 0x7f9fc4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:01.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.085+0000 7f9fe5524640 1 --2- 172.21.15.28:0/736112119 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f9fc4065a90 0x7f9fc4067f50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0045f0 tx=0x7f9fdc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:01.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.089+0000 7f9fd5ffb640 1 -- 172.21.15.28:0/736112119 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f9fd00eab80 con 0x7f9fe00702d0 2023-11-16T02:30:01.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.237+0000 7f9fe7788640 1 -- 172.21.15.28:0/736112119 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9fe004e8a0 con 0x7f9fe00702d0 2023-11-16T02:30:01.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.237+0000 7f9fd5ffb640 1 -- 172.21.15.28:0/736112119 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9fd00b20a0 con 0x7f9fe00702d0 2023-11-16T02:30:01.241 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-11-16T02:30:01.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.237+0000 7f9fe7788640 1 -- 172.21.15.28:0/736112119 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f9fc4065a90 msgr2=0x7f9fc4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:01.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.237+0000 7f9fe7788640 1 --2- 172.21.15.28:0/736112119 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f9fc4065a90 0x7f9fc4067f50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc0045f0 tx=0x7f9fdc008040 comp rx=0 tx=0).stop 2023-11-16T02:30:01.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.237+0000 7f9fe7788640 1 -- 172.21.15.28:0/736112119 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fe00702d0 msgr2=0x7f9fe01e32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:01.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.237+0000 7f9fe7788640 1 --2- 172.21.15.28:0/736112119 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fe00702d0 0x7f9fe01e32a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0000c10 tx=0x7f9fd00192a0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.241+0000 7f9fe7788640 1 -- 172.21.15.28:0/736112119 shutdown_connections 2023-11-16T02:30:01.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.241+0000 7f9fe7788640 1 --2- 172.21.15.28:0/736112119 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f9fc4065a90 0x7f9fc4067f50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.241+0000 7f9fe7788640 1 --2- 172.21.15.28:0/736112119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9fe01417e0 0x7f9fe0150b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.241+0000 7f9fe7788640 1 --2- 172.21.15.28:0/736112119 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9fe00702d0 0x7f9fe01e32a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.241+0000 7f9fe7788640 1 --2- 172.21.15.28:0/736112119 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f9fe006a3d0 0x7f9fe00b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.241+0000 7f9fe7788640 1 -- 172.21.15.28:0/736112119 >> 172.21.15.28:0/736112119 conn(0x7f9fe00bc5a0 msgr2=0x7f9fe0073470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:01.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.241+0000 7f9fe7788640 1 -- 172.21.15.28:0/736112119 shutdown_connections 2023-11-16T02:30:01.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.241+0000 7f9fe7788640 1 -- 172.21.15.28:0/736112119 wait complete. 2023-11-16T02:30:01.259 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-16T02:30:01.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.373+0000 7efd1aa11640 1 Processor -- start 2023-11-16T02:30:01.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.373+0000 7efd1aa11640 1 -- start start 2023-11-16T02:30:01.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.373+0000 7efd1aa11640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd140bc900 0x7efd140b82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:01.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.373+0000 7efd1aa11640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efd141416d0 0x7efd14141b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:01.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.373+0000 7efd1aa11640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7efd14147c60 0x7efd141480d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:01.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.373+0000 7efd1aa11640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd14071b50 con 0x7efd141416d0 2023-11-16T02:30:01.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.373+0000 7efd1aa11640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd14148610 con 0x7efd14147c60 2023-11-16T02:30:01.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.373+0000 7efd1aa11640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd140712b0 con 0x7efd140bc900 2023-11-16T02:30:01.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.373+0000 7efd137fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efd141416d0 0x7efd14141b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:01.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.373+0000 7efd137fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efd141416d0 0x7efd14141b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50116/0 (socket says 172.21.15.28:50116) 2023-11-16T02:30:01.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.373+0000 7efd137fe640 1 -- 172.21.15.28:0/3183598861 learned_addr learned my addr 172.21.15.28:0/3183598861 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:01.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.373+0000 7efd18fae640 1 --2- 172.21.15.28:0/3183598861 >> v2:172.21.15.70:3300/0 conn(0x7efd14147c60 0x7efd141480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:01.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.373+0000 7efd13fff640 1 --2- 172.21.15.28:0/3183598861 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd140bc900 0x7efd140b82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:01.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.373+0000 7efd137fe640 1 -- 172.21.15.28:0/3183598861 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd140bc900 msgr2=0x7efd140b82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:01.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.373+0000 7efd137fe640 1 --2- 172.21.15.28:0/3183598861 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd140bc900 0x7efd140b82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.373+0000 7efd137fe640 1 -- 172.21.15.28:0/3183598861 >> v2:172.21.15.70:3300/0 conn(0x7efd14147c60 msgr2=0x7efd141480d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:01.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.373+0000 7efd137fe640 1 --2- 172.21.15.28:0/3183598861 >> v2:172.21.15.70:3300/0 conn(0x7efd14147c60 0x7efd141480d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.373+0000 7efd137fe640 1 -- 172.21.15.28:0/3183598861 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd14071590 con 0x7efd141416d0 2023-11-16T02:30:01.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.373+0000 7efd18fae640 1 --2- 172.21.15.28:0/3183598861 >> v2:172.21.15.70:3300/0 conn(0x7efd14147c60 0x7efd141480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:01.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.377+0000 7efd137fe640 1 --2- 172.21.15.28:0/3183598861 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd141416d0 0x7efd14141b10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efd1406eb90 tx=0x7efd0801ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94defa5522903fd1 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:01.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.377+0000 7efd12ffd640 1 -- 172.21.15.28:0/3183598861 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd080a7a60 con 0x7efd141416d0 2023-11-16T02:30:01.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.377+0000 7efd12ffd640 1 -- 172.21.15.28:0/3183598861 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd080a7bc0 con 0x7efd141416d0 2023-11-16T02:30:01.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.377+0000 7efd12ffd640 1 -- 172.21.15.28:0/3183598861 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd080af440 con 0x7efd141416d0 2023-11-16T02:30:01.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.377+0000 7efd1aa11640 1 -- 172.21.15.28:0/3183598861 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd141416d0 msgr2=0x7efd14141b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:01.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.377+0000 7efd1aa11640 1 --2- 172.21.15.28:0/3183598861 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd141416d0 0x7efd14141b10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efd1406eb90 tx=0x7efd0801ebd0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.377+0000 7efd1aa11640 1 -- 172.21.15.28:0/3183598861 shutdown_connections 2023-11-16T02:30:01.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.377+0000 7efd1aa11640 1 --2- 172.21.15.28:0/3183598861 >> v2:172.21.15.70:3300/0 conn(0x7efd14147c60 0x7efd141480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.377+0000 7efd1aa11640 1 --2- 172.21.15.28:0/3183598861 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd141416d0 0x7efd14141b10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.377+0000 7efd1aa11640 1 --2- 172.21.15.28:0/3183598861 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd140bc900 0x7efd140b82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.377+0000 7efd1aa11640 1 -- 172.21.15.28:0/3183598861 >> 172.21.15.28:0/3183598861 conn(0x7efd140b9050 msgr2=0x7efd140bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:01.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.377+0000 7efd1aa11640 1 -- 172.21.15.28:0/3183598861 shutdown_connections 2023-11-16T02:30:01.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.377+0000 7efd1aa11640 1 -- 172.21.15.28:0/3183598861 wait complete. 2023-11-16T02:30:01.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.377+0000 7efd1aa11640 1 Processor -- start 2023-11-16T02:30:01.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.377+0000 7efd1aa11640 1 -- start start 2023-11-16T02:30:01.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd1aa11640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd140bc900 0x7efd1414a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:01.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd1aa11640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd141416d0 0x7efd141e5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:01.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd1aa11640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd14147c60 0x7efd141e6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:01.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd1aa11640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1414aaa0 con 0x7efd141416d0 2023-11-16T02:30:01.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd1aa11640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd141e59f0 con 0x7efd140bc900 2023-11-16T02:30:01.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd1aa11640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd1413fac0 con 0x7efd14147c60 2023-11-16T02:30:01.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd137fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd141416d0 0x7efd141e5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:01.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd137fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd141416d0 0x7efd141e5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50124/0 (socket says 172.21.15.28:50124) 2023-11-16T02:30:01.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd137fe640 1 -- 172.21.15.28:0/82424592 learned_addr learned my addr 172.21.15.28:0/82424592 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:01.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd137fe640 1 -- 172.21.15.28:0/82424592 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd14147c60 msgr2=0x7efd141e6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:01.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd13fff640 1 --2- 172.21.15.28:0/82424592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd140bc900 0x7efd1414a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:01.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd137fe640 1 --2- 172.21.15.28:0/82424592 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd14147c60 0x7efd141e6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd137fe640 1 -- 172.21.15.28:0/82424592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd140bc900 msgr2=0x7efd1414a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:01.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd137fe640 1 --2- 172.21.15.28:0/82424592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd140bc900 0x7efd1414a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd137fe640 1 -- 172.21.15.28:0/82424592 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0800b770 con 0x7efd141416d0 2023-11-16T02:30:01.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd137fe640 1 --2- 172.21.15.28:0/82424592 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd141416d0 0x7efd141e5ef0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efd0801d280 tx=0x7efd0801b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:01.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd10ff9640 1 -- 172.21.15.28:0/82424592 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd080ba660 con 0x7efd141416d0 2023-11-16T02:30:01.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd10ff9640 1 -- 172.21.15.28:0/82424592 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd080ba7e0 con 0x7efd141416d0 2023-11-16T02:30:01.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd1aa11640 1 -- 172.21.15.28:0/82424592 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd1413fda0 con 0x7efd141416d0 2023-11-16T02:30:01.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd10ff9640 1 -- 172.21.15.28:0/82424592 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd080bab90 con 0x7efd141416d0 2023-11-16T02:30:01.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd1aa11640 1 -- 172.21.15.28:0/82424592 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd1414fab0 con 0x7efd141416d0 2023-11-16T02:30:01.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd1aa11640 1 -- 172.21.15.28:0/82424592 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd1404e8a0 con 0x7efd141416d0 2023-11-16T02:30:01.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd10ff9640 1 -- 172.21.15.28:0/82424592 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efd080c33b0 con 0x7efd141416d0 2023-11-16T02:30:01.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd10ff9640 1 --2- 172.21.15.28:0/82424592 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7efd00065a60 0x7efd00067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:01.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd10ff9640 1 -- 172.21.15.28:0/82424592 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd0811e2c0 con 0x7efd141416d0 2023-11-16T02:30:01.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd13fff640 1 --2- 172.21.15.28:0/82424592 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7efd00065a60 0x7efd00067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:01.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.381+0000 7efd13fff640 1 --2- 172.21.15.28:0/82424592 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7efd00065a60 0x7efd00067f20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efd0c008d40 tx=0x7efd0c008290 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:01.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.385+0000 7efd10ff9640 1 -- 172.21.15.28:0/82424592 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7efd080ebc80 con 0x7efd141416d0 2023-11-16T02:30:01.551 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.549+0000 7efd1aa11640 1 -- 172.21.15.28:0/82424592 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd140008e0 con 0x7efd141416d0 2023-11-16T02:30:01.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.549+0000 7efd10ff9640 1 -- 172.21.15.28:0/82424592 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15989 (secure 0 0 0) 0x7efd080b4090 con 0x7efd141416d0 2023-11-16T02:30:01.554 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:30:01.554 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":22,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","created":"2023-11-16T02:29:13.710567+0000","modified":"2023-11-16T02:29:38.871066+0000","last_up_change":"2023-11-16T02:29:24.841087+0000","last_in_change":"2023-11-16T02:29:16.024490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-16T02:29:26.490910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-16T02:29:36.133224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-16T02:29:36.866156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dfa8b58d-3481-4e68-86e8-21873d31d0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":38722},{"type":"v1","addr":"172.21.15.28:6809","nonce":38722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":38722},{"type":"v1","addr":"172.21.15.28:6811","nonce":38722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":38722},{"type":"v1","addr":"172.21.15.28:6815","nonce":38722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":38722},{"type":"v1","addr":"172.21.15.28:6813","nonce":38722}]},"public_addr":"172.21.15.28:6809/38722","cluster_addr":"172.21.15.28:6811/38722","heartbeat_back_addr":"172.21.15.28:6815/38722","heartbeat_front_addr":"172.21.15.28:6813/38722","state":["exists","up"]},{"osd":1,"uuid":"1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":38724},{"type":"v1","addr":"172.21.15.28:6824","nonce":38724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":38724},{"type":"v1","addr":"172.21.15.28:6827","nonce":38724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":38724},{"type":"v1","addr":"172.21.15.28:6831","nonce":38724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":38724},{"type":"v1","addr":"172.21.15.28:6829","nonce":38724}]},"public_addr":"172.21.15.28:6824/38724","cluster_addr":"172.21.15.28:6827/38724","heartbeat_back_addr":"172.21.15.28:6831/38724","heartbeat_front_addr":"172.21.15.28:6829/38724","state":["exists","up"]},{"osd":2,"uuid":"e18f39cd-6a35-4d36-9eed-3877794bf2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":38723},{"type":"v1","addr":"172.21.15.28:6801","nonce":38723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":38723},{"type":"v1","addr":"172.21.15.28:6803","nonce":38723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":38723},{"type":"v1","addr":"172.21.15.28:6807","nonce":38723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":38723},{"type":"v1","addr":"172.21.15.28:6805","nonce":38723}]},"public_addr":"172.21.15.28:6801/38723","cluster_addr":"172.21.15.28:6803/38723","heartbeat_back_addr":"172.21.15.28:6807/38723","heartbeat_front_addr":"172.21.15.28:6805/38723","state":["exists","up"]},{"osd":3,"uuid":"303d0728-409d-47d7-b7a6-6eb273f602fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":38725},{"type":"v1","addr":"172.21.15.28:6817","nonce":38725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":38725},{"type":"v1","addr":"172.21.15.28:6819","nonce":38725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":38725},{"type":"v1","addr":"172.21.15.28:6825","nonce":38725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":38725},{"type":"v1","addr":"172.21.15.28:6821","nonce":38725}]},"public_addr":"172.21.15.28:6817/38725","cluster_addr":"172.21.15.28:6819/38725","heartbeat_back_addr":"172.21.15.28:6825/38725","heartbeat_front_addr":"172.21.15.28:6821/38725","state":["exists","up"]},{"osd":4,"uuid":"df0bf0ac-6efe-4964-ad27-7c1771a70c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":38828},{"type":"v1","addr":"172.21.15.70:6801","nonce":38828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":38828},{"type":"v1","addr":"172.21.15.70:6803","nonce":38828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":38828},{"type":"v1","addr":"172.21.15.70:6807","nonce":38828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":38828},{"type":"v1","addr":"172.21.15.70:6805","nonce":38828}]},"public_addr":"172.21.15.70:6801/38828","cluster_addr":"172.21.15.70:6803/38828","heartbeat_back_addr":"172.21.15.70:6807/38828","heartbeat_front_addr":"172.21.15.70:6805/38828","state":["exists","up"]},{"osd":5,"uuid":"84921219-65cb-4c4e-b9ed-a773db639034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":38830},{"type":"v1","addr":"172.21.15.70:6810","nonce":38830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6813","nonce":38830},{"type":"v1","addr":"172.21.15.70:6814","nonce":38830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":38830},{"type":"v1","addr":"172.21.15.70:6824","nonce":38830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":38830},{"type":"v1","addr":"172.21.15.70:6819","nonce":38830}]},"public_addr":"172.21.15.70:6810/38830","cluster_addr":"172.21.15.70:6814/38830","heartbeat_back_addr":"172.21.15.70:6824/38830","heartbeat_front_addr":"172.21.15.70:6819/38830","state":["exists","up"]},{"osd":6,"uuid":"c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":38829},{"type":"v1","addr":"172.21.15.70:6812","nonce":38829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":38829},{"type":"v1","addr":"172.21.15.70:6820","nonce":38829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":38829},{"type":"v1","addr":"172.21.15.70:6828","nonce":38829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":38829},{"type":"v1","addr":"172.21.15.70:6825","nonce":38829}]},"public_addr":"172.21.15.70:6812/38829","cluster_addr":"172.21.15.70:6820/38829","heartbeat_back_addr":"172.21.15.70:6828/38829","heartbeat_front_addr":"172.21.15.70:6825/38829","state":["exists","up"]},{"osd":7,"uuid":"e2cdd418-12ce-4eea-9b22-efdad83eb76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":38839},{"type":"v1","addr":"172.21.15.70:6815","nonce":38839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":38839},{"type":"v1","addr":"172.21.15.70:6823","nonce":38839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":38839},{"type":"v1","addr":"172.21.15.70:6831","nonce":38839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6827","nonce":38839},{"type":"v1","addr":"172.21.15.70:6829","nonce":38839}]},"public_addr":"172.21.15.70:6815/38839","cluster_addr":"172.21.15.70:6823/38839","heartbeat_back_addr":"172.21.15.70:6831/38839","heartbeat_front_addr":"172.21.15.70:6829/38839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.544240+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.637637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.352115+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.652916+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.624477+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.570247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.706468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.696574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-16T02:30:01.556 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.553+0000 7efd1aa11640 1 -- 172.21.15.28:0/82424592 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7efd00065a60 msgr2=0x7efd00067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:01.556 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.553+0000 7efd1aa11640 1 --2- 172.21.15.28:0/82424592 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7efd00065a60 0x7efd00067f20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efd0c008d40 tx=0x7efd0c008290 comp rx=0 tx=0).stop 2023-11-16T02:30:01.556 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.553+0000 7efd1aa11640 1 -- 172.21.15.28:0/82424592 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd141416d0 msgr2=0x7efd141e5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:01.556 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.553+0000 7efd1aa11640 1 --2- 172.21.15.28:0/82424592 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd141416d0 0x7efd141e5ef0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efd0801d280 tx=0x7efd0801b970 comp rx=0 tx=0).stop 2023-11-16T02:30:01.556 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.553+0000 7efd1aa11640 1 -- 172.21.15.28:0/82424592 shutdown_connections 2023-11-16T02:30:01.556 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.553+0000 7efd1aa11640 1 --2- 172.21.15.28:0/82424592 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7efd00065a60 0x7efd00067f20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.556 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.553+0000 7efd1aa11640 1 --2- 172.21.15.28:0/82424592 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7efd14147c60 0x7efd141e6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.556 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.553+0000 7efd1aa11640 1 --2- 172.21.15.28:0/82424592 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd141416d0 0x7efd141e5ef0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.556 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.553+0000 7efd1aa11640 1 --2- 172.21.15.28:0/82424592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd140bc900 0x7efd1414a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.556 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.553+0000 7efd1aa11640 1 -- 172.21.15.28:0/82424592 >> 172.21.15.28:0/82424592 conn(0x7efd140b9050 msgr2=0x7efd14138fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:01.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.553+0000 7efd1aa11640 1 -- 172.21.15.28:0/82424592 shutdown_connections 2023-11-16T02:30:01.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.553+0000 7efd1aa11640 1 -- 172.21.15.28:0/82424592 wait complete. 2023-11-16T02:30:01.575 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-16T02:29:26.490910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-16T02:29:36.133224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-16T02:29:36.866156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-16T02:30:01.576 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-16T02:30:01.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.701+0000 7fc5beba7640 1 Processor -- start 2023-11-16T02:30:01.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.701+0000 7fc5beba7640 1 -- start start 2023-11-16T02:30:01.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.701+0000 7fc5beba7640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc5b806a170 0x7fc5b80b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:01.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.701+0000 7fc5beba7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc5b806a550 0x7fc5b8148a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:01.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.701+0000 7fc5beba7640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b8071800 con 0x7fc5b8148fa0 2023-11-16T02:30:01.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.701+0000 7fc5beba7640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b80b5ec0 con 0x7fc5b806a170 2023-11-16T02:30:01.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.701+0000 7fc5beba7640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b80b6350 con 0x7fc5b806a550 2023-11-16T02:30:01.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.701+0000 7fc5bc943640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc5b806a170 0x7fc5b80b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:01.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.701+0000 7fc5bc943640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc5b806a170 0x7fc5b80b3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50130/0 (socket says 172.21.15.28:50130) 2023-11-16T02:30:01.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.701+0000 7fc5bd144640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc5b8148fa0 0x7fc5b80b7c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37194/0 (socket says 172.21.15.28:37194) 2023-11-16T02:30:01.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.701+0000 7fc5bc943640 1 -- 172.21.15.28:0/1328600209 learned_addr learned my addr 172.21.15.28:0/1328600209 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:01.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.701+0000 7fc5b7fff640 1 --2- 172.21.15.28:0/1328600209 >> v2:172.21.15.70:3300/0 conn(0x7fc5b806a550 0x7fc5b8148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:01.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.701+0000 7fc5bc943640 1 -- 172.21.15.28:0/1328600209 >> v2:172.21.15.70:3300/0 conn(0x7fc5b806a550 msgr2=0x7fc5b8148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:01.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.701+0000 7fc5bc943640 1 --2- 172.21.15.28:0/1328600209 >> v2:172.21.15.70:3300/0 conn(0x7fc5b806a550 0x7fc5b8148a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.701+0000 7fc5bc943640 1 -- 172.21.15.28:0/1328600209 >> v1:172.21.15.28:6789/0 conn(0x7fc5b8148fa0 legacy=0x7fc5b80b7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:01.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.701+0000 7fc5b77fe640 1 -- 172.21.15.28:0/1328600209 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3190687578 0 0) 0x7fc5b00014a0 con 0x7fc5b8148fa0 2023-11-16T02:30:01.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.701+0000 7fc5bc943640 1 -- 172.21.15.28:0/1328600209 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b80b5870 con 0x7fc5b806a170 2023-11-16T02:30:01.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5bc943640 1 --2- 172.21.15.28:0/1328600209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b806a170 0x7fc5b80b3bc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8071700 tx=0x7fc5a801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3493917cb648e08 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:01.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5b77fe640 1 -- 172.21.15.28:0/1328600209 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a80ab610 con 0x7fc5b806a170 2023-11-16T02:30:01.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5b77fe640 1 -- 172.21.15.28:0/1328600209 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a80ab770 con 0x7fc5b806a170 2023-11-16T02:30:01.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5b77fe640 1 -- 172.21.15.28:0/1328600209 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a80abb00 con 0x7fc5b806a170 2023-11-16T02:30:01.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5beba7640 1 -- 172.21.15.28:0/1328600209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b806a170 msgr2=0x7fc5b80b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:01.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5beba7640 1 --2- 172.21.15.28:0/1328600209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b806a170 0x7fc5b80b3bc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8071700 tx=0x7fc5a801c470 comp rx=0 tx=0).stop 2023-11-16T02:30:01.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5beba7640 1 -- 172.21.15.28:0/1328600209 shutdown_connections 2023-11-16T02:30:01.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5beba7640 1 --2- 172.21.15.28:0/1328600209 >> v2:172.21.15.70:3300/0 conn(0x7fc5b806a550 0x7fc5b8148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5beba7640 1 --2- 172.21.15.28:0/1328600209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b806a170 0x7fc5b80b3bc0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5beba7640 1 -- 172.21.15.28:0/1328600209 >> 172.21.15.28:0/1328600209 conn(0x7fc5b80bc5a0 msgr2=0x7fc5b80bc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:01.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5beba7640 1 -- 172.21.15.28:0/1328600209 shutdown_connections 2023-11-16T02:30:01.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5beba7640 1 -- 172.21.15.28:0/1328600209 wait complete. 2023-11-16T02:30:01.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5beba7640 1 Processor -- start 2023-11-16T02:30:01.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5beba7640 1 -- start start 2023-11-16T02:30:01.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5beba7640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc5b806a170 0x7fc5b8147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:01.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5beba7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5b806a550 0x7fc5b8138270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:01.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5beba7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b8148fa0 0x7fc5b81387b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:01.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5beba7640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b8148410 con 0x7fc5b8148fa0 2023-11-16T02:30:01.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5beba7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b8152d40 con 0x7fc5b806a550 2023-11-16T02:30:01.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5beba7640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b8152f80 con 0x7fc5b806a170 2023-11-16T02:30:01.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5bd144640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b8148fa0 0x7fc5b81387b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:01.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5bd144640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b8148fa0 0x7fc5b81387b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50138/0 (socket says 172.21.15.28:50138) 2023-11-16T02:30:01.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5bd144640 1 -- 172.21.15.28:0/2391697710 learned_addr learned my addr 172.21.15.28:0/2391697710 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:01.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5b7fff640 1 --2- 172.21.15.28:0/2391697710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5b806a550 0x7fc5b8138270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:01.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5bd144640 1 -- 172.21.15.28:0/2391697710 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc5b806a170 msgr2=0x7fc5b8147ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:01.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5bd144640 1 --2- 172.21.15.28:0/2391697710 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc5b806a170 0x7fc5b8147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5bd144640 1 -- 172.21.15.28:0/2391697710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5b806a550 msgr2=0x7fc5b8138270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:01.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5bd144640 1 --2- 172.21.15.28:0/2391697710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5b806a550 0x7fc5b8138270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5bd144640 1 -- 172.21.15.28:0/2391697710 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a80094d0 con 0x7fc5b8148fa0 2023-11-16T02:30:01.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.705+0000 7fc5b7fff640 1 --2- 172.21.15.28:0/2391697710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5b806a550 0x7fc5b8138270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:01.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.709+0000 7fc5bd144640 1 --2- 172.21.15.28:0/2391697710 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b8148fa0 0x7fc5b81387b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc5b000c7c0 tx=0x7fc5b000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:01.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.709+0000 7fc5b57fa640 1 -- 172.21.15.28:0/2391697710 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b000a640 con 0x7fc5b8148fa0 2023-11-16T02:30:01.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.709+0000 7fc5b57fa640 1 -- 172.21.15.28:0/2391697710 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b000a7c0 con 0x7fc5b8148fa0 2023-11-16T02:30:01.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.709+0000 7fc5beba7640 1 -- 172.21.15.28:0/2391697710 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b806fe60 con 0x7fc5b8148fa0 2023-11-16T02:30:01.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.709+0000 7fc5b57fa640 1 -- 172.21.15.28:0/2391697710 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b000ab70 con 0x7fc5b8148fa0 2023-11-16T02:30:01.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.709+0000 7fc5beba7640 1 -- 172.21.15.28:0/2391697710 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b8070420 con 0x7fc5b8148fa0 2023-11-16T02:30:01.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.709+0000 7fc5beba7640 1 -- 172.21.15.28:0/2391697710 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b804e8a0 con 0x7fc5b8148fa0 2023-11-16T02:30:01.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.709+0000 7fc5b57fa640 1 -- 172.21.15.28:0/2391697710 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc5b000acd0 con 0x7fc5b8148fa0 2023-11-16T02:30:01.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.709+0000 7fc5b57fa640 1 --2- 172.21.15.28:0/2391697710 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc5a4065a60 0x7fc5a4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:01.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.709+0000 7fc5b57fa640 1 -- 172.21.15.28:0/2391697710 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5b00827d0 con 0x7fc5b8148fa0 2023-11-16T02:30:01.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.709+0000 7fc5bc943640 1 --2- 172.21.15.28:0/2391697710 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc5a4065a60 0x7fc5a4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:01.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.709+0000 7fc5bc943640 1 --2- 172.21.15.28:0/2391697710 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc5a4065a60 0x7fc5a4067f20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc5a80af000 tx=0x7fc5a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:01.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.713+0000 7fc5b57fa640 1 -- 172.21.15.28:0/2391697710 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fc5b0050220 con 0x7fc5b8148fa0 2023-11-16T02:30:01.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.861+0000 7fc5beba7640 1 -- 172.21.15.28:0/2391697710 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc5b8071800 con 0x7fc5b8148fa0 2023-11-16T02:30:01.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.861+0000 7fc5b57fa640 1 -- 172.21.15.28:0/2391697710 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc5b8071800 con 0x7fc5b8148fa0 2023-11-16T02:30:01.867 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-11-16T02:30:01.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.865+0000 7fc5beba7640 1 -- 172.21.15.28:0/2391697710 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc5a4065a60 msgr2=0x7fc5a4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:01.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.865+0000 7fc5beba7640 1 --2- 172.21.15.28:0/2391697710 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc5a4065a60 0x7fc5a4067f20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc5a80af000 tx=0x7fc5a8008040 comp rx=0 tx=0).stop 2023-11-16T02:30:01.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.865+0000 7fc5beba7640 1 -- 172.21.15.28:0/2391697710 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b8148fa0 msgr2=0x7fc5b81387b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:01.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.865+0000 7fc5beba7640 1 --2- 172.21.15.28:0/2391697710 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b8148fa0 0x7fc5b81387b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc5b000c7c0 tx=0x7fc5b000cc80 comp rx=0 tx=0).stop 2023-11-16T02:30:01.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.865+0000 7fc5beba7640 1 -- 172.21.15.28:0/2391697710 shutdown_connections 2023-11-16T02:30:01.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.865+0000 7fc5beba7640 1 --2- 172.21.15.28:0/2391697710 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc5a4065a60 0x7fc5a4067f20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.865+0000 7fc5beba7640 1 --2- 172.21.15.28:0/2391697710 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b8148fa0 0x7fc5b81387b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.865+0000 7fc5beba7640 1 --2- 172.21.15.28:0/2391697710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5b806a550 0x7fc5b8138270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.865+0000 7fc5beba7640 1 --2- 172.21.15.28:0/2391697710 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc5b806a170 0x7fc5b8147ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:01.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.865+0000 7fc5beba7640 1 -- 172.21.15.28:0/2391697710 >> 172.21.15.28:0/2391697710 conn(0x7fc5b80bc5a0 msgr2=0x7fc5b80b7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:01.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.865+0000 7fc5beba7640 1 -- 172.21.15.28:0/2391697710 shutdown_connections 2023-11-16T02:30:01.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:01.865+0000 7fc5beba7640 1 -- 172.21.15.28:0/2391697710 wait complete. 2023-11-16T02:30:01.884 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-16T02:30:02.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9e1eca640 1 Processor -- start 2023-11-16T02:30:02.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9e1eca640 1 -- start start 2023-11-16T02:30:02.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9e1eca640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb9dc06d8c0 0x7fb9dc0ba470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:02.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9e1eca640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb9dc148900 0x7fb9dc153260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:02.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9e1eca640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9dc06eef0 con 0x7fb9dc06dca0 2023-11-16T02:30:02.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9e1eca640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9dc0ba0e0 con 0x7fb9dc06d8c0 2023-11-16T02:30:02.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9e1eca640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9dc06e6e0 con 0x7fb9dc148900 2023-11-16T02:30:02.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9db7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb9dc06d8c0 0x7fb9dc0ba470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:02.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9db7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb9dc06d8c0 0x7fb9dc0ba470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50144/0 (socket says 172.21.15.28:50144) 2023-11-16T02:30:02.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9db7fe640 1 -- 172.21.15.28:0/122062774 learned_addr learned my addr 172.21.15.28:0/122062774 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:02.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9daffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fb9dc06dca0 0x7fb9dc0a3cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37206/0 (socket says 172.21.15.28:37206) 2023-11-16T02:30:02.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9dbfff640 1 --2- 172.21.15.28:0/122062774 >> v2:172.21.15.70:3300/0 conn(0x7fb9dc148900 0x7fb9dc153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:02.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9db7fe640 1 -- 172.21.15.28:0/122062774 >> v2:172.21.15.70:3300/0 conn(0x7fb9dc148900 msgr2=0x7fb9dc153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:02.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9db7fe640 1 --2- 172.21.15.28:0/122062774 >> v2:172.21.15.70:3300/0 conn(0x7fb9dc148900 0x7fb9dc153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:02.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9db7fe640 1 -- 172.21.15.28:0/122062774 >> v1:172.21.15.28:6789/0 conn(0x7fb9dc06dca0 legacy=0x7fb9dc0a3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:02.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9db7fe640 1 -- 172.21.15.28:0/122062774 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc06e930 con 0x7fb9dc06d8c0 2023-11-16T02:30:02.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9db7fe640 1 --2- 172.21.15.28:0/122062774 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9dc06d8c0 0x7fb9dc0ba470 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0678f0 tx=0x7fb9cc01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=867095b8792b0647 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:02.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9da7fc640 1 -- 172.21.15.28:0/122062774 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc0a89f0 con 0x7fb9dc06d8c0 2023-11-16T02:30:02.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9da7fc640 1 -- 172.21.15.28:0/122062774 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc0a8b50 con 0x7fb9dc06d8c0 2023-11-16T02:30:02.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9da7fc640 1 -- 172.21.15.28:0/122062774 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc0b0440 con 0x7fb9dc06d8c0 2023-11-16T02:30:02.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9e1eca640 1 -- 172.21.15.28:0/122062774 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9dc06d8c0 msgr2=0x7fb9dc0ba470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:02.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9e1eca640 1 --2- 172.21.15.28:0/122062774 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9dc06d8c0 0x7fb9dc0ba470 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0678f0 tx=0x7fb9cc01ecf0 comp rx=0 tx=0).stop 2023-11-16T02:30:02.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9e1eca640 1 -- 172.21.15.28:0/122062774 shutdown_connections 2023-11-16T02:30:02.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9e1eca640 1 --2- 172.21.15.28:0/122062774 >> v2:172.21.15.70:3300/0 conn(0x7fb9dc148900 0x7fb9dc153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:02.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9e1eca640 1 --2- 172.21.15.28:0/122062774 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9dc06d8c0 0x7fb9dc0ba470 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:02.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9e1eca640 1 -- 172.21.15.28:0/122062774 >> 172.21.15.28:0/122062774 conn(0x7fb9dc0bac40 msgr2=0x7fb9dc0bb050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:02.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9e1eca640 1 -- 172.21.15.28:0/122062774 shutdown_connections 2023-11-16T02:30:02.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9e1eca640 1 -- 172.21.15.28:0/122062774 wait complete. 2023-11-16T02:30:02.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9e1eca640 1 Processor -- start 2023-11-16T02:30:02.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9e1eca640 1 -- start start 2023-11-16T02:30:02.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9e1eca640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9dc06d8c0 0x7fb9dc0a3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:02.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9e1eca640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9dc06dca0 0x7fb9dc13fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:02.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9e1eca640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9dc148900 0x7fb9dc1e1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:02.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9e1eca640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc0a35b0 con 0x7fb9dc06dca0 2023-11-16T02:30:02.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9e1eca640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc13c3b0 con 0x7fb9dc148900 2023-11-16T02:30:02.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9e1eca640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc0b76e0 con 0x7fb9dc06d8c0 2023-11-16T02:30:02.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9daffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9dc06dca0 0x7fb9dc13fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:02.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9daffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9dc06dca0 0x7fb9dc13fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50148/0 (socket says 172.21.15.28:50148) 2023-11-16T02:30:02.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9daffd640 1 -- 172.21.15.28:0/1977154278 learned_addr learned my addr 172.21.15.28:0/1977154278 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:02.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9db7fe640 1 --2- 172.21.15.28:0/1977154278 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9dc06d8c0 0x7fb9dc0a3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:02.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9dbfff640 1 --2- 172.21.15.28:0/1977154278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9dc148900 0x7fb9dc1e1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:02.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9daffd640 1 -- 172.21.15.28:0/1977154278 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9dc06d8c0 msgr2=0x7fb9dc0a3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:02.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9daffd640 1 --2- 172.21.15.28:0/1977154278 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9dc06d8c0 0x7fb9dc0a3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:02.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9daffd640 1 -- 172.21.15.28:0/1977154278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9dc148900 msgr2=0x7fb9dc1e1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:02.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9daffd640 1 --2- 172.21.15.28:0/1977154278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9dc148900 0x7fb9dc1e1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:02.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9daffd640 1 -- 172.21.15.28:0/1977154278 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9cc0094d0 con 0x7fb9dc06dca0 2023-11-16T02:30:02.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9dbfff640 1 --2- 172.21.15.28:0/1977154278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9dc148900 0x7fb9dc1e1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:02.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9daffd640 1 --2- 172.21.15.28:0/1977154278 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9dc06dca0 0x7fb9dc13fc10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb9c400c500 tx=0x7fb9c400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:02.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9d3fff640 1 -- 172.21.15.28:0/1977154278 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c4007500 con 0x7fb9dc06dca0 2023-11-16T02:30:02.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9d3fff640 1 -- 172.21.15.28:0/1977154278 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c4007660 con 0x7fb9dc06dca0 2023-11-16T02:30:02.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9e1eca640 1 -- 172.21.15.28:0/1977154278 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9dc13e050 con 0x7fb9dc06dca0 2023-11-16T02:30:02.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9d3fff640 1 -- 172.21.15.28:0/1977154278 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c4004a10 con 0x7fb9dc06dca0 2023-11-16T02:30:02.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.009+0000 7fb9e1eca640 1 -- 172.21.15.28:0/1977154278 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9dc140150 con 0x7fb9dc06dca0 2023-11-16T02:30:02.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.013+0000 7fb9e1eca640 1 -- 172.21.15.28:0/1977154278 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9dc1e1370 con 0x7fb9dc06dca0 2023-11-16T02:30:02.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.013+0000 7fb9d3fff640 1 -- 172.21.15.28:0/1977154278 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb9c4004b70 con 0x7fb9dc06dca0 2023-11-16T02:30:02.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.013+0000 7fb9d3fff640 1 --2- 172.21.15.28:0/1977154278 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb9bc065a60 0x7fb9bc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:02.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.013+0000 7fb9d3fff640 1 -- 172.21.15.28:0/1977154278 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9c4082270 con 0x7fb9dc06dca0 2023-11-16T02:30:02.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.013+0000 7fb9db7fe640 1 --2- 172.21.15.28:0/1977154278 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb9bc065a60 0x7fb9bc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:02.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.013+0000 7fb9db7fe640 1 --2- 172.21.15.28:0/1977154278 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb9bc065a60 0x7fb9bc067f20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0b2000 tx=0x7fb9cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:02.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.017+0000 7fb9d3fff640 1 -- 172.21.15.28:0/1977154278 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fb9dc1e1370 con 0x7fb9dc06dca0 2023-11-16T02:30:02.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.173+0000 7fb9e1eca640 1 -- 172.21.15.28:0/1977154278 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb9dc1e1370 con 0x7fb9dc06dca0 2023-11-16T02:30:02.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.173+0000 7fb9d3fff640 1 -- 172.21.15.28:0/1977154278 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb9dc1e1370 con 0x7fb9dc06dca0 2023-11-16T02:30:02.172 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-11-16T02:30:02.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.173+0000 7fb9e1eca640 1 -- 172.21.15.28:0/1977154278 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb9bc065a60 msgr2=0x7fb9bc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:02.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.173+0000 7fb9e1eca640 1 --2- 172.21.15.28:0/1977154278 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb9bc065a60 0x7fb9bc067f20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0b2000 tx=0x7fb9cc008040 comp rx=0 tx=0).stop 2023-11-16T02:30:02.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.173+0000 7fb9e1eca640 1 -- 172.21.15.28:0/1977154278 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9dc06dca0 msgr2=0x7fb9dc13fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:02.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.173+0000 7fb9e1eca640 1 --2- 172.21.15.28:0/1977154278 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9dc06dca0 0x7fb9dc13fc10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb9c400c500 tx=0x7fb9c400c9c0 comp rx=0 tx=0).stop 2023-11-16T02:30:02.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.173+0000 7fb9e1eca640 1 -- 172.21.15.28:0/1977154278 shutdown_connections 2023-11-16T02:30:02.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.173+0000 7fb9e1eca640 1 --2- 172.21.15.28:0/1977154278 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb9bc065a60 0x7fb9bc067f20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:02.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.173+0000 7fb9e1eca640 1 --2- 172.21.15.28:0/1977154278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9dc148900 0x7fb9dc1e1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:02.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.173+0000 7fb9e1eca640 1 --2- 172.21.15.28:0/1977154278 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb9dc06dca0 0x7fb9dc13fc10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:02.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.173+0000 7fb9e1eca640 1 --2- 172.21.15.28:0/1977154278 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9dc06d8c0 0x7fb9dc0a3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:02.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.173+0000 7fb9e1eca640 1 -- 172.21.15.28:0/1977154278 >> 172.21.15.28:0/1977154278 conn(0x7fb9dc0bac40 msgr2=0x7fb9dc0731d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:02.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.173+0000 7fb9e1eca640 1 -- 172.21.15.28:0/1977154278 shutdown_connections 2023-11-16T02:30:02.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.173+0000 7fb9e1eca640 1 -- 172.21.15.28:0/1977154278 wait complete. 2023-11-16T02:30:02.190 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-16T02:30:02.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.301+0000 7f0dbb839640 1 Processor -- start 2023-11-16T02:30:02.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.301+0000 7f0dbb839640 1 -- start start 2023-11-16T02:30:02.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.305+0000 7f0dbb839640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0db41415b0 0x7f0db40ba410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:02.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.305+0000 7f0dbb839640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db40b78a0 con 0x7f0db40b8340 2023-11-16T02:30:02.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.305+0000 7f0dbb839640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db414f000 con 0x7f0db414e0f0 2023-11-16T02:30:02.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.305+0000 7f0dbb839640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0db40ba060 con 0x7f0db41415b0 2023-11-16T02:30:02.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.305+0000 7f0db95d5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0db41415b0 0x7f0db40ba410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:02.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.305+0000 7f0db95d5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0db41415b0 0x7f0db40ba410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50156/0 (socket says 172.21.15.28:50156) 2023-11-16T02:30:02.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.305+0000 7f0db8dd4640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f0db40b8340 0x7f0db40b87d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37210/0 (socket says 172.21.15.28:37210) 2023-11-16T02:30:02.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.305+0000 7f0db95d5640 1 -- 172.21.15.28:0/2228140334 learned_addr learned my addr 172.21.15.28:0/2228140334 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:02.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.305+0000 7f0db95d5640 1 -- 172.21.15.28:0/2228140334 >> v1:172.21.15.70:6789/0 conn(0x7f0db414e0f0 legacy=0x7f0db414e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:02.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.305+0000 7f0db3fff640 1 -- 172.21.15.28:0/2228140334 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198461425 0 0) 0x7f0db40b78a0 con 0x7f0db40b8340 2023-11-16T02:30:02.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.305+0000 7f0db95d5640 1 -- 172.21.15.28:0/2228140334 >> v1:172.21.15.28:6789/0 conn(0x7f0db40b8340 legacy=0x7f0db40b87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:02.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.305+0000 7f0db95d5640 1 -- 172.21.15.28:0/2228140334 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db40b7b40 con 0x7f0db41415b0 2023-11-16T02:30:02.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.305+0000 7f0db95d5640 1 --2- 172.21.15.28:0/2228140334 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0db41415b0 0x7f0db40ba410 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009e50 tx=0x7f0dac01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=510df81c140165d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:02.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.305+0000 7f0db3fff640 1 -- 172.21.15.28:0/2228140334 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac0a5720 con 0x7f0db41415b0 2023-11-16T02:30:02.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.305+0000 7f0db3fff640 1 -- 172.21.15.28:0/2228140334 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac0a5880 con 0x7f0db41415b0 2023-11-16T02:30:02.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.305+0000 7f0db3fff640 1 -- 172.21.15.28:0/2228140334 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac0a5c10 con 0x7f0db41415b0 2023-11-16T02:30:02.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0dbb839640 1 -- 172.21.15.28:0/2228140334 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0db41415b0 msgr2=0x7f0db40ba410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:02.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0dbb839640 1 --2- 172.21.15.28:0/2228140334 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0db41415b0 0x7f0db40ba410 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009e50 tx=0x7f0dac01c9d0 comp rx=0 tx=0).stop 2023-11-16T02:30:02.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0dbb839640 1 -- 172.21.15.28:0/2228140334 shutdown_connections 2023-11-16T02:30:02.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0dbb839640 1 --2- 172.21.15.28:0/2228140334 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0db41415b0 0x7f0db40ba410 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:02.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0dbb839640 1 -- 172.21.15.28:0/2228140334 >> 172.21.15.28:0/2228140334 conn(0x7f0db406b7e0 msgr2=0x7f0db406bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:02.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0dbb839640 1 -- 172.21.15.28:0/2228140334 shutdown_connections 2023-11-16T02:30:02.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0dbb839640 1 -- 172.21.15.28:0/2228140334 wait complete. 2023-11-16T02:30:02.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0dbb839640 1 Processor -- start 2023-11-16T02:30:02.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0dbb839640 1 -- start start 2023-11-16T02:30:02.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0dbb839640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0db40b8340 0x7f0db4137b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:02.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0dbb839640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0db41415b0 0x7f0db414be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:02.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0dbb839640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0db414e0f0 0x7f0db414c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:02.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0dbb839640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db4138060 con 0x7f0db41415b0 2023-11-16T02:30:02.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0dbb839640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db4134250 con 0x7f0db40b8340 2023-11-16T02:30:02.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0dbb839640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db41344f0 con 0x7f0db414e0f0 2023-11-16T02:30:02.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0db8dd4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0db41415b0 0x7f0db414be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:02.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0db8dd4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0db41415b0 0x7f0db414be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50172/0 (socket says 172.21.15.28:50172) 2023-11-16T02:30:02.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0db8dd4640 1 -- 172.21.15.28:0/884260172 learned_addr learned my addr 172.21.15.28:0/884260172 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:02.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0db95d5640 1 --2- 172.21.15.28:0/884260172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0db40b8340 0x7f0db4137b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:02.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0db8dd4640 1 -- 172.21.15.28:0/884260172 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0db414e0f0 msgr2=0x7f0db414c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:02.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0db8dd4640 1 --2- 172.21.15.28:0/884260172 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0db414e0f0 0x7f0db414c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:02.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0db8dd4640 1 -- 172.21.15.28:0/884260172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0db40b8340 msgr2=0x7f0db4137b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:02.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0db8dd4640 1 --2- 172.21.15.28:0/884260172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0db40b8340 0x7f0db4137b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:02.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0db8dd4640 1 -- 172.21.15.28:0/884260172 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac009b30 con 0x7f0db41415b0 2023-11-16T02:30:02.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0db95d5640 1 --2- 172.21.15.28:0/884260172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0db40b8340 0x7f0db4137b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:02.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0db8dd4640 1 --2- 172.21.15.28:0/884260172 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0db41415b0 0x7f0db414be70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0da800c480 tx=0x7f0da800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:02.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0db1ffb640 1 -- 172.21.15.28:0/884260172 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da80074e0 con 0x7f0db41415b0 2023-11-16T02:30:02.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0db1ffb640 1 -- 172.21.15.28:0/884260172 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da8007660 con 0x7f0db41415b0 2023-11-16T02:30:02.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0db1ffb640 1 -- 172.21.15.28:0/884260172 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8004a30 con 0x7f0db41415b0 2023-11-16T02:30:02.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0dbb839640 1 -- 172.21.15.28:0/884260172 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db41347d0 con 0x7f0db41415b0 2023-11-16T02:30:02.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.309+0000 7f0dbb839640 1 -- 172.21.15.28:0/884260172 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db413def0 con 0x7f0db41415b0 2023-11-16T02:30:02.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.313+0000 7f0dbb839640 1 -- 172.21.15.28:0/884260172 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db406b140 con 0x7f0db41415b0 2023-11-16T02:30:02.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.313+0000 7f0db1ffb640 1 -- 172.21.15.28:0/884260172 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0da8004b90 con 0x7f0db41415b0 2023-11-16T02:30:02.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.313+0000 7f0db1ffb640 1 --2- 172.21.15.28:0/884260172 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0da0065a60 0x7f0da0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:02.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.313+0000 7f0db1ffb640 1 -- 172.21.15.28:0/884260172 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0da8082480 con 0x7f0db41415b0 2023-11-16T02:30:02.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.313+0000 7f0db95d5640 1 --2- 172.21.15.28:0/884260172 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0da0065a60 0x7f0da0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:02.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.313+0000 7f0db95d5640 1 --2- 172.21.15.28:0/884260172 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0da0065a60 0x7f0da0067f20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0ae000 tx=0x7f0dac0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:02.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.317+0000 7f0db1ffb640 1 -- 172.21.15.28:0/884260172 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f0da8053830 con 0x7f0db41415b0 2023-11-16T02:30:02.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.465+0000 7f0dbb839640 1 -- 172.21.15.28:0/884260172 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0db4134960 con 0x7f0db41415b0 2023-11-16T02:30:02.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.465+0000 7f0db1ffb640 1 -- 172.21.15.28:0/884260172 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0da80533c0 con 0x7f0db41415b0 2023-11-16T02:30:02.466 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-11-16T02:30:02.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.469+0000 7f0dbb839640 1 -- 172.21.15.28:0/884260172 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0da0065a60 msgr2=0x7f0da0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:02.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.469+0000 7f0dbb839640 1 --2- 172.21.15.28:0/884260172 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0da0065a60 0x7f0da0067f20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0ae000 tx=0x7f0dac0a7070 comp rx=0 tx=0).stop 2023-11-16T02:30:02.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.469+0000 7f0dbb839640 1 -- 172.21.15.28:0/884260172 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0db41415b0 msgr2=0x7f0db414be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:02.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.469+0000 7f0dbb839640 1 --2- 172.21.15.28:0/884260172 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0db41415b0 0x7f0db414be70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0da800c480 tx=0x7f0da800c940 comp rx=0 tx=0).stop 2023-11-16T02:30:02.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.469+0000 7f0dbb839640 1 -- 172.21.15.28:0/884260172 shutdown_connections 2023-11-16T02:30:02.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.469+0000 7f0dbb839640 1 --2- 172.21.15.28:0/884260172 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0da0065a60 0x7f0da0067f20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:02.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.469+0000 7f0dbb839640 1 --2- 172.21.15.28:0/884260172 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0db414e0f0 0x7f0db414c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:02.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.469+0000 7f0dbb839640 1 --2- 172.21.15.28:0/884260172 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0db41415b0 0x7f0db414be70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:02.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.469+0000 7f0dbb839640 1 --2- 172.21.15.28:0/884260172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0db40b8340 0x7f0db4137b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:02.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.469+0000 7f0dbb839640 1 -- 172.21.15.28:0/884260172 >> 172.21.15.28:0/884260172 conn(0x7f0db406b7e0 msgr2=0x7f0db413ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:02.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.469+0000 7f0dbb839640 1 -- 172.21.15.28:0/884260172 shutdown_connections 2023-11-16T02:30:02.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.469+0000 7f0dbb839640 1 -- 172.21.15.28:0/884260172 wait complete. 2023-11-16T02:30:02.510 INFO:tasks.cephfs_test_runner:Starting test: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-11-16T02:30:02.511 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2023-11-16T02:30:02.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.633+0000 7f86a8e7a640 1 Processor -- start 2023-11-16T02:30:02.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.633+0000 7f86a8e7a640 1 -- start start 2023-11-16T02:30:02.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a8e7a640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86a40b86d0 0x7f86a40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:02.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a8e7a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f86a414b710 0x7f86a4144b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:02.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a8e7a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a406c260 con 0x7f86a41446a0 2023-11-16T02:30:02.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a8e7a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a40ba470 con 0x7f86a414b710 2023-11-16T02:30:02.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a8e7a640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a40ba6e0 con 0x7f86a40b86d0 2023-11-16T02:30:02.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a1d9b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f86a41446a0 0x7f86a414b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37224/0 (socket says 172.21.15.28:37224) 2023-11-16T02:30:02.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a1d9b640 1 -- 172.21.15.28:0/3275784342 learned_addr learned my addr 172.21.15.28:0/3275784342 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:02.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a2d9d640 1 --2- 172.21.15.28:0/3275784342 >> v2:172.21.15.70:3300/0 conn(0x7f86a414b710 0x7f86a4144b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:02.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a259c640 1 --2- 172.21.15.28:0/3275784342 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86a40b86d0 0x7f86a40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:02.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a159a640 1 -- 172.21.15.28:0/3275784342 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1004277186 0 0) 0x7f86a406c260 con 0x7f86a41446a0 2023-11-16T02:30:02.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a159a640 1 -- 172.21.15.28:0/3275784342 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f868c003530 con 0x7f86a41446a0 2023-11-16T02:30:02.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a159a640 1 -- 172.21.15.28:0/3275784342 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4291581937 0 0) 0x7f868c003530 con 0x7f86a41446a0 2023-11-16T02:30:02.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a159a640 1 -- 172.21.15.28:0/3275784342 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86a40b86d0 msgr2=0x7f86a40b8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a159a640 1 --2- 172.21.15.28:0/3275784342 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86a40b86d0 0x7f86a40b8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a159a640 1 -- 172.21.15.28:0/3275784342 >> v2:172.21.15.70:3300/0 conn(0x7f86a414b710 msgr2=0x7f86a4144b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a159a640 1 --2- 172.21.15.28:0/3275784342 >> v2:172.21.15.70:3300/0 conn(0x7f86a414b710 0x7f86a4144b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a159a640 1 -- 172.21.15.28:0/3275784342 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a414aae0 con 0x7f86a41446a0 2023-11-16T02:30:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a159a640 1 -- 172.21.15.28:0/3275784342 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7f8698001680 con 0x7f86a41446a0 2023-11-16T02:30:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a159a640 1 -- 172.21.15.28:0/3275784342 >> v1:172.21.15.28:6789/0 conn(0x7f86a41446a0 legacy=0x7f86a414b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a159a640 1 --2- 172.21.15.28:0/3275784342 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86a40b86d0 0x7f868c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a159a640 1 --2- 172.21.15.28:0/3275784342 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f868c003f00 0x7f868c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a159a640 1 --2- 172.21.15.28:0/3275784342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f868c004d10 0x7f868c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a159a640 1 -- 172.21.15.28:0/3275784342 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a40ba470 con 0x7f868c003f00 2023-11-16T02:30:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a159a640 1 -- 172.21.15.28:0/3275784342 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a40ba6e0 con 0x7f868c004d10 2023-11-16T02:30:02.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a159a640 1 -- 172.21.15.28:0/3275784342 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868c00b990 con 0x7f86a40b86d0 2023-11-16T02:30:02.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a1d9b640 1 --2- 172.21.15.28:0/3275784342 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f868c003f00 0x7f868c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:02.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a259c640 1 --2- 172.21.15.28:0/3275784342 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86a40b86d0 0x7f868c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:02.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a2d9d640 1 --2- 172.21.15.28:0/3275784342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f868c004d10 0x7f868c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:02.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a1d9b640 1 -- 172.21.15.28:0/3275784342 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86a40b86d0 msgr2=0x7f868c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:02.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a1d9b640 1 --2- 172.21.15.28:0/3275784342 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86a40b86d0 0x7f868c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:02.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a1d9b640 1 -- 172.21.15.28:0/3275784342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f868c004d10 msgr2=0x7f868c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:02.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a1d9b640 1 --2- 172.21.15.28:0/3275784342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f868c004d10 0x7f868c005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:02.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a1d9b640 1 -- 172.21.15.28:0/3275784342 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868c003530 con 0x7f868c003f00 2023-11-16T02:30:02.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.637+0000 7f86a259c640 1 --2- 172.21.15.28:0/3275784342 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86a40b86d0 0x7f868c003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:02.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a1d9b640 1 --2- 172.21.15.28:0/3275784342 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f868c003f00 0x7f868c0047d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f869800c290 tx=0x7f869801f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c8c585c91e6bcc server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:02.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a159a640 1 -- 172.21.15.28:0/3275784342 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8698005ae0 con 0x7f868c003f00 2023-11-16T02:30:02.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a159a640 1 -- 172.21.15.28:0/3275784342 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86980ab070 con 0x7f868c003f00 2023-11-16T02:30:02.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a159a640 1 -- 172.21.15.28:0/3275784342 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8698005e80 con 0x7f868c003f00 2023-11-16T02:30:02.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a8e7a640 1 -- 172.21.15.28:0/3275784342 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f868c003f00 msgr2=0x7f868c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:02.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a8e7a640 1 --2- 172.21.15.28:0/3275784342 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f868c003f00 0x7f868c0047d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f869800c290 tx=0x7f869801f3d0 comp rx=0 tx=0).stop 2023-11-16T02:30:02.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a2d9d640 1 -- 172.21.15.28:0/3275784342 reap_dead start 2023-11-16T02:30:02.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a8e7a640 1 -- 172.21.15.28:0/3275784342 shutdown_connections 2023-11-16T02:30:02.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a8e7a640 1 -- 172.21.15.28:0/3275784342 >> 172.21.15.28:0/3275784342 conn(0x7f86a406b770 msgr2=0x7f86a406bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:02.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a8e7a640 1 -- 172.21.15.28:0/3275784342 shutdown_connections 2023-11-16T02:30:02.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a8e7a640 1 -- 172.21.15.28:0/3275784342 wait complete. 2023-11-16T02:30:02.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a8e7a640 1 Processor -- start 2023-11-16T02:30:02.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a8e7a640 1 -- start start 2023-11-16T02:30:02.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a8e7a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f868c003f00 0x7f86a413ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:02.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a8e7a640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86a4149630 0x7f86a41e2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:02.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a8e7a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86a41e31e0 0x7f86a41df7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:02.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a8e7a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a413f170 con 0x7f86a41e31e0 2023-11-16T02:30:02.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a8e7a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a41e3650 con 0x7f868c003f00 2023-11-16T02:30:02.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a8e7a640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a41401b0 con 0x7f86a4149630 2023-11-16T02:30:02.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a2d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86a41e31e0 0x7f86a41df7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:02.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a2d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86a41e31e0 0x7f86a41df7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50196/0 (socket says 172.21.15.28:50196) 2023-11-16T02:30:02.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a2d9d640 1 -- 172.21.15.28:0/1861216300 learned_addr learned my addr 172.21.15.28:0/1861216300 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:02.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a1d9b640 1 --2- 172.21.15.28:0/1861216300 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86a4149630 0x7f86a41e2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:02.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a259c640 1 --2- 172.21.15.28:0/1861216300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f868c003f00 0x7f86a413ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:02.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a2d9d640 1 -- 172.21.15.28:0/1861216300 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86a4149630 msgr2=0x7f86a41e2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:02.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a2d9d640 1 --2- 172.21.15.28:0/1861216300 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86a4149630 0x7f86a41e2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:02.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a2d9d640 1 -- 172.21.15.28:0/1861216300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f868c003f00 msgr2=0x7f86a413ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:02.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a2d9d640 1 --2- 172.21.15.28:0/1861216300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f868c003f00 0x7f86a413ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:02.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a2d9d640 1 -- 172.21.15.28:0/1861216300 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a41413d0 con 0x7f86a41e31e0 2023-11-16T02:30:02.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a259c640 1 --2- 172.21.15.28:0/1861216300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f868c003f00 0x7f86a413ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:02.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a2d9d640 1 --2- 172.21.15.28:0/1861216300 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86a41e31e0 0x7f86a41df7a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f86a406ad50 tx=0x7f869c00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:02.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f8692ffd640 1 -- 172.21.15.28:0/1861216300 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c016420 con 0x7f86a41e31e0 2023-11-16T02:30:02.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f8692ffd640 1 -- 172.21.15.28:0/1861216300 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869c0165a0 con 0x7f86a41e31e0 2023-11-16T02:30:02.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a8e7a640 1 -- 172.21.15.28:0/1861216300 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a4149350 con 0x7f86a41e31e0 2023-11-16T02:30:02.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f8692ffd640 1 -- 172.21.15.28:0/1861216300 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c016950 con 0x7f86a41e31e0 2023-11-16T02:30:02.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.641+0000 7f86a8e7a640 1 -- 172.21.15.28:0/1861216300 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a413fe40 con 0x7f86a41e31e0 2023-11-16T02:30:02.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.645+0000 7f86a8e7a640 1 -- 172.21.15.28:0/1861216300 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a413f9c0 con 0x7f86a41e31e0 2023-11-16T02:30:02.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.645+0000 7f8692ffd640 1 -- 172.21.15.28:0/1861216300 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f869c016ab0 con 0x7f86a41e31e0 2023-11-16T02:30:02.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.645+0000 7f8692ffd640 1 --2- 172.21.15.28:0/1861216300 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8684065a90 0x7f8684067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:02.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.645+0000 7f8692ffd640 1 -- 172.21.15.28:0/1861216300 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f869c083f40 con 0x7f86a41e31e0 2023-11-16T02:30:02.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.645+0000 7f86a259c640 1 --2- 172.21.15.28:0/1861216300 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8684065a90 0x7f8684067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:02.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.645+0000 7f86a259c640 1 --2- 172.21.15.28:0/1861216300 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8684065a90 0x7f8684067f50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f86940099e0 tx=0x7f8694008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:02.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.649+0000 7f8692ffd640 1 -- 172.21.15.28:0/1861216300 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f86a413f9c0 con 0x7f86a41e31e0 2023-11-16T02:30:02.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:02.857+0000 7f86a8e7a640 1 -- 172.21.15.28:0/1861216300 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) v1 -- 0x7f86a413f9c0 con 0x7f86a41e31e0 2023-11-16T02:30:03.555 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.556+0000 7f8692ffd640 1 -- 172.21.15.28:0/1861216300 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v47) v1 ==== 166+0+0 (secure 0 0 0) 0x7f86a413f9c0 con 0x7f86a41e31e0 2023-11-16T02:30:03.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.556+0000 7f86a8e7a640 1 -- 172.21.15.28:0/1861216300 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8684065a90 msgr2=0x7f8684067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:03.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.556+0000 7f86a8e7a640 1 --2- 172.21.15.28:0/1861216300 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8684065a90 0x7f8684067f50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f86940099e0 tx=0x7f8694008040 comp rx=0 tx=0).stop 2023-11-16T02:30:03.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.556+0000 7f86a8e7a640 1 -- 172.21.15.28:0/1861216300 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86a41e31e0 msgr2=0x7f86a41df7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:03.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.556+0000 7f86a8e7a640 1 --2- 172.21.15.28:0/1861216300 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86a41e31e0 0x7f86a41df7a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f86a406ad50 tx=0x7f869c00f520 comp rx=0 tx=0).stop 2023-11-16T02:30:03.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.556+0000 7f86a8e7a640 1 -- 172.21.15.28:0/1861216300 shutdown_connections 2023-11-16T02:30:03.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.556+0000 7f86a8e7a640 1 --2- 172.21.15.28:0/1861216300 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8684065a90 0x7f8684067f50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:03.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.556+0000 7f86a8e7a640 1 --2- 172.21.15.28:0/1861216300 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86a41e31e0 0x7f86a41df7a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:03.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.556+0000 7f86a8e7a640 1 --2- 172.21.15.28:0/1861216300 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86a4149630 0x7f86a41e2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:03.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.556+0000 7f86a8e7a640 1 --2- 172.21.15.28:0/1861216300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f868c003f00 0x7f86a413ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:03.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.556+0000 7f86a8e7a640 1 -- 172.21.15.28:0/1861216300 >> 172.21.15.28:0/1861216300 conn(0x7f86a406b770 msgr2=0x7f86a40bef20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:03.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.556+0000 7f86a8e7a640 1 -- 172.21.15.28:0/1861216300 shutdown_connections 2023-11-16T02:30:03.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.556+0000 7f86a8e7a640 1 -- 172.21.15.28:0/1861216300 wait complete. 2023-11-16T02:30:03.580 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-16T02:30:03.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f35933d9640 1 Processor -- start 2023-11-16T02:30:03.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f35933d9640 1 -- start start 2023-11-16T02:30:03.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f35933d9640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f358c06a550 0x7f358c0b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:03.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f35933d9640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f358c0b7c60 0x7f358c0b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:03.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f35933d9640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f358c071800 con 0x7f358c06a170 2023-11-16T02:30:03.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f35933d9640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f358c0b5ec0 con 0x7f358c06a550 2023-11-16T02:30:03.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f35933d9640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358c0b6350 con 0x7f358c0b7c60 2023-11-16T02:30:03.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3591175640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f358c06a170 0x7f358c148a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37230/0 (socket says 172.21.15.28:37230) 2023-11-16T02:30:03.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3591175640 1 -- 172.21.15.28:0/2608360246 learned_addr learned my addr 172.21.15.28:0/2608360246 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:03.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3590974640 1 --2- 172.21.15.28:0/2608360246 >> v2:172.21.15.70:3300/0 conn(0x7f358c06a550 0x7f358c0b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:03.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3591976640 1 --2- 172.21.15.28:0/2608360246 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f358c0b7c60 0x7f358c0b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:03.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3583fff640 1 -- 172.21.15.28:0/2608360246 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 738309936 0 0) 0x7f3588001120 con 0x7f358c06a170 2023-11-16T02:30:03.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3583fff640 1 -- 172.21.15.28:0/2608360246 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3578003530 con 0x7f358c06a170 2023-11-16T02:30:03.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3583fff640 1 -- 172.21.15.28:0/2608360246 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1729717011 0 0) 0x7f3578003530 con 0x7f358c06a170 2023-11-16T02:30:03.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3583fff640 1 -- 172.21.15.28:0/2608360246 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f358c0b7c60 msgr2=0x7f358c0b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:03.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3583fff640 1 --2- 172.21.15.28:0/2608360246 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f358c0b7c60 0x7f358c0b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:03.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3583fff640 1 -- 172.21.15.28:0/2608360246 >> v2:172.21.15.70:3300/0 conn(0x7f358c06a550 msgr2=0x7f358c0b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:03.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3583fff640 1 --2- 172.21.15.28:0/2608360246 >> v2:172.21.15.70:3300/0 conn(0x7f358c06a550 0x7f358c0b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:03.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3583fff640 1 -- 172.21.15.28:0/2608360246 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358c0b5870 con 0x7f358c06a170 2023-11-16T02:30:03.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3583fff640 1 -- 172.21.15.28:0/2608360246 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7f3588001810 con 0x7f358c06a170 2023-11-16T02:30:03.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3583fff640 1 -- 172.21.15.28:0/2608360246 >> v1:172.21.15.28:6789/0 conn(0x7f358c06a170 legacy=0x7f358c148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:03.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3583fff640 1 --2- 172.21.15.28:0/2608360246 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3578003980 0x7f3578003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:03.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3583fff640 1 --2- 172.21.15.28:0/2608360246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35780047d0 0x7f3578004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:03.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3583fff640 1 --2- 172.21.15.28:0/2608360246 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f358c0b7c60 0x7f3578005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:03.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3583fff640 1 -- 172.21.15.28:0/2608360246 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c0b5ec0 con 0x7f3578003980 2023-11-16T02:30:03.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3583fff640 1 -- 172.21.15.28:0/2608360246 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c0b6350 con 0x7f35780047d0 2023-11-16T02:30:03.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3583fff640 1 -- 172.21.15.28:0/2608360246 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357800b990 con 0x7f358c0b7c60 2023-11-16T02:30:03.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3591175640 1 --2- 172.21.15.28:0/2608360246 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3578003980 0x7f3578003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:03.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3591976640 1 --2- 172.21.15.28:0/2608360246 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f358c0b7c60 0x7f3578005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:03.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3590974640 1 --2- 172.21.15.28:0/2608360246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35780047d0 0x7f3578004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:03.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3591175640 1 -- 172.21.15.28:0/2608360246 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f358c0b7c60 msgr2=0x7f3578005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:03.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3591175640 1 --2- 172.21.15.28:0/2608360246 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f358c0b7c60 0x7f3578005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:03.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3591175640 1 -- 172.21.15.28:0/2608360246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35780047d0 msgr2=0x7f3578004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:03.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3591175640 1 --2- 172.21.15.28:0/2608360246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35780047d0 0x7f3578004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:03.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.712+0000 7f3591175640 1 -- 172.21.15.28:0/2608360246 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3578003530 con 0x7f3578003980 2023-11-16T02:30:03.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.716+0000 7f3591175640 1 --2- 172.21.15.28:0/2608360246 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3578003980 0x7f3578003da0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f358800c1f0 tx=0x7f358801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982f73064595fb07 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:03.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.716+0000 7f3583fff640 1 -- 172.21.15.28:0/2608360246 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35880058e0 con 0x7f3578003980 2023-11-16T02:30:03.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.716+0000 7f3583fff640 1 -- 172.21.15.28:0/2608360246 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3588005a40 con 0x7f3578003980 2023-11-16T02:30:03.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.716+0000 7f3583fff640 1 -- 172.21.15.28:0/2608360246 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3588005e10 con 0x7f3578003980 2023-11-16T02:30:03.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.716+0000 7f35933d9640 1 -- 172.21.15.28:0/2608360246 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3578003980 msgr2=0x7f3578003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:03.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.716+0000 7f35933d9640 1 --2- 172.21.15.28:0/2608360246 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3578003980 0x7f3578003da0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f358800c1f0 tx=0x7f358801cc40 comp rx=0 tx=0).stop 2023-11-16T02:30:03.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.716+0000 7f3591976640 1 -- 172.21.15.28:0/2608360246 reap_dead start 2023-11-16T02:30:03.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.716+0000 7f35933d9640 1 -- 172.21.15.28:0/2608360246 shutdown_connections 2023-11-16T02:30:03.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.716+0000 7f35933d9640 1 -- 172.21.15.28:0/2608360246 >> 172.21.15.28:0/2608360246 conn(0x7f358c0bc5a0 msgr2=0x7f358c0bc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:03.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.716+0000 7f35933d9640 1 -- 172.21.15.28:0/2608360246 shutdown_connections 2023-11-16T02:30:03.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.716+0000 7f35933d9640 1 -- 172.21.15.28:0/2608360246 wait complete. 2023-11-16T02:30:03.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.716+0000 7f35933d9640 1 Processor -- start 2023-11-16T02:30:03.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.716+0000 7f35933d9640 1 -- start start 2023-11-16T02:30:03.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f35933d9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3578003980 0x7f358c13c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:03.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f35933d9640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f358c1e1cb0 0x7f358c13b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:03.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f35933d9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f358c13cad0 0x7f358c1e3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:03.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f35933d9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c13c6f0 con 0x7f358c13cad0 2023-11-16T02:30:03.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f35933d9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c1485c0 con 0x7f3578003980 2023-11-16T02:30:03.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f35933d9640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358c13bd30 con 0x7f358c1e1cb0 2023-11-16T02:30:03.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f3591976640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f358c13cad0 0x7f358c1e3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:03.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f3591976640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f358c13cad0 0x7f358c1e3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50210/0 (socket says 172.21.15.28:50210) 2023-11-16T02:30:03.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f3591976640 1 -- 172.21.15.28:0/3271676118 learned_addr learned my addr 172.21.15.28:0/3271676118 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:03.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f3590974640 1 --2- 172.21.15.28:0/3271676118 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f358c1e1cb0 0x7f358c13b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:03.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f3591175640 1 --2- 172.21.15.28:0/3271676118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3578003980 0x7f358c13c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:03.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f3591976640 1 -- 172.21.15.28:0/3271676118 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f358c1e1cb0 msgr2=0x7f358c13b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:03.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f3591976640 1 --2- 172.21.15.28:0/3271676118 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f358c1e1cb0 0x7f358c13b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:03.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f3591976640 1 -- 172.21.15.28:0/3271676118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3578003980 msgr2=0x7f358c13c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:03.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f3591976640 1 --2- 172.21.15.28:0/3271676118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3578003980 0x7f358c13c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:03.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f3591976640 1 -- 172.21.15.28:0/3271676118 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358c148000 con 0x7f358c13cad0 2023-11-16T02:30:03.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f3591976640 1 --2- 172.21.15.28:0/3271676118 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f358c13cad0 0x7f358c1e3db0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f358c0b3230 tx=0x7f35840115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:03.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f3581ffb640 1 -- 172.21.15.28:0/3271676118 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358400e070 con 0x7f358c13cad0 2023-11-16T02:30:03.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f3581ffb640 1 -- 172.21.15.28:0/3271676118 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3584011ed0 con 0x7f358c13cad0 2023-11-16T02:30:03.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f35933d9640 1 -- 172.21.15.28:0/3271676118 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f358c1482e0 con 0x7f358c13cad0 2023-11-16T02:30:03.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f3581ffb640 1 -- 172.21.15.28:0/3271676118 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35840039a0 con 0x7f358c13cad0 2023-11-16T02:30:03.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f35933d9640 1 -- 172.21.15.28:0/3271676118 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f358c0b2bf0 con 0x7f358c13cad0 2023-11-16T02:30:03.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f35933d9640 1 -- 172.21.15.28:0/3271676118 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f358c13b510 con 0x7f358c13cad0 2023-11-16T02:30:03.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f3581ffb640 1 -- 172.21.15.28:0/3271676118 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3584003b20 con 0x7f358c13cad0 2023-11-16T02:30:03.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f3581ffb640 1 --2- 172.21.15.28:0/3271676118 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3570065a60 0x7f3570067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:03.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f3581ffb640 1 -- 172.21.15.28:0/3271676118 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35840845e0 con 0x7f358c13cad0 2023-11-16T02:30:03.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f3591175640 1 --2- 172.21.15.28:0/3271676118 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3570065a60 0x7f3570067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:03.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.720+0000 7f3591175640 1 --2- 172.21.15.28:0/3271676118 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3570065a60 0x7f3570067f20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f35880aa000 tx=0x7f3588001ba0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:03.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.724+0000 7f3581ffb640 1 -- 172.21.15.28:0/3271676118 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f3584052010 con 0x7f358c13cad0 2023-11-16T02:30:03.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.880+0000 7f35933d9640 1 -- 172.21.15.28:0/3271676118 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f358c13b510 con 0x7f358c13cad0 2023-11-16T02:30:03.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.892+0000 7f3581ffb640 1 -- 172.21.15.28:0/3271676118 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3584055630 con 0x7f358c13cad0 2023-11-16T02:30:03.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.892+0000 7f35933d9640 1 -- 172.21.15.28:0/3271676118 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3570065a60 msgr2=0x7f3570067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:03.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.892+0000 7f35933d9640 1 --2- 172.21.15.28:0/3271676118 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3570065a60 0x7f3570067f20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f35880aa000 tx=0x7f3588001ba0 comp rx=0 tx=0).stop 2023-11-16T02:30:03.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.892+0000 7f35933d9640 1 -- 172.21.15.28:0/3271676118 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f358c13cad0 msgr2=0x7f358c1e3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:03.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.892+0000 7f35933d9640 1 --2- 172.21.15.28:0/3271676118 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f358c13cad0 0x7f358c1e3db0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f358c0b3230 tx=0x7f35840115a0 comp rx=0 tx=0).stop 2023-11-16T02:30:03.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.896+0000 7f35933d9640 1 -- 172.21.15.28:0/3271676118 shutdown_connections 2023-11-16T02:30:03.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.896+0000 7f35933d9640 1 --2- 172.21.15.28:0/3271676118 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3570065a60 0x7f3570067f20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:03.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.896+0000 7f35933d9640 1 --2- 172.21.15.28:0/3271676118 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f358c13cad0 0x7f358c1e3db0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:03.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.896+0000 7f35933d9640 1 --2- 172.21.15.28:0/3271676118 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f358c1e1cb0 0x7f358c13b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:03.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.896+0000 7f35933d9640 1 --2- 172.21.15.28:0/3271676118 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3578003980 0x7f358c13c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:03.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.896+0000 7f35933d9640 1 -- 172.21.15.28:0/3271676118 >> 172.21.15.28:0/3271676118 conn(0x7f358c0bc5a0 msgr2=0x7f358c140940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:03.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.896+0000 7f35933d9640 1 -- 172.21.15.28:0/3271676118 shutdown_connections 2023-11-16T02:30:03.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:03.896+0000 7f35933d9640 1 -- 172.21.15.28:0/3271676118 wait complete. 2023-11-16T02:30:03.912 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-16T02:30:03.912 DEBUG:teuthology.orchestra.run.smithi028:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-16T02:30:03.968 DEBUG:teuthology.orchestra.run.smithi070:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-16T02:30:04.011 DEBUG:teuthology.orchestra.run.smithi204:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-16T02:30:04.077 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-16T02:30:04.078 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-16T02:30:04.082 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-16T02:30:04.097 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-16T02:30:04.097 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-16T02:30:04.151 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-16T02:30:04.152 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-16T02:30:04.207 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-16T02:30:04.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.344+0000 7fdca7bfd640 1 Processor -- start 2023-11-16T02:30:04.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.344+0000 7fdca7bfd640 1 -- start start 2023-11-16T02:30:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.344+0000 7fdca7bfd640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fdca00b7dd0 0x7fdca0142850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.344+0000 7fdca7bfd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdca00b5fe0 0x7fdca0142d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.344+0000 7fdca7bfd640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca00b88a0 con 0x7fdca00bc830 2023-11-16T02:30:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.344+0000 7fdca7bfd640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca00b3450 con 0x7fdca00b5fe0 2023-11-16T02:30:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.344+0000 7fdca7bfd640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca00b3fd0 con 0x7fdca00b7dd0 2023-11-16T02:30:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.344+0000 7fdca619a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdca00b5fe0 0x7fdca0142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.344+0000 7fdca5198640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fdca00bc830 0x7fdca00b58d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37234/0 (socket says 172.21.15.28:37234) 2023-11-16T02:30:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.344+0000 7fdca619a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdca00b5fe0 0x7fdca0142d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50226/0 (socket says 172.21.15.28:50226) 2023-11-16T02:30:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.344+0000 7fdca5198640 1 -- 172.21.15.28:0/2438550147 learned_addr learned my addr 172.21.15.28:0/2438550147 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.344+0000 7fdca5999640 1 --2- 172.21.15.28:0/2438550147 >> v2:172.21.15.70:3300/0 conn(0x7fdca00b7dd0 0x7fdca0142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.344+0000 7fdca619a640 1 -- 172.21.15.28:0/2438550147 >> v2:172.21.15.70:3300/0 conn(0x7fdca00b7dd0 msgr2=0x7fdca0142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:04.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.344+0000 7fdca619a640 1 --2- 172.21.15.28:0/2438550147 >> v2:172.21.15.70:3300/0 conn(0x7fdca00b7dd0 0x7fdca0142850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:04.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.344+0000 7fdca619a640 1 -- 172.21.15.28:0/2438550147 >> v1:172.21.15.28:6789/0 conn(0x7fdca00bc830 legacy=0x7fdca00b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:04.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.344+0000 7fdca619a640 1 -- 172.21.15.28:0/2438550147 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca00b36a0 con 0x7fdca00b5fe0 2023-11-16T02:30:04.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.344+0000 7fdca4997640 1 -- 172.21.15.28:0/2438550147 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 145202764 0 0) 0x7fdca00b88a0 con 0x7fdca00bc830 2023-11-16T02:30:04.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.344+0000 7fdca619a640 1 --2- 172.21.15.28:0/2438550147 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdca00b5fe0 0x7fdca0142d90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdca00bc7c0 tx=0x7fdc9801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c034090c2fd487d server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:04.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca4997640 1 -- 172.21.15.28:0/2438550147 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc980ab600 con 0x7fdca00b5fe0 2023-11-16T02:30:04.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca4997640 1 -- 172.21.15.28:0/2438550147 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc980a7050 con 0x7fdca00b5fe0 2023-11-16T02:30:04.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca4997640 1 -- 172.21.15.28:0/2438550147 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc980ab980 con 0x7fdca00b5fe0 2023-11-16T02:30:04.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca7bfd640 1 -- 172.21.15.28:0/2438550147 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdca00b5fe0 msgr2=0x7fdca0142d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:04.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca7bfd640 1 --2- 172.21.15.28:0/2438550147 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdca00b5fe0 0x7fdca0142d90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdca00bc7c0 tx=0x7fdc9801c430 comp rx=0 tx=0).stop 2023-11-16T02:30:04.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca7bfd640 1 -- 172.21.15.28:0/2438550147 shutdown_connections 2023-11-16T02:30:04.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca7bfd640 1 --2- 172.21.15.28:0/2438550147 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdca00b5fe0 0x7fdca0142d90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:04.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca7bfd640 1 --2- 172.21.15.28:0/2438550147 >> v2:172.21.15.70:3300/0 conn(0x7fdca00b7dd0 0x7fdca0142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:04.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca7bfd640 1 -- 172.21.15.28:0/2438550147 >> 172.21.15.28:0/2438550147 conn(0x7fdca00b9050 msgr2=0x7fdca00bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:04.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca7bfd640 1 -- 172.21.15.28:0/2438550147 shutdown_connections 2023-11-16T02:30:04.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca7bfd640 1 -- 172.21.15.28:0/2438550147 wait complete. 2023-11-16T02:30:04.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca7bfd640 1 Processor -- start 2023-11-16T02:30:04.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca7bfd640 1 -- start start 2023-11-16T02:30:04.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca7bfd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdca00b5fe0 0x7fdca0132290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:04.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca7bfd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdca00b7dd0 0x7fdca01e45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:04.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca7bfd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdca00bc830 0x7fdca01e4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:04.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca7bfd640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca013d960 con 0x7fdca00b5fe0 2023-11-16T02:30:04.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca7bfd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca01327d0 con 0x7fdca00b7dd0 2023-11-16T02:30:04.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca7bfd640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca013ce20 con 0x7fdca00bc830 2023-11-16T02:30:04.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca5999640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdca00b5fe0 0x7fdca0132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:04.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca5999640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdca00b5fe0 0x7fdca0132290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50238/0 (socket says 172.21.15.28:50238) 2023-11-16T02:30:04.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca5999640 1 -- 172.21.15.28:0/431691675 learned_addr learned my addr 172.21.15.28:0/431691675 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:04.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca619a640 1 --2- 172.21.15.28:0/431691675 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdca00bc830 0x7fdca01e4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:04.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca5999640 1 -- 172.21.15.28:0/431691675 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdca00bc830 msgr2=0x7fdca01e4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:04.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca5999640 1 --2- 172.21.15.28:0/431691675 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdca00bc830 0x7fdca01e4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:04.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca5999640 1 -- 172.21.15.28:0/431691675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdca00b7dd0 msgr2=0x7fdca01e45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:04.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca5999640 1 --2- 172.21.15.28:0/431691675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdca00b7dd0 0x7fdca01e45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:04.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca5999640 1 -- 172.21.15.28:0/431691675 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc98009420 con 0x7fdca00b5fe0 2023-11-16T02:30:04.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca5999640 1 --2- 172.21.15.28:0/431691675 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdca00b5fe0 0x7fdca0132290 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c007ef0 tx=0x7fdc9c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:04.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdc967fc640 1 -- 172.21.15.28:0/431691675 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c014620 con 0x7fdca00b5fe0 2023-11-16T02:30:04.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdc967fc640 1 -- 172.21.15.28:0/431691675 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c014780 con 0x7fdca00b5fe0 2023-11-16T02:30:04.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdc967fc640 1 -- 172.21.15.28:0/431691675 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c014b30 con 0x7fdca00b5fe0 2023-11-16T02:30:04.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca7bfd640 1 -- 172.21.15.28:0/431691675 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca013d100 con 0x7fdca00b5fe0 2023-11-16T02:30:04.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.348+0000 7fdca7bfd640 1 -- 172.21.15.28:0/431691675 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca013e5b0 con 0x7fdca00b5fe0 2023-11-16T02:30:04.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.352+0000 7fdca7bfd640 1 -- 172.21.15.28:0/431691675 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca01e42c0 con 0x7fdca00b5fe0 2023-11-16T02:30:04.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.352+0000 7fdc967fc640 1 -- 172.21.15.28:0/431691675 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdc9c014c90 con 0x7fdca00b5fe0 2023-11-16T02:30:04.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.352+0000 7fdc967fc640 1 --2- 172.21.15.28:0/431691675 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fdc84065a90 0x7fdc84067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:04.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.352+0000 7fdc967fc640 1 -- 172.21.15.28:0/431691675 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc9c083b60 con 0x7fdca00b5fe0 2023-11-16T02:30:04.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.352+0000 7fdca5198640 1 --2- 172.21.15.28:0/431691675 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fdc84065a90 0x7fdc84067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:04.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.352+0000 7fdca5198640 1 --2- 172.21.15.28:0/431691675 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fdc84065a90 0x7fdc84067f50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdca0073c10 tx=0x7fdc90007970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:04.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.356+0000 7fdc967fc640 1 -- 172.21.15.28:0/431691675 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fdca01e42c0 con 0x7fdca00b5fe0 2023-11-16T02:30:04.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.512+0000 7fdca7bfd640 1 -- 172.21.15.28:0/431691675 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdca01e42c0 con 0x7fdca00b5fe0 2023-11-16T02:30:04.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.516+0000 7fdc967fc640 1 -- 172.21.15.28:0/431691675 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15989 (secure 0 0 0) 0x7fdca01e42c0 con 0x7fdca00b5fe0 2023-11-16T02:30:04.516 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:30:04.516 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":22,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","created":"2023-11-16T02:29:13.710567+0000","modified":"2023-11-16T02:29:38.871066+0000","last_up_change":"2023-11-16T02:29:24.841087+0000","last_in_change":"2023-11-16T02:29:16.024490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-16T02:29:26.490910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-16T02:29:36.133224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-16T02:29:36.866156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dfa8b58d-3481-4e68-86e8-21873d31d0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":38722},{"type":"v1","addr":"172.21.15.28:6809","nonce":38722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":38722},{"type":"v1","addr":"172.21.15.28:6811","nonce":38722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":38722},{"type":"v1","addr":"172.21.15.28:6815","nonce":38722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":38722},{"type":"v1","addr":"172.21.15.28:6813","nonce":38722}]},"public_addr":"172.21.15.28:6809/38722","cluster_addr":"172.21.15.28:6811/38722","heartbeat_back_addr":"172.21.15.28:6815/38722","heartbeat_front_addr":"172.21.15.28:6813/38722","state":["exists","up"]},{"osd":1,"uuid":"1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":38724},{"type":"v1","addr":"172.21.15.28:6824","nonce":38724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":38724},{"type":"v1","addr":"172.21.15.28:6827","nonce":38724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":38724},{"type":"v1","addr":"172.21.15.28:6831","nonce":38724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":38724},{"type":"v1","addr":"172.21.15.28:6829","nonce":38724}]},"public_addr":"172.21.15.28:6824/38724","cluster_addr":"172.21.15.28:6827/38724","heartbeat_back_addr":"172.21.15.28:6831/38724","heartbeat_front_addr":"172.21.15.28:6829/38724","state":["exists","up"]},{"osd":2,"uuid":"e18f39cd-6a35-4d36-9eed-3877794bf2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":38723},{"type":"v1","addr":"172.21.15.28:6801","nonce":38723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":38723},{"type":"v1","addr":"172.21.15.28:6803","nonce":38723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":38723},{"type":"v1","addr":"172.21.15.28:6807","nonce":38723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":38723},{"type":"v1","addr":"172.21.15.28:6805","nonce":38723}]},"public_addr":"172.21.15.28:6801/38723","cluster_addr":"172.21.15.28:6803/38723","heartbeat_back_addr":"172.21.15.28:6807/38723","heartbeat_front_addr":"172.21.15.28:6805/38723","state":["exists","up"]},{"osd":3,"uuid":"303d0728-409d-47d7-b7a6-6eb273f602fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":38725},{"type":"v1","addr":"172.21.15.28:6817","nonce":38725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":38725},{"type":"v1","addr":"172.21.15.28:6819","nonce":38725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":38725},{"type":"v1","addr":"172.21.15.28:6825","nonce":38725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":38725},{"type":"v1","addr":"172.21.15.28:6821","nonce":38725}]},"public_addr":"172.21.15.28:6817/38725","cluster_addr":"172.21.15.28:6819/38725","heartbeat_back_addr":"172.21.15.28:6825/38725","heartbeat_front_addr":"172.21.15.28:6821/38725","state":["exists","up"]},{"osd":4,"uuid":"df0bf0ac-6efe-4964-ad27-7c1771a70c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":38828},{"type":"v1","addr":"172.21.15.70:6801","nonce":38828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":38828},{"type":"v1","addr":"172.21.15.70:6803","nonce":38828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":38828},{"type":"v1","addr":"172.21.15.70:6807","nonce":38828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":38828},{"type":"v1","addr":"172.21.15.70:6805","nonce":38828}]},"public_addr":"172.21.15.70:6801/38828","cluster_addr":"172.21.15.70:6803/38828","heartbeat_back_addr":"172.21.15.70:6807/38828","heartbeat_front_addr":"172.21.15.70:6805/38828","state":["exists","up"]},{"osd":5,"uuid":"84921219-65cb-4c4e-b9ed-a773db639034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":38830},{"type":"v1","addr":"172.21.15.70:6810","nonce":38830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6813","nonce":38830},{"type":"v1","addr":"172.21.15.70:6814","nonce":38830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":38830},{"type":"v1","addr":"172.21.15.70:6824","nonce":38830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":38830},{"type":"v1","addr":"172.21.15.70:6819","nonce":38830}]},"public_addr":"172.21.15.70:6810/38830","cluster_addr":"172.21.15.70:6814/38830","heartbeat_back_addr":"172.21.15.70:6824/38830","heartbeat_front_addr":"172.21.15.70:6819/38830","state":["exists","up"]},{"osd":6,"uuid":"c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":38829},{"type":"v1","addr":"172.21.15.70:6812","nonce":38829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":38829},{"type":"v1","addr":"172.21.15.70:6820","nonce":38829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":38829},{"type":"v1","addr":"172.21.15.70:6828","nonce":38829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":38829},{"type":"v1","addr":"172.21.15.70:6825","nonce":38829}]},"public_addr":"172.21.15.70:6812/38829","cluster_addr":"172.21.15.70:6820/38829","heartbeat_back_addr":"172.21.15.70:6828/38829","heartbeat_front_addr":"172.21.15.70:6825/38829","state":["exists","up"]},{"osd":7,"uuid":"e2cdd418-12ce-4eea-9b22-efdad83eb76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":38839},{"type":"v1","addr":"172.21.15.70:6815","nonce":38839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":38839},{"type":"v1","addr":"172.21.15.70:6823","nonce":38839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":38839},{"type":"v1","addr":"172.21.15.70:6831","nonce":38839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6827","nonce":38839},{"type":"v1","addr":"172.21.15.70:6829","nonce":38839}]},"public_addr":"172.21.15.70:6815/38839","cluster_addr":"172.21.15.70:6823/38839","heartbeat_back_addr":"172.21.15.70:6831/38839","heartbeat_front_addr":"172.21.15.70:6829/38839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.544240+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.637637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.352115+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.652916+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.624477+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.570247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.706468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.696574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-16T02:30:04.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.516+0000 7fdca7bfd640 1 -- 172.21.15.28:0/431691675 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fdc84065a90 msgr2=0x7fdc84067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:04.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.516+0000 7fdca7bfd640 1 --2- 172.21.15.28:0/431691675 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fdc84065a90 0x7fdc84067f50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdca0073c10 tx=0x7fdc90007970 comp rx=0 tx=0).stop 2023-11-16T02:30:04.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.516+0000 7fdca7bfd640 1 -- 172.21.15.28:0/431691675 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdca00b5fe0 msgr2=0x7fdca0132290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:04.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.516+0000 7fdca7bfd640 1 --2- 172.21.15.28:0/431691675 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdca00b5fe0 0x7fdca0132290 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c007ef0 tx=0x7fdc9c00e4b0 comp rx=0 tx=0).stop 2023-11-16T02:30:04.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.516+0000 7fdca7bfd640 1 -- 172.21.15.28:0/431691675 shutdown_connections 2023-11-16T02:30:04.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.516+0000 7fdca7bfd640 1 --2- 172.21.15.28:0/431691675 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fdc84065a90 0x7fdc84067f50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:04.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.516+0000 7fdca7bfd640 1 --2- 172.21.15.28:0/431691675 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdca00bc830 0x7fdca01e4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:04.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.516+0000 7fdca7bfd640 1 --2- 172.21.15.28:0/431691675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdca00b7dd0 0x7fdca01e45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:04.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.516+0000 7fdca7bfd640 1 --2- 172.21.15.28:0/431691675 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdca00b5fe0 0x7fdca0132290 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:04.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.516+0000 7fdca7bfd640 1 -- 172.21.15.28:0/431691675 >> 172.21.15.28:0/431691675 conn(0x7fdca00b9050 msgr2=0x7fdca013f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:04.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.516+0000 7fdca7bfd640 1 -- 172.21.15.28:0/431691675 shutdown_connections 2023-11-16T02:30:04.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.516+0000 7fdca7bfd640 1 -- 172.21.15.28:0/431691675 wait complete. 2023-11-16T02:30:04.535 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-16T02:29:26.490910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-16T02:29:36.133224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-16T02:29:36.866156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-16T02:30:04.535 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-16T02:30:04.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.660+0000 7f19275cd640 1 Processor -- start 2023-11-16T02:30:04.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f19275cd640 1 -- start start 2023-11-16T02:30:04.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f19275cd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f192006a550 0x7f19200b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:04.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f19275cd640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1920071800 con 0x7f19200b7c60 2023-11-16T02:30:04.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f19275cd640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19200b5ec0 con 0x7f192006a170 2023-11-16T02:30:04.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f19275cd640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19200b6350 con 0x7f192006a550 2023-11-16T02:30:04.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f1925b6a640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f19200b7c60 0x7f1920153380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37240/0 (socket says 172.21.15.28:37240) 2023-11-16T02:30:04.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f1925b6a640 1 -- 172.21.15.28:0/687551481 learned_addr learned my addr 172.21.15.28:0/687551481 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:04.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f1924b68640 1 --2- 172.21.15.28:0/687551481 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f192006a550 0x7f19200b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:04.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f1917fff640 1 -- 172.21.15.28:0/687551481 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 708022307 0 0) 0x7f191c001120 con 0x7f19200b7c60 2023-11-16T02:30:04.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f1917fff640 1 -- 172.21.15.28:0/687551481 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f190c003530 con 0x7f19200b7c60 2023-11-16T02:30:04.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f1917fff640 1 -- 172.21.15.28:0/687551481 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 787970038 0 0) 0x7f190c003530 con 0x7f19200b7c60 2023-11-16T02:30:04.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f1917fff640 1 -- 172.21.15.28:0/687551481 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f192006a550 msgr2=0x7f19200b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:04.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f1917fff640 1 --2- 172.21.15.28:0/687551481 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f192006a550 0x7f19200b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:04.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f1917fff640 1 -- 172.21.15.28:0/687551481 >> v1:172.21.15.70:6789/0 conn(0x7f192006a170 legacy=0x7f1920148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:04.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f1917fff640 1 -- 172.21.15.28:0/687551481 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19200b5870 con 0x7f19200b7c60 2023-11-16T02:30:04.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f1917fff640 1 -- 172.21.15.28:0/687551481 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7f191c001810 con 0x7f19200b7c60 2023-11-16T02:30:04.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f1917fff640 1 -- 172.21.15.28:0/687551481 >> v1:172.21.15.28:6789/0 conn(0x7f19200b7c60 legacy=0x7f1920153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:04.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f1917fff640 1 --2- 172.21.15.28:0/687551481 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f190c0039b0 0x7f190c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:04.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f1917fff640 1 --2- 172.21.15.28:0/687551481 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f192006a550 0x7f190c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:04.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f1917fff640 1 --2- 172.21.15.28:0/687551481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f190c004d10 0x7f190c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:04.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f1917fff640 1 -- 172.21.15.28:0/687551481 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19200b6350 con 0x7f190c0039b0 2023-11-16T02:30:04.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f1917fff640 1 -- 172.21.15.28:0/687551481 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190c00bac0 con 0x7f190c004d10 2023-11-16T02:30:04.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f1917fff640 1 -- 172.21.15.28:0/687551481 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f190c00bc80 con 0x7f192006a550 2023-11-16T02:30:04.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f1925369640 1 --2- 172.21.15.28:0/687551481 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f190c0039b0 0x7f190c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:04.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f1924b68640 1 --2- 172.21.15.28:0/687551481 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f192006a550 0x7f190c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:04.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f1925369640 1 -- 172.21.15.28:0/687551481 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f192006a550 msgr2=0x7f190c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:04.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f1925369640 1 --2- 172.21.15.28:0/687551481 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f192006a550 0x7f190c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:04.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f1925369640 1 -- 172.21.15.28:0/687551481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f190c004d10 msgr2=0x7f190c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:04.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f1925369640 1 --2- 172.21.15.28:0/687551481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f190c004d10 0x7f190c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:04.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f1925369640 1 -- 172.21.15.28:0/687551481 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f190c003530 con 0x7f190c0039b0 2023-11-16T02:30:04.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.664+0000 7f1924b68640 1 --2- 172.21.15.28:0/687551481 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f192006a550 0x7f190c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:04.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f1925369640 1 --2- 172.21.15.28:0/687551481 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f190c0039b0 0x7f190c003dd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1918001e70 tx=0x7f191801c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad201df27a9e7e5f server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:04.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f1917fff640 1 -- 172.21.15.28:0/687551481 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1918003b80 con 0x7f190c0039b0 2023-11-16T02:30:04.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f1917fff640 1 -- 172.21.15.28:0/687551481 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1918003ce0 con 0x7f190c0039b0 2023-11-16T02:30:04.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f1917fff640 1 -- 172.21.15.28:0/687551481 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1918005310 con 0x7f190c0039b0 2023-11-16T02:30:04.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f19275cd640 1 -- 172.21.15.28:0/687551481 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f190c0039b0 msgr2=0x7f190c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:04.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f19275cd640 1 --2- 172.21.15.28:0/687551481 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f190c0039b0 0x7f190c003dd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1918001e70 tx=0x7f191801c6c0 comp rx=0 tx=0).stop 2023-11-16T02:30:04.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f1925b6a640 1 -- 172.21.15.28:0/687551481 reap_dead start 2023-11-16T02:30:04.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f19275cd640 1 -- 172.21.15.28:0/687551481 shutdown_connections 2023-11-16T02:30:04.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f19275cd640 1 -- 172.21.15.28:0/687551481 >> 172.21.15.28:0/687551481 conn(0x7f19200bc5a0 msgr2=0x7f19200bc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:04.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f19275cd640 1 -- 172.21.15.28:0/687551481 shutdown_connections 2023-11-16T02:30:04.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f19275cd640 1 -- 172.21.15.28:0/687551481 wait complete. 2023-11-16T02:30:04.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f19275cd640 1 Processor -- start 2023-11-16T02:30:04.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f19275cd640 1 -- start start 2023-11-16T02:30:04.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f19275cd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f192014bcb0 0x7f192014c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:04.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f19275cd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1920146d00 0x7f19201e4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:04.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f19275cd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1920147140 0x7f19201e4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:04.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f19275cd640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192014a8d0 con 0x7f1920147140 2023-11-16T02:30:04.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f19275cd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1920148260 con 0x7f1920146d00 2023-11-16T02:30:04.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f19275cd640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f192014a190 con 0x7f192014bcb0 2023-11-16T02:30:04.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f1925b6a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1920147140 0x7f19201e4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:04.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f1925b6a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1920147140 0x7f19201e4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50260/0 (socket says 172.21.15.28:50260) 2023-11-16T02:30:04.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f1925b6a640 1 -- 172.21.15.28:0/577842448 learned_addr learned my addr 172.21.15.28:0/577842448 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:04.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f1924b68640 1 --2- 172.21.15.28:0/577842448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1920146d00 0x7f19201e4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:04.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f1925369640 1 --2- 172.21.15.28:0/577842448 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f192014bcb0 0x7f192014c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:04.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f1925b6a640 1 -- 172.21.15.28:0/577842448 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f192014bcb0 msgr2=0x7f192014c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f1925b6a640 1 --2- 172.21.15.28:0/577842448 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f192014bcb0 0x7f192014c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f1925b6a640 1 -- 172.21.15.28:0/577842448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1920146d00 msgr2=0x7f19201e4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f1925b6a640 1 --2- 172.21.15.28:0/577842448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1920146d00 0x7f19201e4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f1925b6a640 1 -- 172.21.15.28:0/577842448 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1920147ef0 con 0x7f1920147140 2023-11-16T02:30:04.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f1925b6a640 1 --2- 172.21.15.28:0/577842448 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1920147140 0x7f19201e4f40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f191c001280 tx=0x7f191c00cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:04.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f1915ffb640 1 -- 172.21.15.28:0/577842448 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c004cc0 con 0x7f1920147140 2023-11-16T02:30:04.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f1915ffb640 1 -- 172.21.15.28:0/577842448 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191c004e20 con 0x7f1920147140 2023-11-16T02:30:04.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f19275cd640 1 -- 172.21.15.28:0/577842448 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f192014a470 con 0x7f1920147140 2023-11-16T02:30:04.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f1915ffb640 1 -- 172.21.15.28:0/577842448 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c007290 con 0x7f1920147140 2023-11-16T02:30:04.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.668+0000 7f19275cd640 1 -- 172.21.15.28:0/577842448 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19201486f0 con 0x7f1920147140 2023-11-16T02:30:04.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.672+0000 7f19275cd640 1 -- 172.21.15.28:0/577842448 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1920148410 con 0x7f1920147140 2023-11-16T02:30:04.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.672+0000 7f1915ffb640 1 -- 172.21.15.28:0/577842448 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f191c0073f0 con 0x7f1920147140 2023-11-16T02:30:04.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.672+0000 7f1915ffb640 1 --2- 172.21.15.28:0/577842448 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1904065a90 0x7f1904067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:04.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.672+0000 7f1925369640 1 --2- 172.21.15.28:0/577842448 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1904065a90 0x7f1904067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:04.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.672+0000 7f1915ffb640 1 -- 172.21.15.28:0/577842448 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f191c082380 con 0x7f1920147140 2023-11-16T02:30:04.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.672+0000 7f1925369640 1 --2- 172.21.15.28:0/577842448 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1904065a90 0x7f1904067f50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f19180ac000 tx=0x7f1918001520 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:04.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.676+0000 7f1915ffb640 1 -- 172.21.15.28:0/577842448 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f1920148410 con 0x7f1920147140 2023-11-16T02:30:04.679 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:30:04.682 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:30:04.685 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:30:04.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.832+0000 7f19275cd640 1 -- 172.21.15.28:0/577842448 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1920071800 con 0x7f1920147140 2023-11-16T02:30:04.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.832+0000 7f1915ffb640 1 -- 172.21.15.28:0/577842448 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1920071800 con 0x7f1920147140 2023-11-16T02:30:04.833 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-11-16T02:30:04.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.836+0000 7f19275cd640 1 -- 172.21.15.28:0/577842448 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1904065a90 msgr2=0x7f1904067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:04.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.836+0000 7f19275cd640 1 --2- 172.21.15.28:0/577842448 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1904065a90 0x7f1904067f50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f19180ac000 tx=0x7f1918001520 comp rx=0 tx=0).stop 2023-11-16T02:30:04.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.836+0000 7f19275cd640 1 -- 172.21.15.28:0/577842448 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1920147140 msgr2=0x7f19201e4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:04.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.836+0000 7f19275cd640 1 --2- 172.21.15.28:0/577842448 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1920147140 0x7f19201e4f40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f191c001280 tx=0x7f191c00cad0 comp rx=0 tx=0).stop 2023-11-16T02:30:04.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.836+0000 7f19275cd640 1 -- 172.21.15.28:0/577842448 shutdown_connections 2023-11-16T02:30:04.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.836+0000 7f19275cd640 1 --2- 172.21.15.28:0/577842448 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1904065a90 0x7f1904067f50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:04.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.836+0000 7f19275cd640 1 --2- 172.21.15.28:0/577842448 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1920147140 0x7f19201e4f40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:04.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.836+0000 7f19275cd640 1 --2- 172.21.15.28:0/577842448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1920146d00 0x7f19201e4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:04.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.836+0000 7f19275cd640 1 --2- 172.21.15.28:0/577842448 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f192014bcb0 0x7f192014c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:04.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.836+0000 7f19275cd640 1 -- 172.21.15.28:0/577842448 >> 172.21.15.28:0/577842448 conn(0x7f19200bc5a0 msgr2=0x7f192014d170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:04.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.836+0000 7f19275cd640 1 -- 172.21.15.28:0/577842448 shutdown_connections 2023-11-16T02:30:04.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.836+0000 7f19275cd640 1 -- 172.21.15.28:0/577842448 wait complete. 2023-11-16T02:30:04.852 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-16T02:30:04.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.976+0000 7faaf3102640 1 Processor -- start 2023-11-16T02:30:04.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.976+0000 7faaf3102640 1 -- start start 2023-11-16T02:30:04.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.980+0000 7faaf3102640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7faaec0702d0 0x7faaec071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:04.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.980+0000 7faaf3102640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faaec1417e0 0x7faaec141c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:04.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.980+0000 7faaf3102640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaec14b1f0 con 0x7faaec06a3d0 2023-11-16T02:30:04.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.980+0000 7faaf3102640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaec14bd90 con 0x7faaec1417e0 2023-11-16T02:30:04.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.980+0000 7faaf3102640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaec14aec0 con 0x7faaec0702d0 2023-11-16T02:30:04.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.980+0000 7faaf169f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faaec1417e0 0x7faaec141c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:04.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.980+0000 7faaf169f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faaec1417e0 0x7faaec141c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50272/0 (socket says 172.21.15.28:50272) 2023-11-16T02:30:04.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.980+0000 7faaf169f640 1 -- 172.21.15.28:0/2532397988 learned_addr learned my addr 172.21.15.28:0/2532397988 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:04.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.980+0000 7faaebfff640 1 --2- 172.21.15.28:0/2532397988 >> v2:172.21.15.70:3300/0 conn(0x7faaec0702d0 0x7faaec071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:04.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.980+0000 7faaf169f640 1 -- 172.21.15.28:0/2532397988 >> v2:172.21.15.70:3300/0 conn(0x7faaec0702d0 msgr2=0x7faaec071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:04.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.980+0000 7faaf169f640 1 --2- 172.21.15.28:0/2532397988 >> v2:172.21.15.70:3300/0 conn(0x7faaec0702d0 0x7faaec071090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:04.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.980+0000 7faaf169f640 1 -- 172.21.15.28:0/2532397988 >> v1:172.21.15.70:6789/0 conn(0x7faaec06a3d0 legacy=0x7faaec14b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:04.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.980+0000 7faaf169f640 1 -- 172.21.15.28:0/2532397988 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaec0716b0 con 0x7faaec1417e0 2023-11-16T02:30:04.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.980+0000 7faaebfff640 1 --2- 172.21.15.28:0/2532397988 >> v2:172.21.15.70:3300/0 conn(0x7faaec0702d0 0x7faaec071090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:04.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.980+0000 7faaf169f640 1 --2- 172.21.15.28:0/2532397988 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faaec1417e0 0x7faaec141c90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7faaec0b32b0 tx=0x7faadc01eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c9d3168b5e3b26 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:04.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.980+0000 7faaeb7fe640 1 -- 172.21.15.28:0/2532397988 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc0a7b80 con 0x7faaec1417e0 2023-11-16T02:30:04.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.980+0000 7faaeb7fe640 1 -- 172.21.15.28:0/2532397988 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faadc0a7ce0 con 0x7faaec1417e0 2023-11-16T02:30:04.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.980+0000 7faaeb7fe640 1 -- 172.21.15.28:0/2532397988 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faadc0af660 con 0x7faaec1417e0 2023-11-16T02:30:04.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaf3102640 1 -- 172.21.15.28:0/2532397988 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faaec1417e0 msgr2=0x7faaec141c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:04.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaf3102640 1 --2- 172.21.15.28:0/2532397988 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faaec1417e0 0x7faaec141c90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7faaec0b32b0 tx=0x7faadc01eb90 comp rx=0 tx=0).stop 2023-11-16T02:30:04.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaf3102640 1 -- 172.21.15.28:0/2532397988 shutdown_connections 2023-11-16T02:30:04.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaf3102640 1 --2- 172.21.15.28:0/2532397988 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faaec1417e0 0x7faaec141c90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:04.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaf3102640 1 --2- 172.21.15.28:0/2532397988 >> v2:172.21.15.70:3300/0 conn(0x7faaec0702d0 0x7faaec071090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:04.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaf3102640 1 -- 172.21.15.28:0/2532397988 >> 172.21.15.28:0/2532397988 conn(0x7faaec0bc5a0 msgr2=0x7faaec0bc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:04.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaf3102640 1 -- 172.21.15.28:0/2532397988 shutdown_connections 2023-11-16T02:30:04.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaf3102640 1 -- 172.21.15.28:0/2532397988 wait complete. 2023-11-16T02:30:04.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaf3102640 1 Processor -- start 2023-11-16T02:30:04.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaf3102640 1 -- start start 2023-11-16T02:30:04.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaf3102640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faaec06a3d0 0x7faaec0b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:04.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaf3102640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faaec0702d0 0x7faaec150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:04.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaf3102640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaec1417e0 0x7faaec1508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:04.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaf3102640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaec0b5b40 con 0x7faaec0702d0 2023-11-16T02:30:04.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaf3102640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaec1e6250 con 0x7faaec1417e0 2023-11-16T02:30:04.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaf3102640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaec1e6530 con 0x7faaec06a3d0 2023-11-16T02:30:04.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaebfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faaec0702d0 0x7faaec150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:04.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaebfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faaec0702d0 0x7faaec150380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50282/0 (socket says 172.21.15.28:50282) 2023-11-16T02:30:04.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaebfff640 1 -- 172.21.15.28:0/1997817073 learned_addr learned my addr 172.21.15.28:0/1997817073 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:04.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaf169f640 1 --2- 172.21.15.28:0/1997817073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaec1417e0 0x7faaec1508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:04.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaf0e9e640 1 --2- 172.21.15.28:0/1997817073 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faaec06a3d0 0x7faaec0b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:04.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaebfff640 1 -- 172.21.15.28:0/1997817073 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faaec06a3d0 msgr2=0x7faaec0b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:04.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaebfff640 1 --2- 172.21.15.28:0/1997817073 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faaec06a3d0 0x7faaec0b5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:04.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaebfff640 1 -- 172.21.15.28:0/1997817073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaec1417e0 msgr2=0x7faaec1508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:04.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaebfff640 1 --2- 172.21.15.28:0/1997817073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaec1417e0 0x7faaec1508c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:04.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaebfff640 1 -- 172.21.15.28:0/1997817073 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faadc00b770 con 0x7faaec0702d0 2023-11-16T02:30:04.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaf169f640 1 --2- 172.21.15.28:0/1997817073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaec1417e0 0x7faaec1508c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:30:04.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaebfff640 1 --2- 172.21.15.28:0/1997817073 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faaec0702d0 0x7faaec150380 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7faad400c7f0 tx=0x7faad400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:04.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faae97fa640 1 -- 172.21.15.28:0/1997817073 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad400cea0 con 0x7faaec0702d0 2023-11-16T02:30:04.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faae97fa640 1 -- 172.21.15.28:0/1997817073 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad4007a30 con 0x7faaec0702d0 2023-11-16T02:30:04.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaf3102640 1 -- 172.21.15.28:0/1997817073 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaec1e6810 con 0x7faaec0702d0 2023-11-16T02:30:04.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faae97fa640 1 -- 172.21.15.28:0/1997817073 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad4007de0 con 0x7faaec0702d0 2023-11-16T02:30:04.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.984+0000 7faaf3102640 1 -- 172.21.15.28:0/1997817073 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaec151ef0 con 0x7faaec0702d0 2023-11-16T02:30:04.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.988+0000 7faaf3102640 1 -- 172.21.15.28:0/1997817073 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaec04e8a0 con 0x7faaec0702d0 2023-11-16T02:30:04.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.988+0000 7faae97fa640 1 -- 172.21.15.28:0/1997817073 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7faad40113f0 con 0x7faaec0702d0 2023-11-16T02:30:04.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.988+0000 7faae97fa640 1 --2- 172.21.15.28:0/1997817073 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7faacc065a60 0x7faacc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:04.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.988+0000 7faae97fa640 1 -- 172.21.15.28:0/1997817073 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faad40832a0 con 0x7faaec0702d0 2023-11-16T02:30:04.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.988+0000 7faaf0e9e640 1 --2- 172.21.15.28:0/1997817073 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7faacc065a60 0x7faacc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:04.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.988+0000 7faaf0e9e640 1 --2- 172.21.15.28:0/1997817073 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7faacc065a60 0x7faacc067f20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7faae4009f20 tx=0x7faae40094d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:04.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:04.992+0000 7faae97fa640 1 -- 172.21.15.28:0/1997817073 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7faad4050cf0 con 0x7faaec0702d0 2023-11-16T02:30:05.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.140+0000 7faaf3102640 1 -- 172.21.15.28:0/1997817073 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faaec0b3240 con 0x7faaec0702d0 2023-11-16T02:30:05.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.140+0000 7faae97fa640 1 -- 172.21.15.28:0/1997817073 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7faad4054310 con 0x7faaec0702d0 2023-11-16T02:30:05.142 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-11-16T02:30:05.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.144+0000 7faaf3102640 1 -- 172.21.15.28:0/1997817073 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7faacc065a60 msgr2=0x7faacc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:05.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.144+0000 7faaf3102640 1 --2- 172.21.15.28:0/1997817073 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7faacc065a60 0x7faacc067f20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7faae4009f20 tx=0x7faae40094d0 comp rx=0 tx=0).stop 2023-11-16T02:30:05.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.144+0000 7faaf3102640 1 -- 172.21.15.28:0/1997817073 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faaec0702d0 msgr2=0x7faaec150380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:05.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.144+0000 7faaf3102640 1 --2- 172.21.15.28:0/1997817073 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faaec0702d0 0x7faaec150380 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7faad400c7f0 tx=0x7faad400ccb0 comp rx=0 tx=0).stop 2023-11-16T02:30:05.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.144+0000 7faaf3102640 1 -- 172.21.15.28:0/1997817073 shutdown_connections 2023-11-16T02:30:05.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.144+0000 7faaf3102640 1 --2- 172.21.15.28:0/1997817073 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7faacc065a60 0x7faacc067f20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:05.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.144+0000 7faaf3102640 1 --2- 172.21.15.28:0/1997817073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaec1417e0 0x7faaec1508c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:05.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.144+0000 7faaf3102640 1 --2- 172.21.15.28:0/1997817073 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faaec0702d0 0x7faaec150380 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:05.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.144+0000 7faaf3102640 1 --2- 172.21.15.28:0/1997817073 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faaec06a3d0 0x7faaec0b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:05.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.144+0000 7faaf3102640 1 -- 172.21.15.28:0/1997817073 >> 172.21.15.28:0/1997817073 conn(0x7faaec0bc5a0 msgr2=0x7faaec06f950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:05.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.144+0000 7faaf3102640 1 -- 172.21.15.28:0/1997817073 shutdown_connections 2023-11-16T02:30:05.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.144+0000 7faaf3102640 1 -- 172.21.15.28:0/1997817073 wait complete. 2023-11-16T02:30:05.159 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-16T02:30:05.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.276+0000 7fefef8e7640 1 Processor -- start 2023-11-16T02:30:05.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.276+0000 7fefef8e7640 1 -- start start 2023-11-16T02:30:05.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.276+0000 7fefef8e7640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fefe806a550 0x7fefe80b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:05.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.276+0000 7fefef8e7640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fefe80b7c60 0x7fefe80b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:05.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.276+0000 7fefef8e7640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe8071800 con 0x7fefe806a170 2023-11-16T02:30:05.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.276+0000 7fefef8e7640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe80b5ec0 con 0x7fefe80b7c60 2023-11-16T02:30:05.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.276+0000 7fefef8e7640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe80b6350 con 0x7fefe806a550 2023-11-16T02:30:05.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.276+0000 7fefede84640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fefe80b7c60 0x7fefe80b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:05.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.276+0000 7fefed683640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fefe806a170 0x7fefe8148a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.28:46448/0 (socket says 172.21.15.28:46448) 2023-11-16T02:30:05.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.276+0000 7fefed683640 1 -- 172.21.15.28:0/1630204776 learned_addr learned my addr 172.21.15.28:0/1630204776 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:05.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.276+0000 7fefede84640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fefe80b7c60 0x7fefe80b80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50296/0 (socket says 172.21.15.28:50296) 2023-11-16T02:30:05.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.276+0000 7fefece82640 1 --2- 172.21.15.28:0/1630204776 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fefe806a550 0x7fefe80b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:05.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.276+0000 7fefede84640 1 -- 172.21.15.28:0/1630204776 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fefe806a550 msgr2=0x7fefe80b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:05.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.276+0000 7fefede84640 1 --2- 172.21.15.28:0/1630204776 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fefe806a550 0x7fefe80b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:05.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.276+0000 7fefede84640 1 -- 172.21.15.28:0/1630204776 >> v1:172.21.15.70:6789/0 conn(0x7fefe806a170 legacy=0x7fefe8148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:05.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.276+0000 7fefede84640 1 -- 172.21.15.28:0/1630204776 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe80b5870 con 0x7fefe80b7c60 2023-11-16T02:30:05.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.280+0000 7fefede84640 1 --2- 172.21.15.28:0/1630204776 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefe80b7c60 0x7fefe80b80d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fefe0009d90 tx=0x7fefe001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b1cb90989123aa server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:05.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.280+0000 7fefdffff640 1 -- 172.21.15.28:0/1630204776 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe00a5920 con 0x7fefe80b7c60 2023-11-16T02:30:05.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.280+0000 7fefdffff640 1 -- 172.21.15.28:0/1630204776 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe00a5a80 con 0x7fefe80b7c60 2023-11-16T02:30:05.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.280+0000 7fefdffff640 1 -- 172.21.15.28:0/1630204776 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe00a5e10 con 0x7fefe80b7c60 2023-11-16T02:30:05.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.280+0000 7fefef8e7640 1 -- 172.21.15.28:0/1630204776 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefe80b7c60 msgr2=0x7fefe80b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:05.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.280+0000 7fefef8e7640 1 --2- 172.21.15.28:0/1630204776 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefe80b7c60 0x7fefe80b80d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fefe0009d90 tx=0x7fefe001c8c0 comp rx=0 tx=0).stop 2023-11-16T02:30:05.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.280+0000 7fefef8e7640 1 -- 172.21.15.28:0/1630204776 shutdown_connections 2023-11-16T02:30:05.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.280+0000 7fefef8e7640 1 --2- 172.21.15.28:0/1630204776 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefe80b7c60 0x7fefe80b80d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:05.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.280+0000 7fefef8e7640 1 --2- 172.21.15.28:0/1630204776 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fefe806a550 0x7fefe80b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:05.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.280+0000 7fefef8e7640 1 -- 172.21.15.28:0/1630204776 >> 172.21.15.28:0/1630204776 conn(0x7fefe80bc5a0 msgr2=0x7fefe80bc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:05.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.280+0000 7fefef8e7640 1 -- 172.21.15.28:0/1630204776 shutdown_connections 2023-11-16T02:30:05.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.280+0000 7fefef8e7640 1 -- 172.21.15.28:0/1630204776 wait complete. 2023-11-16T02:30:05.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.280+0000 7fefef8e7640 1 Processor -- start 2023-11-16T02:30:05.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.280+0000 7fefef8e7640 1 -- start start 2023-11-16T02:30:05.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.280+0000 7fefef8e7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefe806a170 0x7fefe8144040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:05.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.280+0000 7fefef8e7640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fefe806a550 0x7fefe813a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:05.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.280+0000 7fefef8e7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefe80b7c60 0x7fefe813a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:05.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.280+0000 7fefef8e7640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe81e0e00 con 0x7fefe806a170 2023-11-16T02:30:05.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.280+0000 7fefef8e7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe8144580 con 0x7fefe80b7c60 2023-11-16T02:30:05.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.280+0000 7fefef8e7640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe81449c0 con 0x7fefe806a550 2023-11-16T02:30:05.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.280+0000 7fefed683640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefe806a170 0x7fefe8144040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:05.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.280+0000 7fefed683640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefe806a170 0x7fefe8144040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50306/0 (socket says 172.21.15.28:50306) 2023-11-16T02:30:05.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.280+0000 7fefed683640 1 -- 172.21.15.28:0/982063073 learned_addr learned my addr 172.21.15.28:0/982063073 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:05.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.284+0000 7fefede84640 1 --2- 172.21.15.28:0/982063073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefe80b7c60 0x7fefe813a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:05.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.284+0000 7fefece82640 1 --2- 172.21.15.28:0/982063073 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fefe806a550 0x7fefe813a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:05.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.284+0000 7fefed683640 1 -- 172.21.15.28:0/982063073 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fefe806a550 msgr2=0x7fefe813a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:05.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.284+0000 7fefed683640 1 --2- 172.21.15.28:0/982063073 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fefe806a550 0x7fefe813a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:05.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.284+0000 7fefed683640 1 -- 172.21.15.28:0/982063073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefe80b7c60 msgr2=0x7fefe813a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:05.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.284+0000 7fefed683640 1 --2- 172.21.15.28:0/982063073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefe80b7c60 0x7fefe813a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:05.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.284+0000 7fefed683640 1 -- 172.21.15.28:0/982063073 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe0009a70 con 0x7fefe806a170 2023-11-16T02:30:05.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.284+0000 7fefece82640 1 --2- 172.21.15.28:0/982063073 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fefe806a550 0x7fefe813a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:05.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.284+0000 7fefed683640 1 --2- 172.21.15.28:0/982063073 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefe806a170 0x7fefe8144040 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fefd800c370 tx=0x7fefd800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:05.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.284+0000 7fefddffb640 1 -- 172.21.15.28:0/982063073 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd8005cf0 con 0x7fefe806a170 2023-11-16T02:30:05.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.284+0000 7fefddffb640 1 -- 172.21.15.28:0/982063073 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd8005e50 con 0x7fefe806a170 2023-11-16T02:30:05.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.284+0000 7fefddffb640 1 -- 172.21.15.28:0/982063073 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd80072f0 con 0x7fefe806a170 2023-11-16T02:30:05.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.284+0000 7fefef8e7640 1 -- 172.21.15.28:0/982063073 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe81461b0 con 0x7fefe806a170 2023-11-16T02:30:05.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.284+0000 7fefef8e7640 1 -- 172.21.15.28:0/982063073 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe8145b60 con 0x7fefe806a170 2023-11-16T02:30:05.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.284+0000 7fefef8e7640 1 -- 172.21.15.28:0/982063073 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe804e8a0 con 0x7fefe806a170 2023-11-16T02:30:05.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.284+0000 7fefddffb640 1 -- 172.21.15.28:0/982063073 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fefd8007450 con 0x7fefe806a170 2023-11-16T02:30:05.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.284+0000 7fefddffb640 1 --2- 172.21.15.28:0/982063073 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fefcc065a60 0x7fefcc067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:05.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.284+0000 7fefddffb640 1 -- 172.21.15.28:0/982063073 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefd80824e0 con 0x7fefe806a170 2023-11-16T02:30:05.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.284+0000 7fefece82640 1 --2- 172.21.15.28:0/982063073 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fefcc065a60 0x7fefcc067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:05.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.284+0000 7fefece82640 1 --2- 172.21.15.28:0/982063073 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fefcc065a60 0x7fefcc067f20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fefe813ebb0 tx=0x7fefe4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:05.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.288+0000 7fefddffb640 1 -- 172.21.15.28:0/982063073 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fefd804ff30 con 0x7fefe806a170 2023-11-16T02:30:05.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.436+0000 7fefef8e7640 1 -- 172.21.15.28:0/982063073 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fefe8071800 con 0x7fefe806a170 2023-11-16T02:30:05.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.436+0000 7fefddffb640 1 -- 172.21.15.28:0/982063073 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fefe8071800 con 0x7fefe806a170 2023-11-16T02:30:05.438 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-11-16T02:30:05.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.440+0000 7fefef8e7640 1 -- 172.21.15.28:0/982063073 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fefcc065a60 msgr2=0x7fefcc067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:05.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.440+0000 7fefef8e7640 1 --2- 172.21.15.28:0/982063073 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fefcc065a60 0x7fefcc067f20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fefe813ebb0 tx=0x7fefe4008040 comp rx=0 tx=0).stop 2023-11-16T02:30:05.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.440+0000 7fefef8e7640 1 -- 172.21.15.28:0/982063073 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefe806a170 msgr2=0x7fefe8144040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:05.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.440+0000 7fefef8e7640 1 --2- 172.21.15.28:0/982063073 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefe806a170 0x7fefe8144040 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fefd800c370 tx=0x7fefd800c830 comp rx=0 tx=0).stop 2023-11-16T02:30:05.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.440+0000 7fefef8e7640 1 -- 172.21.15.28:0/982063073 shutdown_connections 2023-11-16T02:30:05.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.440+0000 7fefef8e7640 1 --2- 172.21.15.28:0/982063073 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fefcc065a60 0x7fefcc067f20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:05.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.440+0000 7fefef8e7640 1 --2- 172.21.15.28:0/982063073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefe80b7c60 0x7fefe813a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:05.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.440+0000 7fefef8e7640 1 --2- 172.21.15.28:0/982063073 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fefe806a550 0x7fefe813a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:05.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.440+0000 7fefef8e7640 1 --2- 172.21.15.28:0/982063073 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fefe806a170 0x7fefe8144040 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:05.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.440+0000 7fefef8e7640 1 -- 172.21.15.28:0/982063073 >> 172.21.15.28:0/982063073 conn(0x7fefe80bc5a0 msgr2=0x7fefe813ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:05.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.440+0000 7fefef8e7640 1 -- 172.21.15.28:0/982063073 shutdown_connections 2023-11-16T02:30:05.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.440+0000 7fefef8e7640 1 -- 172.21.15.28:0/982063073 wait complete. 2023-11-16T02:30:05.456 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-16T02:30:05.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.580+0000 7ff6a0a21640 1 Processor -- start 2023-11-16T02:30:05.580 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.580+0000 7ff6a0a21640 1 -- start start 2023-11-16T02:30:05.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.580+0000 7ff6a0a21640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff69c142940 0x7ff69c065930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:05.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.580+0000 7ff6a0a21640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff69c072370 con 0x7ff69c071db0 2023-11-16T02:30:05.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.580+0000 7ff6a0a21640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff69c0b66a0 con 0x7ff69c0b3f50 2023-11-16T02:30:05.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.580+0000 7ff6a0a21640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff69c148f80 con 0x7ff69c142940 2023-11-16T02:30:05.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.580+0000 7ff69a59c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff69c142940 0x7ff69c065930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:05.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.580+0000 7ff699d9b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff69c071db0 0x7ff69c148870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37252/0 (socket says 172.21.15.28:37252) 2023-11-16T02:30:05.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.580+0000 7ff69a59c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff69c142940 0x7ff69c065930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50318/0 (socket says 172.21.15.28:50318) 2023-11-16T02:30:05.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.580+0000 7ff699d9b640 1 -- 172.21.15.28:0/4028951348 learned_addr learned my addr 172.21.15.28:0/4028951348 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:05.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.580+0000 7ff69a59c640 1 -- 172.21.15.28:0/4028951348 >> v1:172.21.15.70:6789/0 conn(0x7ff69c0b3f50 legacy=0x7ff69c0b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:05.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.580+0000 7ff69a59c640 1 -- 172.21.15.28:0/4028951348 >> v1:172.21.15.28:6789/0 conn(0x7ff69c071db0 legacy=0x7ff69c148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:05.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.580+0000 7ff69a59c640 1 -- 172.21.15.28:0/4028951348 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c0b5dd0 con 0x7ff69c142940 2023-11-16T02:30:05.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff69a59c640 1 --2- 172.21.15.28:0/4028951348 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff69c142940 0x7ff69c065930 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009d90 tx=0x7ff68c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f960ab1b8d845a62 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:05.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff69959a640 1 -- 172.21.15.28:0/4028951348 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c0a58c0 con 0x7ff69c142940 2023-11-16T02:30:05.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff69959a640 1 -- 172.21.15.28:0/4028951348 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68c0a5a20 con 0x7ff69c142940 2023-11-16T02:30:05.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff69959a640 1 -- 172.21.15.28:0/4028951348 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c0a5db0 con 0x7ff69c142940 2023-11-16T02:30:05.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff6a0a21640 1 -- 172.21.15.28:0/4028951348 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff69c142940 msgr2=0x7ff69c065930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:05.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff6a0a21640 1 --2- 172.21.15.28:0/4028951348 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff69c142940 0x7ff69c065930 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009d90 tx=0x7ff68c01c910 comp rx=0 tx=0).stop 2023-11-16T02:30:05.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff6a0a21640 1 -- 172.21.15.28:0/4028951348 shutdown_connections 2023-11-16T02:30:05.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff6a0a21640 1 --2- 172.21.15.28:0/4028951348 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff69c142940 0x7ff69c065930 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:05.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff6a0a21640 1 -- 172.21.15.28:0/4028951348 >> 172.21.15.28:0/4028951348 conn(0x7ff69c06de20 msgr2=0x7ff69c069d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:05.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff6a0a21640 1 -- 172.21.15.28:0/4028951348 shutdown_connections 2023-11-16T02:30:05.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff6a0a21640 1 -- 172.21.15.28:0/4028951348 wait complete. 2023-11-16T02:30:05.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff6a0a21640 1 Processor -- start 2023-11-16T02:30:05.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff6a0a21640 1 -- start start 2023-11-16T02:30:05.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff6a0a21640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff69c071db0 0x7ff69c131fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:05.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff6a0a21640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff69c0b3f50 0x7ff69c1e4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:05.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff6a0a21640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff69c142940 0x7ff69c143fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:05.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff6a0a21640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c132520 con 0x7ff69c142940 2023-11-16T02:30:05.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff6a0a21640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c1e3bb0 con 0x7ff69c0b3f50 2023-11-16T02:30:05.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff6a0a21640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69c146490 con 0x7ff69c071db0 2023-11-16T02:30:05.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff69ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff69c142940 0x7ff69c143fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:05.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff69ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff69c142940 0x7ff69c143fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50324/0 (socket says 172.21.15.28:50324) 2023-11-16T02:30:05.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff69ad9d640 1 -- 172.21.15.28:0/3463084860 learned_addr learned my addr 172.21.15.28:0/3463084860 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:05.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff699d9b640 1 --2- 172.21.15.28:0/3463084860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff69c0b3f50 0x7ff69c1e4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:05.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff69a59c640 1 --2- 172.21.15.28:0/3463084860 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff69c071db0 0x7ff69c131fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:05.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff69ad9d640 1 -- 172.21.15.28:0/3463084860 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff69c071db0 msgr2=0x7ff69c131fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:05.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff69ad9d640 1 --2- 172.21.15.28:0/3463084860 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff69c071db0 0x7ff69c131fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:05.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff69ad9d640 1 -- 172.21.15.28:0/3463084860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff69c0b3f50 msgr2=0x7ff69c1e4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:05.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff69ad9d640 1 --2- 172.21.15.28:0/3463084860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff69c0b3f50 0x7ff69c1e4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:05.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff69ad9d640 1 -- 172.21.15.28:0/3463084860 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff68c009a70 con 0x7ff69c142940 2023-11-16T02:30:05.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff69ad9d640 1 --2- 172.21.15.28:0/3463084860 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff69c142940 0x7ff69c143fb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff69400c3c0 tx=0x7ff69400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:05.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff68affd640 1 -- 172.21.15.28:0/3463084860 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694011790 con 0x7ff69c142940 2023-11-16T02:30:05.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff68affd640 1 -- 172.21.15.28:0/3463084860 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6940118f0 con 0x7ff69c142940 2023-11-16T02:30:05.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.584+0000 7ff68affd640 1 -- 172.21.15.28:0/3463084860 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694011ca0 con 0x7ff69c142940 2023-11-16T02:30:05.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.588+0000 7ff6a0a21640 1 -- 172.21.15.28:0/3463084860 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff69c147990 con 0x7ff69c142940 2023-11-16T02:30:05.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.588+0000 7ff6a0a21640 1 -- 172.21.15.28:0/3463084860 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff69c145ef0 con 0x7ff69c142940 2023-11-16T02:30:05.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.588+0000 7ff6a0a21640 1 -- 172.21.15.28:0/3463084860 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff69c04e8a0 con 0x7ff69c142940 2023-11-16T02:30:05.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.588+0000 7ff68affd640 1 -- 172.21.15.28:0/3463084860 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff69401c460 con 0x7ff69c142940 2023-11-16T02:30:05.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.588+0000 7ff68affd640 1 --2- 172.21.15.28:0/3463084860 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff67c065a60 0x7ff67c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:05.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.588+0000 7ff68affd640 1 -- 172.21.15.28:0/3463084860 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff694082fb0 con 0x7ff69c142940 2023-11-16T02:30:05.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.588+0000 7ff69a59c640 1 --2- 172.21.15.28:0/3463084860 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff67c065a60 0x7ff67c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:05.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.588+0000 7ff69a59c640 1 --2- 172.21.15.28:0/3463084860 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff67c065a60 0x7ff67c067f20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0af000 tx=0x7ff68c0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:05.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.592+0000 7ff68affd640 1 -- 172.21.15.28:0/3463084860 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7ff6940b4070 con 0x7ff69c142940 2023-11-16T02:30:05.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.760+0000 7ff6a0a21640 1 -- 172.21.15.28:0/3463084860 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff69c0b3580 con 0x7ff69c142940 2023-11-16T02:30:05.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.764+0000 7ff68affd640 1 -- 172.21.15.28:0/3463084860 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff694050a00 con 0x7ff69c142940 2023-11-16T02:30:05.763 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2023-11-16T02:30:05.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.764+0000 7ff6a0a21640 1 -- 172.21.15.28:0/3463084860 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff67c065a60 msgr2=0x7ff67c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:05.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.764+0000 7ff6a0a21640 1 --2- 172.21.15.28:0/3463084860 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff67c065a60 0x7ff67c067f20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0af000 tx=0x7ff68c0a7070 comp rx=0 tx=0).stop 2023-11-16T02:30:05.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.764+0000 7ff6a0a21640 1 -- 172.21.15.28:0/3463084860 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff69c142940 msgr2=0x7ff69c143fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:05.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.764+0000 7ff6a0a21640 1 --2- 172.21.15.28:0/3463084860 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff69c142940 0x7ff69c143fb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff69400c3c0 tx=0x7ff69400c880 comp rx=0 tx=0).stop 2023-11-16T02:30:05.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.764+0000 7ff6a0a21640 1 -- 172.21.15.28:0/3463084860 shutdown_connections 2023-11-16T02:30:05.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.764+0000 7ff6a0a21640 1 --2- 172.21.15.28:0/3463084860 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7ff67c065a60 0x7ff67c067f20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:05.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.764+0000 7ff6a0a21640 1 --2- 172.21.15.28:0/3463084860 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff69c142940 0x7ff69c143fb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:05.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.764+0000 7ff6a0a21640 1 --2- 172.21.15.28:0/3463084860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff69c0b3f50 0x7ff69c1e4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:05.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.764+0000 7ff6a0a21640 1 --2- 172.21.15.28:0/3463084860 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7ff69c071db0 0x7ff69c131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:05.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.764+0000 7ff6a0a21640 1 -- 172.21.15.28:0/3463084860 >> 172.21.15.28:0/3463084860 conn(0x7ff69c06de20 msgr2=0x7ff69c13dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:05.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.764+0000 7ff6a0a21640 1 -- 172.21.15.28:0/3463084860 shutdown_connections 2023-11-16T02:30:05.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:05.764+0000 7ff6a0a21640 1 -- 172.21.15.28:0/3463084860 wait complete. 2023-11-16T02:30:05.783 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-16T02:30:05.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:30:05.783 DEBUG:teuthology.orchestra.run.smithi204:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-11-16T02:30:05.820 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi204.front.sepia.ceph.com 2023-11-16T02:30:05.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:30:05.821 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-16T02:30:05.883 INFO:tasks.cephfs.cephfs_test_case:[] 2023-11-16T02:30:05.884 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-16T02:30:06.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e1482e640 1 Processor -- start 2023-11-16T02:30:06.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e1482e640 1 -- start start 2023-11-16T02:30:06.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e1482e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e1014a8e0 0x7f1e10070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:06.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e1482e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1e100b2eb0 0x7f1e100708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:06.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e1482e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1006f1d0 con 0x7f1e100b6170 2023-11-16T02:30:06.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e1482e640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e10071470 con 0x7f1e100b2eb0 2023-11-16T02:30:06.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e1482e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e100b8490 con 0x7f1e1014a8e0 2023-11-16T02:30:06.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0dd9b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f1e100b6170 0x7f1e100b27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37268/0 (socket says 172.21.15.28:37268) 2023-11-16T02:30:06.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0dd9b640 1 -- 172.21.15.28:0/4037817090 learned_addr learned my addr 172.21.15.28:0/4037817090 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:06.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0e59c640 1 --2- 172.21.15.28:0/4037817090 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e1014a8e0 0x7f1e10070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:06.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0ed9d640 1 --2- 172.21.15.28:0/4037817090 >> v2:172.21.15.70:3300/0 conn(0x7f1e100b2eb0 0x7f1e100708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:06.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0d59a640 1 -- 172.21.15.28:0/4037817090 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4004407375 0 0) 0x7f1e1006f1d0 con 0x7f1e100b6170 2023-11-16T02:30:06.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0d59a640 1 -- 172.21.15.28:0/4037817090 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1df8003530 con 0x7f1e100b6170 2023-11-16T02:30:06.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0d59a640 1 -- 172.21.15.28:0/4037817090 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3837992998 0 0) 0x7f1df8003530 con 0x7f1e100b6170 2023-11-16T02:30:06.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0d59a640 1 -- 172.21.15.28:0/4037817090 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e1014a8e0 msgr2=0x7f1e10070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:06.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0d59a640 1 --2- 172.21.15.28:0/4037817090 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e1014a8e0 0x7f1e10070360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0d59a640 1 -- 172.21.15.28:0/4037817090 >> v2:172.21.15.70:3300/0 conn(0x7f1e100b2eb0 msgr2=0x7f1e100708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:06.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0d59a640 1 --2- 172.21.15.28:0/4037817090 >> v2:172.21.15.70:3300/0 conn(0x7f1e100b2eb0 0x7f1e100708a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0d59a640 1 -- 172.21.15.28:0/4037817090 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1014b250 con 0x7f1e100b6170 2023-11-16T02:30:06.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0d59a640 1 -- 172.21.15.28:0/4037817090 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7f1e04001680 con 0x7f1e100b6170 2023-11-16T02:30:06.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0d59a640 1 -- 172.21.15.28:0/4037817090 >> v1:172.21.15.28:6789/0 conn(0x7f1e100b6170 legacy=0x7f1e100b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:06.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0d59a640 1 --2- 172.21.15.28:0/4037817090 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e1014a8e0 0x7f1df80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:06.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0d59a640 1 --2- 172.21.15.28:0/4037817090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1df8003f30 0x7f1df80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:06.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0d59a640 1 --2- 172.21.15.28:0/4037817090 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1df8004d10 0x7f1df8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:06.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0d59a640 1 -- 172.21.15.28:0/4037817090 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e10071470 con 0x7f1df8004d10 2023-11-16T02:30:06.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0d59a640 1 -- 172.21.15.28:0/4037817090 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e100b8490 con 0x7f1df8003f30 2023-11-16T02:30:06.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0d59a640 1 -- 172.21.15.28:0/4037817090 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df800b990 con 0x7f1e1014a8e0 2023-11-16T02:30:06.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0ed9d640 1 --2- 172.21.15.28:0/4037817090 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1df8004d10 0x7f1df8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:06.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0dd9b640 1 --2- 172.21.15.28:0/4037817090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1df8003f30 0x7f1df80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:06.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0e59c640 1 --2- 172.21.15.28:0/4037817090 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e1014a8e0 0x7f1df80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:06.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0ed9d640 1 -- 172.21.15.28:0/4037817090 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e1014a8e0 msgr2=0x7f1df80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:06.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0ed9d640 1 --2- 172.21.15.28:0/4037817090 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e1014a8e0 0x7f1df80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0ed9d640 1 -- 172.21.15.28:0/4037817090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1df8003f30 msgr2=0x7f1df80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:06.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0ed9d640 1 --2- 172.21.15.28:0/4037817090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1df8003f30 0x7f1df80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.016+0000 7f1e0ed9d640 1 -- 172.21.15.28:0/4037817090 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df8003530 con 0x7f1df8004d10 2023-11-16T02:30:06.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e0ed9d640 1 --2- 172.21.15.28:0/4037817090 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1df8004d10 0x7f1df8005190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1e08009fc0 tx=0x7f1e0801eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f480fc18ae91f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:06.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e0d59a640 1 -- 172.21.15.28:0/4037817090 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e080af440 con 0x7f1df8004d10 2023-11-16T02:30:06.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e0d59a640 1 -- 172.21.15.28:0/4037817090 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0800f040 con 0x7f1df8004d10 2023-11-16T02:30:06.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e0d59a640 1 -- 172.21.15.28:0/4037817090 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e080af7e0 con 0x7f1df8004d10 2023-11-16T02:30:06.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e1482e640 1 -- 172.21.15.28:0/4037817090 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1df8004d10 msgr2=0x7f1df8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:06.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e1482e640 1 --2- 172.21.15.28:0/4037817090 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1df8004d10 0x7f1df8005190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1e08009fc0 tx=0x7f1e0801eeb0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e0ed9d640 1 -- 172.21.15.28:0/4037817090 reap_dead start 2023-11-16T02:30:06.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e1482e640 1 -- 172.21.15.28:0/4037817090 shutdown_connections 2023-11-16T02:30:06.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e1482e640 1 -- 172.21.15.28:0/4037817090 >> 172.21.15.28:0/4037817090 conn(0x7f1e100b9050 msgr2=0x7f1e100bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:06.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e1482e640 1 -- 172.21.15.28:0/4037817090 shutdown_connections 2023-11-16T02:30:06.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e1482e640 1 -- 172.21.15.28:0/4037817090 wait complete. 2023-11-16T02:30:06.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e1482e640 1 Processor -- start 2023-11-16T02:30:06.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e1482e640 1 -- start start 2023-11-16T02:30:06.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e1482e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1df8004d10 0x7f1e100bc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:06.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e1482e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e10145b60 0x7f1e101e30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:06.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e1482e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e101e3620 0x7f1e10147530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:06.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e1482e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e101da000 con 0x7f1df8004d10 2023-11-16T02:30:06.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e1482e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e10144eb0 con 0x7f1e101e3620 2023-11-16T02:30:06.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e1482e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e101e3ab0 con 0x7f1e10145b60 2023-11-16T02:30:06.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e0e59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1df8004d10 0x7f1e100bc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:06.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e0e59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1df8004d10 0x7f1e100bc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50336/0 (socket says 172.21.15.28:50336) 2023-11-16T02:30:06.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e0e59c640 1 -- 172.21.15.28:0/2071944250 learned_addr learned my addr 172.21.15.28:0/2071944250 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:06.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e0e59c640 1 -- 172.21.15.28:0/2071944250 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e10145b60 msgr2=0x7f1e101e30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:06.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e0e59c640 1 --2- 172.21.15.28:0/2071944250 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e10145b60 0x7f1e101e30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e0e59c640 1 -- 172.21.15.28:0/2071944250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e101e3620 msgr2=0x7f1e10147530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:06.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e0e59c640 1 --2- 172.21.15.28:0/2071944250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e101e3620 0x7f1e10147530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e0e59c640 1 -- 172.21.15.28:0/2071944250 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e10144bd0 con 0x7f1df8004d10 2023-11-16T02:30:06.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e0e59c640 1 --2- 172.21.15.28:0/2071944250 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1df8004d10 0x7f1e100bc8b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1e000107e0 tx=0x7f1e00010ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:06.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1dfeffd640 1 -- 172.21.15.28:0/2071944250 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0000ecc0 con 0x7f1df8004d10 2023-11-16T02:30:06.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1dfeffd640 1 -- 172.21.15.28:0/2071944250 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0000ee20 con 0x7f1df8004d10 2023-11-16T02:30:06.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e1482e640 1 -- 172.21.15.28:0/2071944250 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e100bbbe0 con 0x7f1df8004d10 2023-11-16T02:30:06.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1dfeffd640 1 -- 172.21.15.28:0/2071944250 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e00012670 con 0x7f1df8004d10 2023-11-16T02:30:06.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.020+0000 7f1e1482e640 1 -- 172.21.15.28:0/2071944250 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e100bafe0 con 0x7f1df8004d10 2023-11-16T02:30:06.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.024+0000 7f1e1482e640 1 -- 172.21.15.28:0/2071944250 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1004e8a0 con 0x7f1df8004d10 2023-11-16T02:30:06.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.024+0000 7f1dfeffd640 1 -- 172.21.15.28:0/2071944250 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1e000127d0 con 0x7f1df8004d10 2023-11-16T02:30:06.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.024+0000 7f1dfeffd640 1 --2- 172.21.15.28:0/2071944250 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1df0065a90 0x7f1df0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:06.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.024+0000 7f1dfeffd640 1 -- 172.21.15.28:0/2071944250 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e00016070 con 0x7f1df8004d10 2023-11-16T02:30:06.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.024+0000 7f1e0dd9b640 1 --2- 172.21.15.28:0/2071944250 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1df0065a90 0x7f1df0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:06.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.024+0000 7f1e0dd9b640 1 --2- 172.21.15.28:0/2071944250 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1df0065a90 0x7f1df0067f50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1e04001ec0 tx=0x7f1e04001d70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:06.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.028+0000 7f1dfeffd640 1 -- 172.21.15.28:0/2071944250 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f1e00051350 con 0x7f1df8004d10 2023-11-16T02:30:06.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.208+0000 7f1e1482e640 1 -- 172.21.15.28:0/2071944250 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e100b35f0 con 0x7f1df8004d10 2023-11-16T02:30:06.210 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.208+0000 7f1dfeffd640 1 -- 172.21.15.28:0/2071944250 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3883 (secure 0 0 0) 0x7f1e00054970 con 0x7f1df8004d10 2023-11-16T02:30:06.210 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:30:06.211 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/4054669002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":4054669002},{"type":"v1","addr":"172.21.15.28:6836","nonce":4054669002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/903740631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":903740631},{"type":"v1","addr":"172.21.15.70:6833","nonce":903740631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-16T02:29:37.868031+0000","modified":"2023-11-16T02:29:40.877544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6837/1025130674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1025130674},{"type":"v1","addr":"172.21.15.28:6837","nonce":1025130674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-16T02:30:06.211 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 7 2023-11-16T02:30:06.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.212+0000 7f1e1482e640 1 -- 172.21.15.28:0/2071944250 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1df0065a90 msgr2=0x7f1df0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:06.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.212+0000 7f1e1482e640 1 --2- 172.21.15.28:0/2071944250 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1df0065a90 0x7f1df0067f50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1e04001ec0 tx=0x7f1e04001d70 comp rx=0 tx=0).stop 2023-11-16T02:30:06.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.212+0000 7f1e1482e640 1 -- 172.21.15.28:0/2071944250 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1df8004d10 msgr2=0x7f1e100bc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:06.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.212+0000 7f1e1482e640 1 --2- 172.21.15.28:0/2071944250 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1df8004d10 0x7f1e100bc8b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1e000107e0 tx=0x7f1e00010ca0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.212+0000 7f1e1482e640 1 -- 172.21.15.28:0/2071944250 shutdown_connections 2023-11-16T02:30:06.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.212+0000 7f1e1482e640 1 --2- 172.21.15.28:0/2071944250 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1df0065a90 0x7f1df0067f50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.212+0000 7f1e1482e640 1 --2- 172.21.15.28:0/2071944250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e101e3620 0x7f1e10147530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.212+0000 7f1e1482e640 1 --2- 172.21.15.28:0/2071944250 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e10145b60 0x7f1e101e30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.212+0000 7f1e1482e640 1 --2- 172.21.15.28:0/2071944250 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1df8004d10 0x7f1e100bc8b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.212+0000 7f1e1482e640 1 -- 172.21.15.28:0/2071944250 >> 172.21.15.28:0/2071944250 conn(0x7f1e100b9050 msgr2=0x7f1e10149980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:06.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.212+0000 7f1e1482e640 1 -- 172.21.15.28:0/2071944250 shutdown_connections 2023-11-16T02:30:06.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.212+0000 7f1e1482e640 1 -- 172.21.15.28:0/2071944250 wait complete. 2023-11-16T02:30:06.229 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-16T02:30:06.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.348+0000 7f85024e6640 1 Processor -- start 2023-11-16T02:30:06.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.348+0000 7f85024e6640 1 -- start start 2023-11-16T02:30:06.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.352+0000 7f85024e6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f84fc148960 0x7f84fc0b3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:06.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.352+0000 7f85024e6640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84fc0b52b0 con 0x7f84fc148df0 2023-11-16T02:30:06.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.352+0000 7f85024e6640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84fc0bcdb0 con 0x7f84fc0b8240 2023-11-16T02:30:06.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.352+0000 7f85024e6640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84fc0b6220 con 0x7f84fc148960 2023-11-16T02:30:06.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.352+0000 7f84fb7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f84fc148960 0x7f84fc0b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:06.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.352+0000 7f8500a83640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f84fc148df0 0x7f84fc1532a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37278/0 (socket says 172.21.15.28:37278) 2023-11-16T02:30:06.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.352+0000 7f8500a83640 1 -- 172.21.15.28:0/4209535718 learned_addr learned my addr 172.21.15.28:0/4209535718 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:06.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.352+0000 7f84faffd640 1 -- 172.21.15.28:0/4209535718 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1379856406 0 0) 0x7f84fc0b52b0 con 0x7f84fc148df0 2023-11-16T02:30:06.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.352+0000 7f84faffd640 1 -- 172.21.15.28:0/4209535718 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84e4003530 con 0x7f84fc148df0 2023-11-16T02:30:06.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.352+0000 7f84fb7fe640 1 -- 172.21.15.28:0/4209535718 >> v1:172.21.15.70:6789/0 conn(0x7f84fc0b8240 legacy=0x7f84fc0bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:06.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.352+0000 7f84fb7fe640 1 -- 172.21.15.28:0/4209535718 >> v1:172.21.15.28:6789/0 conn(0x7f84fc148df0 legacy=0x7f84fc1532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:06.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.352+0000 7f84fb7fe640 1 -- 172.21.15.28:0/4209535718 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84fc0b4040 con 0x7f84fc148960 2023-11-16T02:30:06.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.352+0000 7f84fb7fe640 1 --2- 172.21.15.28:0/4209535718 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84fc148960 0x7f84fc0b3450 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f84f00097c0 tx=0x7f84f001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f3737a80797851 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:06.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.352+0000 7f84faffd640 1 -- 172.21.15.28:0/4209535718 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f00ad660 con 0x7f84fc148960 2023-11-16T02:30:06.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.352+0000 7f84faffd640 1 -- 172.21.15.28:0/4209535718 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f00ad7c0 con 0x7f84fc148960 2023-11-16T02:30:06.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.352+0000 7f84faffd640 1 -- 172.21.15.28:0/4209535718 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f00adb50 con 0x7f84fc148960 2023-11-16T02:30:06.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.352+0000 7f85024e6640 1 -- 172.21.15.28:0/4209535718 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84fc148960 msgr2=0x7f84fc0b3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:06.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.352+0000 7f85024e6640 1 --2- 172.21.15.28:0/4209535718 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84fc148960 0x7f84fc0b3450 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f84f00097c0 tx=0x7f84f001c450 comp rx=0 tx=0).stop 2023-11-16T02:30:06.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.352+0000 7f85024e6640 1 -- 172.21.15.28:0/4209535718 shutdown_connections 2023-11-16T02:30:06.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.352+0000 7f85024e6640 1 --2- 172.21.15.28:0/4209535718 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84fc148960 0x7f84fc0b3450 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.352+0000 7f85024e6640 1 -- 172.21.15.28:0/4209535718 >> 172.21.15.28:0/4209535718 conn(0x7f84fc0b9050 msgr2=0x7f84fc0bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:06.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.352+0000 7f85024e6640 1 -- 172.21.15.28:0/4209535718 shutdown_connections 2023-11-16T02:30:06.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.352+0000 7f85024e6640 1 -- 172.21.15.28:0/4209535718 wait complete. 2023-11-16T02:30:06.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.356+0000 7f85024e6640 1 Processor -- start 2023-11-16T02:30:06.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.356+0000 7f85024e6640 1 -- start start 2023-11-16T02:30:06.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.356+0000 7f85024e6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84fc0b8240 0x7f84fc13b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:06.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.356+0000 7f85024e6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84fc148960 0x7f84fc143d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:06.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.356+0000 7f85024e6640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f84fc148df0 0x7f84fc145990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:06.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.356+0000 7f85024e6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc13ef00 con 0x7f84fc148960 2023-11-16T02:30:06.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.356+0000 7f85024e6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc1442b0 con 0x7f84fc0b8240 2023-11-16T02:30:06.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.356+0000 7f85024e6640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc145500 con 0x7f84fc148df0 2023-11-16T02:30:06.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.356+0000 7f84fb7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84fc148960 0x7f84fc143d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:06.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.356+0000 7f84fb7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84fc148960 0x7f84fc143d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50342/0 (socket says 172.21.15.28:50342) 2023-11-16T02:30:06.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.356+0000 7f84fb7fe640 1 -- 172.21.15.28:0/2532381424 learned_addr learned my addr 172.21.15.28:0/2532381424 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:06.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.356+0000 7f8500a83640 1 --2- 172.21.15.28:0/2532381424 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f84fc148df0 0x7f84fc145990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:06.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.356+0000 7f84fbfff640 1 --2- 172.21.15.28:0/2532381424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84fc0b8240 0x7f84fc13b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:06.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.356+0000 7f84fb7fe640 1 -- 172.21.15.28:0/2532381424 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f84fc148df0 msgr2=0x7f84fc145990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:06.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.356+0000 7f84fb7fe640 1 --2- 172.21.15.28:0/2532381424 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f84fc148df0 0x7f84fc145990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.356+0000 7f84fb7fe640 1 -- 172.21.15.28:0/2532381424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84fc0b8240 msgr2=0x7f84fc13b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:06.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.356+0000 7f84fb7fe640 1 --2- 172.21.15.28:0/2532381424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84fc0b8240 0x7f84fc13b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.356+0000 7f84fb7fe640 1 -- 172.21.15.28:0/2532381424 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f0009420 con 0x7f84fc148960 2023-11-16T02:30:06.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.356+0000 7f84fb7fe640 1 --2- 172.21.15.28:0/2532381424 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84fc148960 0x7f84fc143d70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f84f00097c0 tx=0x7f84f00191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:06.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.356+0000 7f84f8ff9640 1 -- 172.21.15.28:0/2532381424 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f0004230 con 0x7f84fc148960 2023-11-16T02:30:06.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.356+0000 7f84f8ff9640 1 -- 172.21.15.28:0/2532381424 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f0004390 con 0x7f84fc148960 2023-11-16T02:30:06.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.356+0000 7f84f8ff9640 1 -- 172.21.15.28:0/2532381424 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f0003820 con 0x7f84fc148960 2023-11-16T02:30:06.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.356+0000 7f85024e6640 1 -- 172.21.15.28:0/2532381424 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84fc145ed0 con 0x7f84fc148960 2023-11-16T02:30:06.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.356+0000 7f85024e6640 1 -- 172.21.15.28:0/2532381424 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84fc144eb0 con 0x7f84fc148960 2023-11-16T02:30:06.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.356+0000 7f85024e6640 1 -- 172.21.15.28:0/2532381424 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84fc13f0c0 con 0x7f84fc148960 2023-11-16T02:30:06.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.356+0000 7f84f8ff9640 1 -- 172.21.15.28:0/2532381424 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f84f00b4040 con 0x7f84fc148960 2023-11-16T02:30:06.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.360+0000 7f84f8ff9640 1 --2- 172.21.15.28:0/2532381424 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f84e8065a60 0x7f84e8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:06.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.360+0000 7f84f8ff9640 1 -- 172.21.15.28:0/2532381424 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84f011c820 con 0x7f84fc148960 2023-11-16T02:30:06.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.360+0000 7f84fbfff640 1 --2- 172.21.15.28:0/2532381424 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f84e8065a60 0x7f84e8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:06.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.360+0000 7f84fbfff640 1 --2- 172.21.15.28:0/2532381424 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f84e8065a60 0x7f84e8067f20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f84ec007fd0 tx=0x7f84ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:06.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.360+0000 7f84f8ff9640 1 -- 172.21.15.28:0/2532381424 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f84f00ea2c0 con 0x7f84fc148960 2023-11-16T02:30:06.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.516+0000 7f85024e6640 1 -- 172.21.15.28:0/2532381424 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84fc04e8a0 con 0x7f84fc148960 2023-11-16T02:30:06.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.520+0000 7f84f8ff9640 1 -- 172.21.15.28:0/2532381424 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f84f00ed8e0 con 0x7f84fc148960 2023-11-16T02:30:06.520 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:30:06.520 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":22,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","created":"2023-11-16T02:29:13.710567+0000","modified":"2023-11-16T02:29:38.871066+0000","last_up_change":"2023-11-16T02:29:24.841087+0000","last_in_change":"2023-11-16T02:29:16.024490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-16T02:29:26.490910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-16T02:29:36.133224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-16T02:29:36.866156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dfa8b58d-3481-4e68-86e8-21873d31d0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":38722},{"type":"v1","addr":"172.21.15.28:6809","nonce":38722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":38722},{"type":"v1","addr":"172.21.15.28:6811","nonce":38722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":38722},{"type":"v1","addr":"172.21.15.28:6815","nonce":38722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":38722},{"type":"v1","addr":"172.21.15.28:6813","nonce":38722}]},"public_addr":"172.21.15.28:6809/38722","cluster_addr":"172.21.15.28:6811/38722","heartbeat_back_addr":"172.21.15.28:6815/38722","heartbeat_front_addr":"172.21.15.28:6813/38722","state":["exists","up"]},{"osd":1,"uuid":"1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":38724},{"type":"v1","addr":"172.21.15.28:6824","nonce":38724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":38724},{"type":"v1","addr":"172.21.15.28:6827","nonce":38724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":38724},{"type":"v1","addr":"172.21.15.28:6831","nonce":38724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":38724},{"type":"v1","addr":"172.21.15.28:6829","nonce":38724}]},"public_addr":"172.21.15.28:6824/38724","cluster_addr":"172.21.15.28:6827/38724","heartbeat_back_addr":"172.21.15.28:6831/38724","heartbeat_front_addr":"172.21.15.28:6829/38724","state":["exists","up"]},{"osd":2,"uuid":"e18f39cd-6a35-4d36-9eed-3877794bf2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":38723},{"type":"v1","addr":"172.21.15.28:6801","nonce":38723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":38723},{"type":"v1","addr":"172.21.15.28:6803","nonce":38723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":38723},{"type":"v1","addr":"172.21.15.28:6807","nonce":38723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":38723},{"type":"v1","addr":"172.21.15.28:6805","nonce":38723}]},"public_addr":"172.21.15.28:6801/38723","cluster_addr":"172.21.15.28:6803/38723","heartbeat_back_addr":"172.21.15.28:6807/38723","heartbeat_front_addr":"172.21.15.28:6805/38723","state":["exists","up"]},{"osd":3,"uuid":"303d0728-409d-47d7-b7a6-6eb273f602fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":38725},{"type":"v1","addr":"172.21.15.28:6817","nonce":38725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":38725},{"type":"v1","addr":"172.21.15.28:6819","nonce":38725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":38725},{"type":"v1","addr":"172.21.15.28:6825","nonce":38725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":38725},{"type":"v1","addr":"172.21.15.28:6821","nonce":38725}]},"public_addr":"172.21.15.28:6817/38725","cluster_addr":"172.21.15.28:6819/38725","heartbeat_back_addr":"172.21.15.28:6825/38725","heartbeat_front_addr":"172.21.15.28:6821/38725","state":["exists","up"]},{"osd":4,"uuid":"df0bf0ac-6efe-4964-ad27-7c1771a70c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":38828},{"type":"v1","addr":"172.21.15.70:6801","nonce":38828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":38828},{"type":"v1","addr":"172.21.15.70:6803","nonce":38828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":38828},{"type":"v1","addr":"172.21.15.70:6807","nonce":38828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":38828},{"type":"v1","addr":"172.21.15.70:6805","nonce":38828}]},"public_addr":"172.21.15.70:6801/38828","cluster_addr":"172.21.15.70:6803/38828","heartbeat_back_addr":"172.21.15.70:6807/38828","heartbeat_front_addr":"172.21.15.70:6805/38828","state":["exists","up"]},{"osd":5,"uuid":"84921219-65cb-4c4e-b9ed-a773db639034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":38830},{"type":"v1","addr":"172.21.15.70:6810","nonce":38830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6813","nonce":38830},{"type":"v1","addr":"172.21.15.70:6814","nonce":38830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":38830},{"type":"v1","addr":"172.21.15.70:6824","nonce":38830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":38830},{"type":"v1","addr":"172.21.15.70:6819","nonce":38830}]},"public_addr":"172.21.15.70:6810/38830","cluster_addr":"172.21.15.70:6814/38830","heartbeat_back_addr":"172.21.15.70:6824/38830","heartbeat_front_addr":"172.21.15.70:6819/38830","state":["exists","up"]},{"osd":6,"uuid":"c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":38829},{"type":"v1","addr":"172.21.15.70:6812","nonce":38829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":38829},{"type":"v1","addr":"172.21.15.70:6820","nonce":38829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":38829},{"type":"v1","addr":"172.21.15.70:6828","nonce":38829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":38829},{"type":"v1","addr":"172.21.15.70:6825","nonce":38829}]},"public_addr":"172.21.15.70:6812/38829","cluster_addr":"172.21.15.70:6820/38829","heartbeat_back_addr":"172.21.15.70:6828/38829","heartbeat_front_addr":"172.21.15.70:6825/38829","state":["exists","up"]},{"osd":7,"uuid":"e2cdd418-12ce-4eea-9b22-efdad83eb76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":38839},{"type":"v1","addr":"172.21.15.70:6815","nonce":38839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":38839},{"type":"v1","addr":"172.21.15.70:6823","nonce":38839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":38839},{"type":"v1","addr":"172.21.15.70:6831","nonce":38839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6827","nonce":38839},{"type":"v1","addr":"172.21.15.70:6829","nonce":38839}]},"public_addr":"172.21.15.70:6815/38839","cluster_addr":"172.21.15.70:6823/38839","heartbeat_back_addr":"172.21.15.70:6831/38839","heartbeat_front_addr":"172.21.15.70:6829/38839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.544240+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.637637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.352115+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.652916+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.624477+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.570247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.706468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.696574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-16T02:30:06.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.520+0000 7f85024e6640 1 -- 172.21.15.28:0/2532381424 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f84e8065a60 msgr2=0x7f84e8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:06.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.520+0000 7f85024e6640 1 --2- 172.21.15.28:0/2532381424 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f84e8065a60 0x7f84e8067f20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f84ec007fd0 tx=0x7f84ec009040 comp rx=0 tx=0).stop 2023-11-16T02:30:06.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.520+0000 7f85024e6640 1 -- 172.21.15.28:0/2532381424 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84fc148960 msgr2=0x7f84fc143d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:06.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.520+0000 7f85024e6640 1 --2- 172.21.15.28:0/2532381424 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84fc148960 0x7f84fc143d70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f84f00097c0 tx=0x7f84f00191f0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.520+0000 7f85024e6640 1 -- 172.21.15.28:0/2532381424 shutdown_connections 2023-11-16T02:30:06.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.520+0000 7f85024e6640 1 --2- 172.21.15.28:0/2532381424 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f84e8065a60 0x7f84e8067f20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.520+0000 7f85024e6640 1 --2- 172.21.15.28:0/2532381424 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f84fc148df0 0x7f84fc145990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.520+0000 7f85024e6640 1 --2- 172.21.15.28:0/2532381424 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84fc148960 0x7f84fc143d70 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.520+0000 7f85024e6640 1 --2- 172.21.15.28:0/2532381424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84fc0b8240 0x7f84fc13b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.520+0000 7f85024e6640 1 -- 172.21.15.28:0/2532381424 >> 172.21.15.28:0/2532381424 conn(0x7f84fc0b9050 msgr2=0x7f84fc13d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:06.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.520+0000 7f85024e6640 1 -- 172.21.15.28:0/2532381424 shutdown_connections 2023-11-16T02:30:06.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.520+0000 7f85024e6640 1 -- 172.21.15.28:0/2532381424 wait complete. 2023-11-16T02:30:06.539 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-16T02:29:26.490910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-16T02:29:36.133224+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-16T02:29:36.866156+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-16T02:30:06.540 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-16T02:30:06.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.668+0000 7f57e3702640 1 Processor -- start 2023-11-16T02:30:06.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.668+0000 7f57e3702640 1 -- start start 2023-11-16T02:30:06.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.668+0000 7f57e3702640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f57dc0702d0 0x7f57dc071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:06.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.668+0000 7f57e3702640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57dc14b1f0 con 0x7f57dc06a3d0 2023-11-16T02:30:06.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.668+0000 7f57e3702640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57dc14aec0 con 0x7f57dc1417e0 2023-11-16T02:30:06.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.668+0000 7f57e3702640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57dc14bd90 con 0x7f57dc0702d0 2023-11-16T02:30:06.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.668+0000 7f57e0c9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f57dc0702d0 0x7f57dc071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:06.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.668+0000 7f57e149e640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f57dc06a3d0 0x7f57dc14b680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37288/0 (socket says 172.21.15.28:37288) 2023-11-16T02:30:06.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.668+0000 7f57e0c9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f57dc0702d0 0x7f57dc071090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50356/0 (socket says 172.21.15.28:50356) 2023-11-16T02:30:06.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.668+0000 7f57e149e640 1 -- 172.21.15.28:0/2456326970 learned_addr learned my addr 172.21.15.28:0/2456326970 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:06.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.668+0000 7f57e0c9d640 1 -- 172.21.15.28:0/2456326970 >> v1:172.21.15.70:6789/0 conn(0x7f57dc1417e0 legacy=0x7f57dc1521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:06.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.668+0000 7f57e0c9d640 1 -- 172.21.15.28:0/2456326970 >> v1:172.21.15.28:6789/0 conn(0x7f57dc06a3d0 legacy=0x7f57dc14b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:06.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.668+0000 7f57d3fff640 1 -- 172.21.15.28:0/2456326970 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747746438 0 0) 0x7f57dc14b1f0 con 0x7f57dc06a3d0 2023-11-16T02:30:06.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.668+0000 7f57e0c9d640 1 -- 172.21.15.28:0/2456326970 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57dc0716b0 con 0x7f57dc0702d0 2023-11-16T02:30:06.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e0c9d640 1 --2- 172.21.15.28:0/2456326970 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57dc0702d0 0x7f57dc071090 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f57cc0097c0 tx=0x7f57cc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b03f56895df9a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:06.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57d3fff640 1 -- 172.21.15.28:0/2456326970 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc004230 con 0x7f57dc0702d0 2023-11-16T02:30:06.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57d3fff640 1 -- 172.21.15.28:0/2456326970 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57cc0a7050 con 0x7f57dc0702d0 2023-11-16T02:30:06.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57d3fff640 1 -- 172.21.15.28:0/2456326970 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc003620 con 0x7f57dc0702d0 2023-11-16T02:30:06.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e3702640 1 -- 172.21.15.28:0/2456326970 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57dc0702d0 msgr2=0x7f57dc071090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:06.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e3702640 1 --2- 172.21.15.28:0/2456326970 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57dc0702d0 0x7f57dc071090 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f57cc0097c0 tx=0x7f57cc01c440 comp rx=0 tx=0).stop 2023-11-16T02:30:06.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e3702640 1 -- 172.21.15.28:0/2456326970 shutdown_connections 2023-11-16T02:30:06.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e3702640 1 --2- 172.21.15.28:0/2456326970 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57dc0702d0 0x7f57dc071090 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e3702640 1 -- 172.21.15.28:0/2456326970 >> 172.21.15.28:0/2456326970 conn(0x7f57dc0bc5a0 msgr2=0x7f57dc0bc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:06.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e3702640 1 -- 172.21.15.28:0/2456326970 shutdown_connections 2023-11-16T02:30:06.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e3702640 1 -- 172.21.15.28:0/2456326970 wait complete. 2023-11-16T02:30:06.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e3702640 1 Processor -- start 2023-11-16T02:30:06.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e3702640 1 -- start start 2023-11-16T02:30:06.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e3702640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57dc06a3d0 0x7f57dc14a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:06.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e3702640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f57dc0702d0 0x7f57dc149400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:06.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e3702640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57dc1417e0 0x7f57dc1334e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:06.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e3702640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc0ba680 con 0x7f57dc06a3d0 2023-11-16T02:30:06.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e3702640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc0bbd70 con 0x7f57dc1417e0 2023-11-16T02:30:06.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e3702640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc14ab60 con 0x7f57dc0702d0 2023-11-16T02:30:06.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e149e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57dc06a3d0 0x7f57dc14a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:06.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e149e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57dc06a3d0 0x7f57dc14a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50366/0 (socket says 172.21.15.28:50366) 2023-11-16T02:30:06.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e149e640 1 -- 172.21.15.28:0/1980774039 learned_addr learned my addr 172.21.15.28:0/1980774039 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:06.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e0c9d640 1 --2- 172.21.15.28:0/1980774039 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f57dc0702d0 0x7f57dc149400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:06.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e149e640 1 -- 172.21.15.28:0/1980774039 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f57dc0702d0 msgr2=0x7f57dc149400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:06.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e1c9f640 1 --2- 172.21.15.28:0/1980774039 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57dc1417e0 0x7f57dc1334e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:06.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e149e640 1 --2- 172.21.15.28:0/1980774039 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f57dc0702d0 0x7f57dc149400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e149e640 1 -- 172.21.15.28:0/1980774039 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57dc1417e0 msgr2=0x7f57dc1334e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:06.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e149e640 1 --2- 172.21.15.28:0/1980774039 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57dc1417e0 0x7f57dc1334e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e149e640 1 -- 172.21.15.28:0/1980774039 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc009420 con 0x7f57dc06a3d0 2023-11-16T02:30:06.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57e149e640 1 --2- 172.21.15.28:0/1980774039 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57dc06a3d0 0x7f57dc14a620 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f57d80011f0 tx=0x7f57d800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:06.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57d1ffb640 1 -- 172.21.15.28:0/1980774039 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d80074e0 con 0x7f57dc06a3d0 2023-11-16T02:30:06.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.672+0000 7f57d1ffb640 1 -- 172.21.15.28:0/1980774039 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d8007640 con 0x7f57dc06a3d0 2023-11-16T02:30:06.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.676+0000 7f57e3702640 1 -- 172.21.15.28:0/1980774039 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57dc0ba3a0 con 0x7f57dc06a3d0 2023-11-16T02:30:06.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.676+0000 7f57d1ffb640 1 -- 172.21.15.28:0/1980774039 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8004a10 con 0x7f57dc06a3d0 2023-11-16T02:30:06.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.676+0000 7f57e3702640 1 -- 172.21.15.28:0/1980774039 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57dc0bb850 con 0x7f57dc06a3d0 2023-11-16T02:30:06.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.676+0000 7f57e3702640 1 -- 172.21.15.28:0/1980774039 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57dc04e8a0 con 0x7f57dc06a3d0 2023-11-16T02:30:06.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.676+0000 7f57d1ffb640 1 -- 172.21.15.28:0/1980774039 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f57d8004b70 con 0x7f57dc06a3d0 2023-11-16T02:30:06.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.676+0000 7f57d1ffb640 1 --2- 172.21.15.28:0/1980774039 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f57c0065a60 0x7f57c0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:06.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.676+0000 7f57d1ffb640 1 -- 172.21.15.28:0/1980774039 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57d8082620 con 0x7f57dc06a3d0 2023-11-16T02:30:06.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.676+0000 7f57e0c9d640 1 --2- 172.21.15.28:0/1980774039 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f57c0065a60 0x7f57c0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:06.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.676+0000 7f57e0c9d640 1 --2- 172.21.15.28:0/1980774039 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f57c0065a60 0x7f57c0067f20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f57cc0ad000 tx=0x7f57cc0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:06.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.680+0000 7f57d1ffb640 1 -- 172.21.15.28:0/1980774039 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f57d8050070 con 0x7f57dc06a3d0 2023-11-16T02:30:06.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.832+0000 7f57e3702640 1 -- 172.21.15.28:0/1980774039 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f57dc14b910 con 0x7f57dc06a3d0 2023-11-16T02:30:06.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.836+0000 7f57d1ffb640 1 -- 172.21.15.28:0/1980774039 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f57d8053690 con 0x7f57dc06a3d0 2023-11-16T02:30:06.835 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-11-16T02:30:06.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.836+0000 7f57e3702640 1 -- 172.21.15.28:0/1980774039 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f57c0065a60 msgr2=0x7f57c0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:06.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.836+0000 7f57e3702640 1 --2- 172.21.15.28:0/1980774039 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f57c0065a60 0x7f57c0067f20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f57cc0ad000 tx=0x7f57cc0a6000 comp rx=0 tx=0).stop 2023-11-16T02:30:06.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.836+0000 7f57e3702640 1 -- 172.21.15.28:0/1980774039 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57dc06a3d0 msgr2=0x7f57dc14a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:06.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.836+0000 7f57e3702640 1 --2- 172.21.15.28:0/1980774039 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57dc06a3d0 0x7f57dc14a620 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f57d80011f0 tx=0x7f57d800c9b0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.836+0000 7f57e3702640 1 -- 172.21.15.28:0/1980774039 shutdown_connections 2023-11-16T02:30:06.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.836+0000 7f57e3702640 1 --2- 172.21.15.28:0/1980774039 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f57c0065a60 0x7f57c0067f20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.836+0000 7f57e3702640 1 --2- 172.21.15.28:0/1980774039 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57dc1417e0 0x7f57dc1334e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.836+0000 7f57e3702640 1 --2- 172.21.15.28:0/1980774039 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f57dc0702d0 0x7f57dc149400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.836+0000 7f57e3702640 1 --2- 172.21.15.28:0/1980774039 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f57dc06a3d0 0x7f57dc14a620 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.836+0000 7f57e3702640 1 -- 172.21.15.28:0/1980774039 >> 172.21.15.28:0/1980774039 conn(0x7f57dc0bc5a0 msgr2=0x7f57dc13c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:06.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.836+0000 7f57e3702640 1 -- 172.21.15.28:0/1980774039 shutdown_connections 2023-11-16T02:30:06.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.836+0000 7f57e3702640 1 -- 172.21.15.28:0/1980774039 wait complete. 2023-11-16T02:30:06.854 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-16T02:30:06.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.968+0000 7fb71d995640 1 Processor -- start 2023-11-16T02:30:06.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.968+0000 7fb71d995640 1 -- start start 2023-11-16T02:30:06.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.972+0000 7fb71d995640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb71806a170 0x7fb7180b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:06.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.972+0000 7fb71d995640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb71806a550 0x7fb718148a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:06.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.972+0000 7fb71d995640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb718148fa0 0x7fb7180b7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:06.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.972+0000 7fb71d995640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb718071800 con 0x7fb71806a170 2023-11-16T02:30:06.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.972+0000 7fb71d995640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7180b5ec0 con 0x7fb71806a550 2023-11-16T02:30:06.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.972+0000 7fb71d995640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7180b6350 con 0x7fb718148fa0 2023-11-16T02:30:06.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.972+0000 7fb716ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb71806a170 0x7fb7180b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:06.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.972+0000 7fb716ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb71806a170 0x7fb7180b3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50374/0 (socket says 172.21.15.28:50374) 2023-11-16T02:30:06.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.972+0000 7fb716ffd640 1 -- 172.21.15.28:0/1150936184 learned_addr learned my addr 172.21.15.28:0/1150936184 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:06.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.972+0000 7fb7177fe640 1 --2- 172.21.15.28:0/1150936184 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb718148fa0 0x7fb7180b7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:06.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.972+0000 7fb7167fc640 1 --2- 172.21.15.28:0/1150936184 >> v2:172.21.15.70:3300/0 conn(0x7fb71806a550 0x7fb718148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:06.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.972+0000 7fb716ffd640 1 -- 172.21.15.28:0/1150936184 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb718148fa0 msgr2=0x7fb7180b7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:06.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.972+0000 7fb716ffd640 1 --2- 172.21.15.28:0/1150936184 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb718148fa0 0x7fb7180b7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.972+0000 7fb716ffd640 1 -- 172.21.15.28:0/1150936184 >> v2:172.21.15.70:3300/0 conn(0x7fb71806a550 msgr2=0x7fb718148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:06.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.972+0000 7fb716ffd640 1 --2- 172.21.15.28:0/1150936184 >> v2:172.21.15.70:3300/0 conn(0x7fb71806a550 0x7fb718148a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.972+0000 7fb716ffd640 1 -- 172.21.15.28:0/1150936184 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7180b5870 con 0x7fb71806a170 2023-11-16T02:30:06.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.972+0000 7fb716ffd640 1 --2- 172.21.15.28:0/1150936184 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb71806a170 0x7fb7180b3bc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb718071700 tx=0x7fb71001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c24d3b15afdf1a server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:06.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.972+0000 7fb715ffb640 1 -- 172.21.15.28:0/1150936184 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7100a56d0 con 0x7fb71806a170 2023-11-16T02:30:06.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.972+0000 7fb715ffb640 1 -- 172.21.15.28:0/1150936184 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7100a5830 con 0x7fb71806a170 2023-11-16T02:30:06.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.972+0000 7fb715ffb640 1 -- 172.21.15.28:0/1150936184 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7100a5bc0 con 0x7fb71806a170 2023-11-16T02:30:06.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb71d995640 1 -- 172.21.15.28:0/1150936184 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb71806a170 msgr2=0x7fb7180b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:06.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb71d995640 1 --2- 172.21.15.28:0/1150936184 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb71806a170 0x7fb7180b3bc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb718071700 tx=0x7fb71001c940 comp rx=0 tx=0).stop 2023-11-16T02:30:06.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb71d995640 1 -- 172.21.15.28:0/1150936184 shutdown_connections 2023-11-16T02:30:06.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb71d995640 1 --2- 172.21.15.28:0/1150936184 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb718148fa0 0x7fb7180b7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb71d995640 1 --2- 172.21.15.28:0/1150936184 >> v2:172.21.15.70:3300/0 conn(0x7fb71806a550 0x7fb718148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb71d995640 1 --2- 172.21.15.28:0/1150936184 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb71806a170 0x7fb7180b3bc0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb71d995640 1 -- 172.21.15.28:0/1150936184 >> 172.21.15.28:0/1150936184 conn(0x7fb7180bc5a0 msgr2=0x7fb7180bc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:06.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb71d995640 1 -- 172.21.15.28:0/1150936184 shutdown_connections 2023-11-16T02:30:06.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb71d995640 1 -- 172.21.15.28:0/1150936184 wait complete. 2023-11-16T02:30:06.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb71d995640 1 Processor -- start 2023-11-16T02:30:06.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb71d995640 1 -- start start 2023-11-16T02:30:06.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb71d995640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb71806a170 0x7fb71814b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:06.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb71d995640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb71806a550 0x7fb7181e4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:06.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb71d995640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb718148fa0 0x7fb7181e47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:06.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb71d995640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb718146170 con 0x7fb71806a550 2023-11-16T02:30:06.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb71d995640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb718141830 con 0x7fb71806a170 2023-11-16T02:30:06.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb71d995640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb718141b10 con 0x7fb718148fa0 2023-11-16T02:30:06.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb7167fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb71806a550 0x7fb7181e4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:06.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb7167fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb71806a550 0x7fb7181e4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50382/0 (socket says 172.21.15.28:50382) 2023-11-16T02:30:06.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb7167fc640 1 -- 172.21.15.28:0/3920410733 learned_addr learned my addr 172.21.15.28:0/3920410733 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:06.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb716ffd640 1 --2- 172.21.15.28:0/3920410733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb71806a170 0x7fb71814b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:06.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb7177fe640 1 --2- 172.21.15.28:0/3920410733 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb718148fa0 0x7fb7181e47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:06.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb7167fc640 1 -- 172.21.15.28:0/3920410733 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb718148fa0 msgr2=0x7fb7181e47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:06.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb7167fc640 1 --2- 172.21.15.28:0/3920410733 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb718148fa0 0x7fb7181e47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb7167fc640 1 -- 172.21.15.28:0/3920410733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb71806a170 msgr2=0x7fb71814b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:06.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb7167fc640 1 --2- 172.21.15.28:0/3920410733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb71806a170 0x7fb71814b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:06.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.976+0000 7fb7167fc640 1 -- 172.21.15.28:0/3920410733 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb710009b30 con 0x7fb71806a550 2023-11-16T02:30:06.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.980+0000 7fb7167fc640 1 --2- 172.21.15.28:0/3920410733 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb71806a550 0x7fb7181e4260 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00d800 tx=0x7fb70c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:06.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.980+0000 7fb6fffff640 1 -- 172.21.15.28:0/3920410733 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c0096a0 con 0x7fb71806a550 2023-11-16T02:30:06.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.980+0000 7fb6fffff640 1 -- 172.21.15.28:0/3920410733 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70c009800 con 0x7fb71806a550 2023-11-16T02:30:06.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.980+0000 7fb6fffff640 1 -- 172.21.15.28:0/3920410733 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c009b70 con 0x7fb71806a550 2023-11-16T02:30:06.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.980+0000 7fb71d995640 1 -- 172.21.15.28:0/3920410733 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb718145900 con 0x7fb71806a550 2023-11-16T02:30:06.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.980+0000 7fb71d995640 1 -- 172.21.15.28:0/3920410733 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7181454d0 con 0x7fb71806a550 2023-11-16T02:30:06.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.980+0000 7fb71d995640 1 -- 172.21.15.28:0/3920410733 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71804e8a0 con 0x7fb71806a550 2023-11-16T02:30:06.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.980+0000 7fb6fffff640 1 -- 172.21.15.28:0/3920410733 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb70c009cd0 con 0x7fb71806a550 2023-11-16T02:30:06.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.980+0000 7fb6fffff640 1 --2- 172.21.15.28:0/3920410733 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb704065a90 0x7fb704067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:06.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.980+0000 7fb6fffff640 1 -- 172.21.15.28:0/3920410733 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb70c0836b0 con 0x7fb71806a550 2023-11-16T02:30:06.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.980+0000 7fb716ffd640 1 --2- 172.21.15.28:0/3920410733 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb704065a90 0x7fb704067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:06.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.980+0000 7fb716ffd640 1 --2- 172.21.15.28:0/3920410733 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb704065a90 0x7fb704067f50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb7100ae000 tx=0x7fb7100a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:06.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:06.984+0000 7fb6fffff640 1 -- 172.21.15.28:0/3920410733 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fb70c0511b0 con 0x7fb71806a550 2023-11-16T02:30:07.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.136+0000 7fb71d995640 1 -- 172.21.15.28:0/3920410733 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb718148090 con 0x7fb71806a550 2023-11-16T02:30:07.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.140+0000 7fb6fffff640 1 -- 172.21.15.28:0/3920410733 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb70c0547d0 con 0x7fb71806a550 2023-11-16T02:30:07.140 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-11-16T02:30:07.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.140+0000 7fb71d995640 1 -- 172.21.15.28:0/3920410733 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb704065a90 msgr2=0x7fb704067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:07.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.140+0000 7fb71d995640 1 --2- 172.21.15.28:0/3920410733 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb704065a90 0x7fb704067f50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb7100ae000 tx=0x7fb7100a7070 comp rx=0 tx=0).stop 2023-11-16T02:30:07.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.140+0000 7fb71d995640 1 -- 172.21.15.28:0/3920410733 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb71806a550 msgr2=0x7fb7181e4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:07.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.140+0000 7fb71d995640 1 --2- 172.21.15.28:0/3920410733 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb71806a550 0x7fb7181e4260 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00d800 tx=0x7fb70c00dcc0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.140+0000 7fb71d995640 1 -- 172.21.15.28:0/3920410733 shutdown_connections 2023-11-16T02:30:07.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.140+0000 7fb71d995640 1 --2- 172.21.15.28:0/3920410733 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb704065a90 0x7fb704067f50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.140+0000 7fb71d995640 1 --2- 172.21.15.28:0/3920410733 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb718148fa0 0x7fb7181e47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.140+0000 7fb71d995640 1 --2- 172.21.15.28:0/3920410733 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb71806a550 0x7fb7181e4260 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.140+0000 7fb71d995640 1 --2- 172.21.15.28:0/3920410733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb71806a170 0x7fb71814b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.140+0000 7fb71d995640 1 -- 172.21.15.28:0/3920410733 >> 172.21.15.28:0/3920410733 conn(0x7fb7180bc5a0 msgr2=0x7fb718148800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:07.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.140+0000 7fb71d995640 1 -- 172.21.15.28:0/3920410733 shutdown_connections 2023-11-16T02:30:07.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.140+0000 7fb71d995640 1 -- 172.21.15.28:0/3920410733 wait complete. 2023-11-16T02:30:07.159 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-16T02:30:07.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.284+0000 7fc28e6ed640 1 Processor -- start 2023-11-16T02:30:07.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.284+0000 7fc28e6ed640 1 -- start start 2023-11-16T02:30:07.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.284+0000 7fc28e6ed640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc28806a170 0x7fc2880b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:07.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.284+0000 7fc28e6ed640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc2880b7c60 0x7fc2880b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:07.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.284+0000 7fc28e6ed640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc288071800 con 0x7fc28806a550 2023-11-16T02:30:07.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.284+0000 7fc28e6ed640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2880b5ec0 con 0x7fc28806a170 2023-11-16T02:30:07.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.284+0000 7fc28e6ed640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2880b6350 con 0x7fc2880b7c60 2023-11-16T02:30:07.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.284+0000 7fc287fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc28806a170 0x7fc2880b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:07.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.284+0000 7fc2877fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc28806a550 0x7fc288148a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37290/0 (socket says 172.21.15.28:37290) 2023-11-16T02:30:07.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.284+0000 7fc2877fe640 1 -- 172.21.15.28:0/2485347914 learned_addr learned my addr 172.21.15.28:0/2485347914 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:07.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.284+0000 7fc28cc8a640 1 --2- 172.21.15.28:0/2485347914 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc2880b7c60 0x7fc2880b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:07.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.284+0000 7fc287fff640 1 -- 172.21.15.28:0/2485347914 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc2880b7c60 msgr2=0x7fc2880b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:07.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.284+0000 7fc287fff640 1 --2- 172.21.15.28:0/2485347914 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc2880b7c60 0x7fc2880b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.284+0000 7fc287fff640 1 -- 172.21.15.28:0/2485347914 >> v1:172.21.15.28:6789/0 conn(0x7fc28806a550 legacy=0x7fc288148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:07.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.284+0000 7fc287fff640 1 -- 172.21.15.28:0/2485347914 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2880b5870 con 0x7fc28806a170 2023-11-16T02:30:07.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.284+0000 7fc286ffd640 1 -- 172.21.15.28:0/2485347914 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3051588472 0 0) 0x7fc27c001120 con 0x7fc28806a550 2023-11-16T02:30:07.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.284+0000 7fc28cc8a640 1 --2- 172.21.15.28:0/2485347914 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc2880b7c60 0x7fc2880b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:30:07.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.288+0000 7fc287fff640 1 --2- 172.21.15.28:0/2485347914 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc28806a170 0x7fc2880b3bc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc278009d90 tx=0x7fc27801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73282b8057e11303 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:07.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.288+0000 7fc286ffd640 1 -- 172.21.15.28:0/2485347914 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2780a5920 con 0x7fc28806a170 2023-11-16T02:30:07.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.288+0000 7fc286ffd640 1 -- 172.21.15.28:0/2485347914 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2780a5a80 con 0x7fc28806a170 2023-11-16T02:30:07.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.288+0000 7fc286ffd640 1 -- 172.21.15.28:0/2485347914 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2780a5e10 con 0x7fc28806a170 2023-11-16T02:30:07.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.288+0000 7fc28e6ed640 1 -- 172.21.15.28:0/2485347914 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc28806a170 msgr2=0x7fc2880b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:07.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.288+0000 7fc28e6ed640 1 --2- 172.21.15.28:0/2485347914 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc28806a170 0x7fc2880b3bc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc278009d90 tx=0x7fc27801c8c0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.288+0000 7fc28e6ed640 1 -- 172.21.15.28:0/2485347914 shutdown_connections 2023-11-16T02:30:07.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.288+0000 7fc28e6ed640 1 --2- 172.21.15.28:0/2485347914 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc2880b7c60 0x7fc2880b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.288+0000 7fc28e6ed640 1 --2- 172.21.15.28:0/2485347914 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc28806a170 0x7fc2880b3bc0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.288+0000 7fc28e6ed640 1 -- 172.21.15.28:0/2485347914 >> 172.21.15.28:0/2485347914 conn(0x7fc2880bc5a0 msgr2=0x7fc2880bc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:07.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.288+0000 7fc28e6ed640 1 -- 172.21.15.28:0/2485347914 shutdown_connections 2023-11-16T02:30:07.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.288+0000 7fc28e6ed640 1 -- 172.21.15.28:0/2485347914 wait complete. 2023-11-16T02:30:07.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.292+0000 7fc28e6ed640 1 Processor -- start 2023-11-16T02:30:07.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.292+0000 7fc28e6ed640 1 -- start start 2023-11-16T02:30:07.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.292+0000 7fc28e6ed640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc28806a170 0x7fc28806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:07.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.292+0000 7fc28e6ed640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc28806a550 0x7fc2881418e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:07.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.292+0000 7fc28e6ed640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2880b7c60 0x7fc288141e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:07.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.292+0000 7fc28e6ed640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc288151de0 con 0x7fc28806a170 2023-11-16T02:30:07.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.292+0000 7fc28e6ed640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2880707a0 con 0x7fc2880b7c60 2023-11-16T02:30:07.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.292+0000 7fc28e6ed640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc288152e70 con 0x7fc28806a550 2023-11-16T02:30:07.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.292+0000 7fc287fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc28806a170 0x7fc28806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:07.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.292+0000 7fc287fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc28806a170 0x7fc28806f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50400/0 (socket says 172.21.15.28:50400) 2023-11-16T02:30:07.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.292+0000 7fc287fff640 1 -- 172.21.15.28:0/3750041653 learned_addr learned my addr 172.21.15.28:0/3750041653 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:07.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.292+0000 7fc28cc8a640 1 --2- 172.21.15.28:0/3750041653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2880b7c60 0x7fc288141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:07.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.292+0000 7fc2877fe640 1 --2- 172.21.15.28:0/3750041653 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc28806a550 0x7fc2881418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:07.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.292+0000 7fc287fff640 1 -- 172.21.15.28:0/3750041653 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc28806a550 msgr2=0x7fc2881418e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:07.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.292+0000 7fc287fff640 1 --2- 172.21.15.28:0/3750041653 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc28806a550 0x7fc2881418e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.292+0000 7fc287fff640 1 -- 172.21.15.28:0/3750041653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2880b7c60 msgr2=0x7fc288141e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:07.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.292+0000 7fc287fff640 1 --2- 172.21.15.28:0/3750041653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2880b7c60 0x7fc288141e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.292+0000 7fc287fff640 1 -- 172.21.15.28:0/3750041653 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc278009a70 con 0x7fc28806a170 2023-11-16T02:30:07.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.292+0000 7fc287fff640 1 --2- 172.21.15.28:0/3750041653 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc28806a170 0x7fc28806f1a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc27801a4f0 tx=0x7fc278019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:07.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.292+0000 7fc284ff9640 1 -- 172.21.15.28:0/3750041653 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2780b8890 con 0x7fc28806a170 2023-11-16T02:30:07.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.292+0000 7fc284ff9640 1 -- 172.21.15.28:0/3750041653 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2780b89f0 con 0x7fc28806a170 2023-11-16T02:30:07.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.292+0000 7fc28e6ed640 1 -- 172.21.15.28:0/3750041653 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc288151790 con 0x7fc28806a170 2023-11-16T02:30:07.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.292+0000 7fc284ff9640 1 -- 172.21.15.28:0/3750041653 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2780b8d80 con 0x7fc28806a170 2023-11-16T02:30:07.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.292+0000 7fc28e6ed640 1 -- 172.21.15.28:0/3750041653 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2880704c0 con 0x7fc28806a170 2023-11-16T02:30:07.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.292+0000 7fc28e6ed640 1 -- 172.21.15.28:0/3750041653 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc28804e8a0 con 0x7fc28806a170 2023-11-16T02:30:07.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.296+0000 7fc284ff9640 1 -- 172.21.15.28:0/3750041653 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc2780b4040 con 0x7fc28806a170 2023-11-16T02:30:07.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.296+0000 7fc284ff9640 1 --2- 172.21.15.28:0/3750041653 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc274065a90 0x7fc274067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:07.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.296+0000 7fc284ff9640 1 -- 172.21.15.28:0/3750041653 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc27811e800 con 0x7fc28806a170 2023-11-16T02:30:07.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.296+0000 7fc2877fe640 1 --2- 172.21.15.28:0/3750041653 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc274065a90 0x7fc274067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:07.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.296+0000 7fc2877fe640 1 --2- 172.21.15.28:0/3750041653 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc274065a90 0x7fc274067f50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc28813b510 tx=0x7fc27c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:07.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.300+0000 7fc284ff9640 1 -- 172.21.15.28:0/3750041653 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fc2780ec330 con 0x7fc28806a170 2023-11-16T02:30:07.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.456+0000 7fc28e6ed640 1 -- 172.21.15.28:0/3750041653 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc2880b5120 con 0x7fc28806a170 2023-11-16T02:30:07.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.456+0000 7fc284ff9640 1 -- 172.21.15.28:0/3750041653 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc2780ef950 con 0x7fc28806a170 2023-11-16T02:30:07.457 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-11-16T02:30:07.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.460+0000 7fc28e6ed640 1 -- 172.21.15.28:0/3750041653 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc274065a90 msgr2=0x7fc274067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:07.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.460+0000 7fc28e6ed640 1 --2- 172.21.15.28:0/3750041653 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc274065a90 0x7fc274067f50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc28813b510 tx=0x7fc27c009040 comp rx=0 tx=0).stop 2023-11-16T02:30:07.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.460+0000 7fc28e6ed640 1 -- 172.21.15.28:0/3750041653 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc28806a170 msgr2=0x7fc28806f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:07.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.460+0000 7fc28e6ed640 1 --2- 172.21.15.28:0/3750041653 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc28806a170 0x7fc28806f1a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc27801a4f0 tx=0x7fc278019660 comp rx=0 tx=0).stop 2023-11-16T02:30:07.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.460+0000 7fc28e6ed640 1 -- 172.21.15.28:0/3750041653 shutdown_connections 2023-11-16T02:30:07.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.460+0000 7fc28e6ed640 1 --2- 172.21.15.28:0/3750041653 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc274065a90 0x7fc274067f50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.460+0000 7fc28e6ed640 1 --2- 172.21.15.28:0/3750041653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2880b7c60 0x7fc288141e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.460+0000 7fc28e6ed640 1 --2- 172.21.15.28:0/3750041653 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc28806a550 0x7fc2881418e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.460+0000 7fc28e6ed640 1 --2- 172.21.15.28:0/3750041653 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc28806a170 0x7fc28806f1a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.460+0000 7fc28e6ed640 1 -- 172.21.15.28:0/3750041653 >> 172.21.15.28:0/3750041653 conn(0x7fc2880bc5a0 msgr2=0x7fc2880ba730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:07.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.460+0000 7fc28e6ed640 1 -- 172.21.15.28:0/3750041653 shutdown_connections 2023-11-16T02:30:07.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.460+0000 7fc28e6ed640 1 -- 172.21.15.28:0/3750041653 wait complete. 2023-11-16T02:30:07.477 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-16T02:30:07.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.596+0000 7f06b2f1e640 1 Processor -- start 2023-11-16T02:30:07.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.596+0000 7f06b2f1e640 1 -- start start 2023-11-16T02:30:07.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06b2f1e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f06ac0b8240 0x7f06ac0bc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:07.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06b2f1e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f06ac0b3b60 0x7f06ac148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:07.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06b2f1e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ac0b52b0 con 0x7f06ac148960 2023-11-16T02:30:07.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06b2f1e640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ac0b6220 con 0x7f06ac0b3b60 2023-11-16T02:30:07.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06b2f1e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac0b4040 con 0x7f06ac0b8240 2023-11-16T02:30:07.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06abfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f06ac148960 0x7f06ac0b3450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37294/0 (socket says 172.21.15.28:37294) 2023-11-16T02:30:07.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06abfff640 1 -- 172.21.15.28:0/3440571887 learned_addr learned my addr 172.21.15.28:0/3440571887 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:07.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06b14bb640 1 --2- 172.21.15.28:0/3440571887 >> v2:172.21.15.70:3300/0 conn(0x7f06ac0b3b60 0x7f06ac148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:07.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06ab7fe640 1 -- 172.21.15.28:0/3440571887 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2298738730 0 0) 0x7f06ac0b52b0 con 0x7f06ac148960 2023-11-16T02:30:07.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06ab7fe640 1 -- 172.21.15.28:0/3440571887 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0694003530 con 0x7f06ac148960 2023-11-16T02:30:07.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06b0cba640 1 --2- 172.21.15.28:0/3440571887 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f06ac0b8240 0x7f06ac0bc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:07.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06ab7fe640 1 -- 172.21.15.28:0/3440571887 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4097911796 0 0) 0x7f0694003530 con 0x7f06ac148960 2023-11-16T02:30:07.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06ab7fe640 1 -- 172.21.15.28:0/3440571887 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f06ac0b8240 msgr2=0x7f06ac0bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:07.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06ab7fe640 1 --2- 172.21.15.28:0/3440571887 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f06ac0b8240 0x7f06ac0bc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06ab7fe640 1 -- 172.21.15.28:0/3440571887 >> v2:172.21.15.70:3300/0 conn(0x7f06ac0b3b60 msgr2=0x7f06ac148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:07.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06ab7fe640 1 --2- 172.21.15.28:0/3440571887 >> v2:172.21.15.70:3300/0 conn(0x7f06ac0b3b60 0x7f06ac148dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06ab7fe640 1 -- 172.21.15.28:0/3440571887 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac0b5a20 con 0x7f06ac148960 2023-11-16T02:30:07.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06ab7fe640 1 -- 172.21.15.28:0/3440571887 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7f06a0001680 con 0x7f06ac148960 2023-11-16T02:30:07.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06ab7fe640 1 -- 172.21.15.28:0/3440571887 >> v1:172.21.15.28:6789/0 conn(0x7f06ac148960 legacy=0x7f06ac0b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:07.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06ab7fe640 1 --2- 172.21.15.28:0/3440571887 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f06ac0b8240 0x7f0694003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:07.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06ab7fe640 1 --2- 172.21.15.28:0/3440571887 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0694003f00 0x7f06940047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:07.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06ab7fe640 1 --2- 172.21.15.28:0/3440571887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0694004d10 0x7f0694005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:07.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06ab7fe640 1 -- 172.21.15.28:0/3440571887 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac0b6220 con 0x7f0694003f00 2023-11-16T02:30:07.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06ab7fe640 1 -- 172.21.15.28:0/3440571887 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac0b4040 con 0x7f0694004d10 2023-11-16T02:30:07.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06ab7fe640 1 -- 172.21.15.28:0/3440571887 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069400b990 con 0x7f06ac0b8240 2023-11-16T02:30:07.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06abfff640 1 --2- 172.21.15.28:0/3440571887 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0694003f00 0x7f06940047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:07.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06b0cba640 1 --2- 172.21.15.28:0/3440571887 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f06ac0b8240 0x7f0694003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:07.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06b14bb640 1 --2- 172.21.15.28:0/3440571887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0694004d10 0x7f0694005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:07.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06abfff640 1 -- 172.21.15.28:0/3440571887 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f06ac0b8240 msgr2=0x7f0694003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:07.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06abfff640 1 --2- 172.21.15.28:0/3440571887 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f06ac0b8240 0x7f0694003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06abfff640 1 -- 172.21.15.28:0/3440571887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0694004d10 msgr2=0x7f0694005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:07.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06abfff640 1 --2- 172.21.15.28:0/3440571887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0694004d10 0x7f0694005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.600+0000 7f06abfff640 1 -- 172.21.15.28:0/3440571887 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0694003530 con 0x7f0694003f00 2023-11-16T02:30:07.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06abfff640 1 --2- 172.21.15.28:0/3440571887 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0694003f00 0x7f06940047d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f06a000c290 tx=0x7f06a001f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dacf6493606dfe12 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:07.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06ab7fe640 1 -- 172.21.15.28:0/3440571887 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a0005ae0 con 0x7f0694003f00 2023-11-16T02:30:07.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06ab7fe640 1 -- 172.21.15.28:0/3440571887 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a00ab070 con 0x7f0694003f00 2023-11-16T02:30:07.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06ab7fe640 1 -- 172.21.15.28:0/3440571887 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a0005e80 con 0x7f0694003f00 2023-11-16T02:30:07.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b2f1e640 1 -- 172.21.15.28:0/3440571887 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0694003f00 msgr2=0x7f06940047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:07.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b2f1e640 1 --2- 172.21.15.28:0/3440571887 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0694003f00 0x7f06940047d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f06a000c290 tx=0x7f06a001f3d0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b14bb640 1 -- 172.21.15.28:0/3440571887 reap_dead start 2023-11-16T02:30:07.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b2f1e640 1 -- 172.21.15.28:0/3440571887 shutdown_connections 2023-11-16T02:30:07.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b2f1e640 1 -- 172.21.15.28:0/3440571887 >> 172.21.15.28:0/3440571887 conn(0x7f06ac0b9050 msgr2=0x7f06ac0bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:07.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b2f1e640 1 -- 172.21.15.28:0/3440571887 shutdown_connections 2023-11-16T02:30:07.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b2f1e640 1 -- 172.21.15.28:0/3440571887 wait complete. 2023-11-16T02:30:07.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b2f1e640 1 Processor -- start 2023-11-16T02:30:07.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b2f1e640 1 -- start start 2023-11-16T02:30:07.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b2f1e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0694003f00 0x7f06ac1d37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:07.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b2f1e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06ac1d20d0 0x7f06ac1d2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:07.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b2f1e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f06ac1d44c0 0x7f06ac1d4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:07.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b2f1e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac1d5640 con 0x7f0694003f00 2023-11-16T02:30:07.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b2f1e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac1d2a90 con 0x7f06ac1d20d0 2023-11-16T02:30:07.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b2f1e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac1d4e80 con 0x7f06ac1d44c0 2023-11-16T02:30:07.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b0cba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0694003f00 0x7f06ac1d37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:07.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b0cba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0694003f00 0x7f06ac1d37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50416/0 (socket says 172.21.15.28:50416) 2023-11-16T02:30:07.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b0cba640 1 -- 172.21.15.28:0/262257785 learned_addr learned my addr 172.21.15.28:0/262257785 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:07.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b14bb640 1 --2- 172.21.15.28:0/262257785 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f06ac1d44c0 0x7f06ac1d4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:07.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06abfff640 1 --2- 172.21.15.28:0/262257785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06ac1d20d0 0x7f06ac1d2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:07.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b0cba640 1 -- 172.21.15.28:0/262257785 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f06ac1d44c0 msgr2=0x7f06ac1d4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:07.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b0cba640 1 --2- 172.21.15.28:0/262257785 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f06ac1d44c0 0x7f06ac1d4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b0cba640 1 -- 172.21.15.28:0/262257785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06ac1d20d0 msgr2=0x7f06ac1d2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:07.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b0cba640 1 --2- 172.21.15.28:0/262257785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06ac1d20d0 0x7f06ac1d2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b0cba640 1 -- 172.21.15.28:0/262257785 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac1d1130 con 0x7f0694003f00 2023-11-16T02:30:07.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06abfff640 1 --2- 172.21.15.28:0/262257785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06ac1d20d0 0x7f06ac1d2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:07.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b0cba640 1 --2- 172.21.15.28:0/262257785 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0694003f00 0x7f06ac1d37e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f069c011610 tx=0x7f069c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:07.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06a97fa640 1 -- 172.21.15.28:0/262257785 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c00f8f0 con 0x7f0694003f00 2023-11-16T02:30:07.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06a97fa640 1 -- 172.21.15.28:0/262257785 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069c00fa50 con 0x7f0694003f00 2023-11-16T02:30:07.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b2f1e640 1 -- 172.21.15.28:0/262257785 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ac1d2f20 con 0x7f0694003f00 2023-11-16T02:30:07.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06a97fa640 1 -- 172.21.15.28:0/262257785 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c00fdc0 con 0x7f0694003f00 2023-11-16T02:30:07.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.604+0000 7f06b2f1e640 1 -- 172.21.15.28:0/262257785 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ac1d3ef0 con 0x7f0694003f00 2023-11-16T02:30:07.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.608+0000 7f06b2f1e640 1 -- 172.21.15.28:0/262257785 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ac04e8a0 con 0x7f0694003f00 2023-11-16T02:30:07.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.608+0000 7f06a97fa640 1 -- 172.21.15.28:0/262257785 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f069c015460 con 0x7f0694003f00 2023-11-16T02:30:07.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.608+0000 7f06a97fa640 1 --2- 172.21.15.28:0/262257785 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0698065a60 0x7f0698067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:07.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.608+0000 7f06abfff640 1 --2- 172.21.15.28:0/262257785 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0698065a60 0x7f0698067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:07.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.608+0000 7f06a97fa640 1 -- 172.21.15.28:0/262257785 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f069c0839b0 con 0x7f0694003f00 2023-11-16T02:30:07.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.608+0000 7f06abfff640 1 --2- 172.21.15.28:0/262257785 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0698065a60 0x7f0698067f20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f06a00ae000 tx=0x7f06a0001a10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:07.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.612+0000 7f06a97fa640 1 -- 172.21.15.28:0/262257785 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f069c0514b0 con 0x7f0694003f00 2023-11-16T02:30:07.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.804+0000 7f06b2f1e640 1 -- 172.21.15.28:0/262257785 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06ac1d5780 con 0x7f0694003f00 2023-11-16T02:30:07.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.808+0000 7f06a97fa640 1 -- 172.21.15.28:0/262257785 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3883 (secure 0 0 0) 0x7f06ac1d5780 con 0x7f0694003f00 2023-11-16T02:30:07.807 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:30:07.808 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/4054669002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":4054669002},{"type":"v1","addr":"172.21.15.28:6836","nonce":4054669002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/903740631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":903740631},{"type":"v1","addr":"172.21.15.70:6833","nonce":903740631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-16T02:29:37.868031+0000","modified":"2023-11-16T02:29:40.877544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6837/1025130674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1025130674},{"type":"v1","addr":"172.21.15.28:6837","nonce":1025130674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-16T02:30:07.808 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 7 2023-11-16T02:30:07.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.808+0000 7f06b2f1e640 1 -- 172.21.15.28:0/262257785 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0698065a60 msgr2=0x7f0698067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.808+0000 7f06b2f1e640 1 --2- 172.21.15.28:0/262257785 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0698065a60 0x7f0698067f20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f06a00ae000 tx=0x7f06a0001a10 comp rx=0 tx=0).stop 2023-11-16T02:30:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.808+0000 7f06b2f1e640 1 -- 172.21.15.28:0/262257785 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0694003f00 msgr2=0x7f06ac1d37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.808+0000 7f06b2f1e640 1 --2- 172.21.15.28:0/262257785 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0694003f00 0x7f06ac1d37e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f069c011610 tx=0x7f069c011ad0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.808+0000 7f06b2f1e640 1 -- 172.21.15.28:0/262257785 shutdown_connections 2023-11-16T02:30:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.808+0000 7f06b2f1e640 1 --2- 172.21.15.28:0/262257785 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0698065a60 0x7f0698067f20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.808+0000 7f06b2f1e640 1 --2- 172.21.15.28:0/262257785 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f06ac1d44c0 0x7f06ac1d4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.808+0000 7f06b2f1e640 1 --2- 172.21.15.28:0/262257785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06ac1d20d0 0x7f06ac1d2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.808+0000 7f06b2f1e640 1 --2- 172.21.15.28:0/262257785 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0694003f00 0x7f06ac1d37e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.808+0000 7f06b2f1e640 1 -- 172.21.15.28:0/262257785 >> 172.21.15.28:0/262257785 conn(0x7f06ac0b9050 msgr2=0x7f06ac0b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:07.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.808+0000 7f06b2f1e640 1 -- 172.21.15.28:0/262257785 shutdown_connections 2023-11-16T02:30:07.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.808+0000 7f06b2f1e640 1 -- 172.21.15.28:0/262257785 wait complete. 2023-11-16T02:30:07.826 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-16T02:30:07.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.948+0000 7f0db39a2640 1 Processor -- start 2023-11-16T02:30:07.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.948+0000 7f0db39a2640 1 -- start start 2023-11-16T02:30:07.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.952+0000 7f0db39a2640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f0dac0bc900 0x7f0dac0b82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:07.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.952+0000 7f0db39a2640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0dac1416d0 0x7f0dac141b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:07.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.952+0000 7f0db39a2640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dac0712b0 con 0x7f0dac147c60 2023-11-16T02:30:07.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.952+0000 7f0db39a2640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dac071b50 con 0x7f0dac1416d0 2023-11-16T02:30:07.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.952+0000 7f0db39a2640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dac071590 con 0x7f0dac0bc900 2023-11-16T02:30:07.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.952+0000 7f0db0f3d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0dac1416d0 0x7f0dac141b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:07.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.952+0000 7f0db0f3d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0dac1416d0 0x7f0dac141b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50428/0 (socket says 172.21.15.28:50428) 2023-11-16T02:30:07.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.952+0000 7f0db0f3d640 1 -- 172.21.15.28:0/2526955021 learned_addr learned my addr 172.21.15.28:0/2526955021 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:07.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.952+0000 7f0db173e640 1 --2- 172.21.15.28:0/2526955021 >> v2:172.21.15.70:3300/0 conn(0x7f0dac0bc900 0x7f0dac0b82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:07.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.952+0000 7f0db0f3d640 1 -- 172.21.15.28:0/2526955021 >> v2:172.21.15.70:3300/0 conn(0x7f0dac0bc900 msgr2=0x7f0dac0b82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:07.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.952+0000 7f0db0f3d640 1 --2- 172.21.15.28:0/2526955021 >> v2:172.21.15.70:3300/0 conn(0x7f0dac0bc900 0x7f0dac0b82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.952+0000 7f0db0f3d640 1 -- 172.21.15.28:0/2526955021 >> v1:172.21.15.70:6789/0 conn(0x7f0dac147c60 legacy=0x7f0dac148070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:07.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.952+0000 7f0db0f3d640 1 -- 172.21.15.28:0/2526955021 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac071870 con 0x7f0dac1416d0 2023-11-16T02:30:07.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db0f3d640 1 --2- 172.21.15.28:0/2526955021 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0dac1416d0 0x7f0dac141b40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0bcff0 tx=0x7f0d9c01eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6a522fd2cd11f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:07.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0da3fff640 1 -- 172.21.15.28:0/2526955021 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c0a7a70 con 0x7f0dac1416d0 2023-11-16T02:30:07.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0da3fff640 1 -- 172.21.15.28:0/2526955021 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9c0a7bd0 con 0x7f0dac1416d0 2023-11-16T02:30:07.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0da3fff640 1 -- 172.21.15.28:0/2526955021 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c0af440 con 0x7f0dac1416d0 2023-11-16T02:30:07.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db39a2640 1 -- 172.21.15.28:0/2526955021 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0dac1416d0 msgr2=0x7f0dac141b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:07.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db39a2640 1 --2- 172.21.15.28:0/2526955021 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0dac1416d0 0x7f0dac141b40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0bcff0 tx=0x7f0d9c01eb90 comp rx=0 tx=0).stop 2023-11-16T02:30:07.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db39a2640 1 -- 172.21.15.28:0/2526955021 shutdown_connections 2023-11-16T02:30:07.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db39a2640 1 --2- 172.21.15.28:0/2526955021 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0dac1416d0 0x7f0dac141b40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db39a2640 1 --2- 172.21.15.28:0/2526955021 >> v2:172.21.15.70:3300/0 conn(0x7f0dac0bc900 0x7f0dac0b82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db39a2640 1 -- 172.21.15.28:0/2526955021 >> 172.21.15.28:0/2526955021 conn(0x7f0dac0b9050 msgr2=0x7f0dac0bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:07.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db39a2640 1 -- 172.21.15.28:0/2526955021 shutdown_connections 2023-11-16T02:30:07.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db39a2640 1 -- 172.21.15.28:0/2526955021 wait complete. 2023-11-16T02:30:07.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db39a2640 1 Processor -- start 2023-11-16T02:30:07.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db39a2640 1 -- start start 2023-11-16T02:30:07.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db39a2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0dac0bc900 0x7f0dac140410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:07.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db39a2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dac1416d0 0x7f0dac146880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:07.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db39a2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0dac147c60 0x7f0dac134810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:07.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db39a2640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac140950 con 0x7f0dac0bc900 2023-11-16T02:30:07.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db39a2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac0b2790 con 0x7f0dac1416d0 2023-11-16T02:30:07.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db39a2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac151e80 con 0x7f0dac147c60 2023-11-16T02:30:07.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db173e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0dac0bc900 0x7f0dac140410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:07.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db173e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0dac0bc900 0x7f0dac140410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50436/0 (socket says 172.21.15.28:50436) 2023-11-16T02:30:07.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db173e640 1 -- 172.21.15.28:0/604366374 learned_addr learned my addr 172.21.15.28:0/604366374 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:07.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db0f3d640 1 --2- 172.21.15.28:0/604366374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dac1416d0 0x7f0dac146880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:07.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db1f3f640 1 --2- 172.21.15.28:0/604366374 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0dac147c60 0x7f0dac134810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:07.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db173e640 1 -- 172.21.15.28:0/604366374 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0dac147c60 msgr2=0x7f0dac134810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:07.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db173e640 1 --2- 172.21.15.28:0/604366374 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0dac147c60 0x7f0dac134810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db173e640 1 -- 172.21.15.28:0/604366374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dac1416d0 msgr2=0x7f0dac146880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:07.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db173e640 1 --2- 172.21.15.28:0/604366374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dac1416d0 0x7f0dac146880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:07.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db173e640 1 -- 172.21.15.28:0/604366374 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9c00b770 con 0x7f0dac0bc900 2023-11-16T02:30:07.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.956+0000 7f0db1f3f640 1 --2- 172.21.15.28:0/604366374 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0dac147c60 0x7f0dac134810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:07.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.960+0000 7f0db173e640 1 --2- 172.21.15.28:0/604366374 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0dac0bc900 0x7f0dac140410 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0da800d830 tx=0x7f0da800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:07.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.960+0000 7f0da1ffb640 1 -- 172.21.15.28:0/604366374 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da800b660 con 0x7f0dac0bc900 2023-11-16T02:30:07.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.960+0000 7f0da1ffb640 1 -- 172.21.15.28:0/604366374 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da800b7c0 con 0x7f0dac0bc900 2023-11-16T02:30:07.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.960+0000 7f0db39a2640 1 -- 172.21.15.28:0/604366374 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dac0b5740 con 0x7f0dac0bc900 2023-11-16T02:30:07.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.960+0000 7f0da1ffb640 1 -- 172.21.15.28:0/604366374 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da800bb30 con 0x7f0dac0bc900 2023-11-16T02:30:07.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.960+0000 7f0db39a2640 1 -- 172.21.15.28:0/604366374 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dac145f60 con 0x7f0dac0bc900 2023-11-16T02:30:07.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.960+0000 7f0db39a2640 1 -- 172.21.15.28:0/604366374 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dac138bc0 con 0x7f0dac0bc900 2023-11-16T02:30:07.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.960+0000 7f0da1ffb640 1 -- 172.21.15.28:0/604366374 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0da801e460 con 0x7f0dac0bc900 2023-11-16T02:30:07.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.960+0000 7f0da1ffb640 1 --2- 172.21.15.28:0/604366374 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0d90065a60 0x7f0d90067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:07.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.960+0000 7f0da1ffb640 1 -- 172.21.15.28:0/604366374 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0da8083860 con 0x7f0dac0bc900 2023-11-16T02:30:07.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.960+0000 7f0db0f3d640 1 --2- 172.21.15.28:0/604366374 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0d90065a60 0x7f0d90067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:07.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.960+0000 7f0db0f3d640 1 --2- 172.21.15.28:0/604366374 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0d90065a60 0x7f0d90067f20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c0b1000 tx=0x7f0d9c0a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:07.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:07.964+0000 7f0da1ffb640 1 -- 172.21.15.28:0/604366374 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f0da80512b0 con 0x7f0dac0bc900 2023-11-16T02:30:08.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.120+0000 7f0db39a2640 1 -- 172.21.15.28:0/604366374 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0dac04e8a0 con 0x7f0dac0bc900 2023-11-16T02:30:08.123 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.120+0000 7f0da1ffb640 1 -- 172.21.15.28:0/604366374 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f0da80548d0 con 0x7f0dac0bc900 2023-11-16T02:30:08.123 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:30:08.123 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":22,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","created":"2023-11-16T02:29:13.710567+0000","modified":"2023-11-16T02:29:38.871066+0000","last_up_change":"2023-11-16T02:29:24.841087+0000","last_in_change":"2023-11-16T02:29:16.024490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-16T02:29:26.490910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-16T02:29:36.133224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-16T02:29:36.866156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dfa8b58d-3481-4e68-86e8-21873d31d0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":38722},{"type":"v1","addr":"172.21.15.28:6809","nonce":38722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":38722},{"type":"v1","addr":"172.21.15.28:6811","nonce":38722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":38722},{"type":"v1","addr":"172.21.15.28:6815","nonce":38722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":38722},{"type":"v1","addr":"172.21.15.28:6813","nonce":38722}]},"public_addr":"172.21.15.28:6809/38722","cluster_addr":"172.21.15.28:6811/38722","heartbeat_back_addr":"172.21.15.28:6815/38722","heartbeat_front_addr":"172.21.15.28:6813/38722","state":["exists","up"]},{"osd":1,"uuid":"1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":38724},{"type":"v1","addr":"172.21.15.28:6824","nonce":38724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":38724},{"type":"v1","addr":"172.21.15.28:6827","nonce":38724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":38724},{"type":"v1","addr":"172.21.15.28:6831","nonce":38724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":38724},{"type":"v1","addr":"172.21.15.28:6829","nonce":38724}]},"public_addr":"172.21.15.28:6824/38724","cluster_addr":"172.21.15.28:6827/38724","heartbeat_back_addr":"172.21.15.28:6831/38724","heartbeat_front_addr":"172.21.15.28:6829/38724","state":["exists","up"]},{"osd":2,"uuid":"e18f39cd-6a35-4d36-9eed-3877794bf2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":38723},{"type":"v1","addr":"172.21.15.28:6801","nonce":38723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":38723},{"type":"v1","addr":"172.21.15.28:6803","nonce":38723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":38723},{"type":"v1","addr":"172.21.15.28:6807","nonce":38723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":38723},{"type":"v1","addr":"172.21.15.28:6805","nonce":38723}]},"public_addr":"172.21.15.28:6801/38723","cluster_addr":"172.21.15.28:6803/38723","heartbeat_back_addr":"172.21.15.28:6807/38723","heartbeat_front_addr":"172.21.15.28:6805/38723","state":["exists","up"]},{"osd":3,"uuid":"303d0728-409d-47d7-b7a6-6eb273f602fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":38725},{"type":"v1","addr":"172.21.15.28:6817","nonce":38725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":38725},{"type":"v1","addr":"172.21.15.28:6819","nonce":38725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":38725},{"type":"v1","addr":"172.21.15.28:6825","nonce":38725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":38725},{"type":"v1","addr":"172.21.15.28:6821","nonce":38725}]},"public_addr":"172.21.15.28:6817/38725","cluster_addr":"172.21.15.28:6819/38725","heartbeat_back_addr":"172.21.15.28:6825/38725","heartbeat_front_addr":"172.21.15.28:6821/38725","state":["exists","up"]},{"osd":4,"uuid":"df0bf0ac-6efe-4964-ad27-7c1771a70c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":38828},{"type":"v1","addr":"172.21.15.70:6801","nonce":38828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":38828},{"type":"v1","addr":"172.21.15.70:6803","nonce":38828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":38828},{"type":"v1","addr":"172.21.15.70:6807","nonce":38828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":38828},{"type":"v1","addr":"172.21.15.70:6805","nonce":38828}]},"public_addr":"172.21.15.70:6801/38828","cluster_addr":"172.21.15.70:6803/38828","heartbeat_back_addr":"172.21.15.70:6807/38828","heartbeat_front_addr":"172.21.15.70:6805/38828","state":["exists","up"]},{"osd":5,"uuid":"84921219-65cb-4c4e-b9ed-a773db639034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":38830},{"type":"v1","addr":"172.21.15.70:6810","nonce":38830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6813","nonce":38830},{"type":"v1","addr":"172.21.15.70:6814","nonce":38830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":38830},{"type":"v1","addr":"172.21.15.70:6824","nonce":38830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":38830},{"type":"v1","addr":"172.21.15.70:6819","nonce":38830}]},"public_addr":"172.21.15.70:6810/38830","cluster_addr":"172.21.15.70:6814/38830","heartbeat_back_addr":"172.21.15.70:6824/38830","heartbeat_front_addr":"172.21.15.70:6819/38830","state":["exists","up"]},{"osd":6,"uuid":"c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":38829},{"type":"v1","addr":"172.21.15.70:6812","nonce":38829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":38829},{"type":"v1","addr":"172.21.15.70:6820","nonce":38829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":38829},{"type":"v1","addr":"172.21.15.70:6828","nonce":38829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":38829},{"type":"v1","addr":"172.21.15.70:6825","nonce":38829}]},"public_addr":"172.21.15.70:6812/38829","cluster_addr":"172.21.15.70:6820/38829","heartbeat_back_addr":"172.21.15.70:6828/38829","heartbeat_front_addr":"172.21.15.70:6825/38829","state":["exists","up"]},{"osd":7,"uuid":"e2cdd418-12ce-4eea-9b22-efdad83eb76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":38839},{"type":"v1","addr":"172.21.15.70:6815","nonce":38839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":38839},{"type":"v1","addr":"172.21.15.70:6823","nonce":38839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":38839},{"type":"v1","addr":"172.21.15.70:6831","nonce":38839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6827","nonce":38839},{"type":"v1","addr":"172.21.15.70:6829","nonce":38839}]},"public_addr":"172.21.15.70:6815/38839","cluster_addr":"172.21.15.70:6823/38839","heartbeat_back_addr":"172.21.15.70:6831/38839","heartbeat_front_addr":"172.21.15.70:6829/38839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.544240+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.637637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.352115+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.652916+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.624477+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.570247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.706468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.696574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-16T02:30:08.125 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.124+0000 7f0db39a2640 1 -- 172.21.15.28:0/604366374 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0d90065a60 msgr2=0x7f0d90067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:08.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.124+0000 7f0db39a2640 1 --2- 172.21.15.28:0/604366374 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0d90065a60 0x7f0d90067f20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c0b1000 tx=0x7f0d9c0a9070 comp rx=0 tx=0).stop 2023-11-16T02:30:08.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.124+0000 7f0db39a2640 1 -- 172.21.15.28:0/604366374 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0dac0bc900 msgr2=0x7f0dac140410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:08.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.124+0000 7f0db39a2640 1 --2- 172.21.15.28:0/604366374 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0dac0bc900 0x7f0dac140410 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0da800d830 tx=0x7f0da800dcf0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.124+0000 7f0db39a2640 1 -- 172.21.15.28:0/604366374 shutdown_connections 2023-11-16T02:30:08.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.124+0000 7f0db39a2640 1 --2- 172.21.15.28:0/604366374 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0d90065a60 0x7f0d90067f20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.124+0000 7f0db39a2640 1 --2- 172.21.15.28:0/604366374 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f0dac147c60 0x7f0dac134810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.124+0000 7f0db39a2640 1 --2- 172.21.15.28:0/604366374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dac1416d0 0x7f0dac146880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.124+0000 7f0db39a2640 1 --2- 172.21.15.28:0/604366374 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0dac0bc900 0x7f0dac140410 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.124+0000 7f0db39a2640 1 -- 172.21.15.28:0/604366374 >> 172.21.15.28:0/604366374 conn(0x7f0dac0b9050 msgr2=0x7f0dac06edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:08.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.124+0000 7f0db39a2640 1 -- 172.21.15.28:0/604366374 shutdown_connections 2023-11-16T02:30:08.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.124+0000 7f0db39a2640 1 -- 172.21.15.28:0/604366374 wait complete. 2023-11-16T02:30:08.141 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-16T02:30:08.142 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-16T02:30:08.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe15632a640 1 Processor -- start 2023-11-16T02:30:08.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe15632a640 1 -- start start 2023-11-16T02:30:08.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe15632a640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe1500b8ab0 0x7fe15014b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:08.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe15632a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe15014b540 0x7fe1501553f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:08.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe15632a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15006c260 con 0x7fe1500b86d0 2023-11-16T02:30:08.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe15632a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1500b8f10 con 0x7fe15014b540 2023-11-16T02:30:08.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe15632a640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1500ba470 con 0x7fe1500b8ab0 2023-11-16T02:30:08.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14ffff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe1500b86d0 0x7fe1501446a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37308/0 (socket says 172.21.15.28:37308) 2023-11-16T02:30:08.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14ffff640 1 -- 172.21.15.28:0/1001055299 learned_addr learned my addr 172.21.15.28:0/1001055299 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:08.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe1548c7640 1 --2- 172.21.15.28:0/1001055299 >> v2:172.21.15.70:3300/0 conn(0x7fe15014b540 0x7fe1501553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:08.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14f7fe640 1 --2- 172.21.15.28:0/1001055299 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe1500b8ab0 0x7fe15014b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:08.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14effd640 1 -- 172.21.15.28:0/1001055299 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135612057 0 0) 0x7fe15006c260 con 0x7fe1500b86d0 2023-11-16T02:30:08.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14effd640 1 -- 172.21.15.28:0/1001055299 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe13c003530 con 0x7fe1500b86d0 2023-11-16T02:30:08.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14effd640 1 -- 172.21.15.28:0/1001055299 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3348410109 0 0) 0x7fe13c003530 con 0x7fe1500b86d0 2023-11-16T02:30:08.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14effd640 1 -- 172.21.15.28:0/1001055299 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe1500b8ab0 msgr2=0x7fe15014b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:08.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14effd640 1 --2- 172.21.15.28:0/1001055299 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe1500b8ab0 0x7fe15014b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14effd640 1 -- 172.21.15.28:0/1001055299 >> v2:172.21.15.70:3300/0 conn(0x7fe15014b540 msgr2=0x7fe1501553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:08.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14effd640 1 --2- 172.21.15.28:0/1001055299 >> v2:172.21.15.70:3300/0 conn(0x7fe15014b540 0x7fe1501553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14effd640 1 -- 172.21.15.28:0/1001055299 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15014b9b0 con 0x7fe1500b86d0 2023-11-16T02:30:08.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14effd640 1 -- 172.21.15.28:0/1001055299 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7fe138001680 con 0x7fe1500b86d0 2023-11-16T02:30:08.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14effd640 1 -- 172.21.15.28:0/1001055299 >> v1:172.21.15.28:6789/0 conn(0x7fe1500b86d0 legacy=0x7fe1501446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:08.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14effd640 1 --2- 172.21.15.28:0/1001055299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe13c003980 0x7fe13c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:08.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14effd640 1 --2- 172.21.15.28:0/1001055299 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe13c0047d0 0x7fe13c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:08.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14effd640 1 --2- 172.21.15.28:0/1001055299 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe1500b8ab0 0x7fe13c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:08.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14effd640 1 -- 172.21.15.28:0/1001055299 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1500b8f10 con 0x7fe13c0047d0 2023-11-16T02:30:08.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14effd640 1 -- 172.21.15.28:0/1001055299 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1500ba470 con 0x7fe13c003980 2023-11-16T02:30:08.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14effd640 1 -- 172.21.15.28:0/1001055299 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c00b990 con 0x7fe1500b8ab0 2023-11-16T02:30:08.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14f7fe640 1 --2- 172.21.15.28:0/1001055299 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe13c0047d0 0x7fe13c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:08.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14ffff640 1 --2- 172.21.15.28:0/1001055299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe13c003980 0x7fe13c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:08.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe1548c7640 1 --2- 172.21.15.28:0/1001055299 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe1500b8ab0 0x7fe13c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:08.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14f7fe640 1 -- 172.21.15.28:0/1001055299 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe1500b8ab0 msgr2=0x7fe13c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:08.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14f7fe640 1 --2- 172.21.15.28:0/1001055299 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe1500b8ab0 0x7fe13c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14f7fe640 1 -- 172.21.15.28:0/1001055299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe13c003980 msgr2=0x7fe13c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:08.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14f7fe640 1 --2- 172.21.15.28:0/1001055299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe13c003980 0x7fe13c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14f7fe640 1 -- 172.21.15.28:0/1001055299 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c003530 con 0x7fe13c0047d0 2023-11-16T02:30:08.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.264+0000 7fe14ffff640 1 --2- 172.21.15.28:0/1001055299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe13c003980 0x7fe13c003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:30:08.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.268+0000 7fe14f7fe640 1 --2- 172.21.15.28:0/1001055299 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe13c0047d0 0x7fe13c004c50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe140009ae0 tx=0x7fe14001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d5483b6ba0cbd6 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:08.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.268+0000 7fe14effd640 1 -- 172.21.15.28:0/1001055299 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1400a5560 con 0x7fe13c0047d0 2023-11-16T02:30:08.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.268+0000 7fe14effd640 1 -- 172.21.15.28:0/1001055299 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1400a56c0 con 0x7fe13c0047d0 2023-11-16T02:30:08.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.268+0000 7fe14effd640 1 -- 172.21.15.28:0/1001055299 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1400a5a70 con 0x7fe13c0047d0 2023-11-16T02:30:08.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.268+0000 7fe15632a640 1 -- 172.21.15.28:0/1001055299 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe13c0047d0 msgr2=0x7fe13c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:08.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.268+0000 7fe15632a640 1 --2- 172.21.15.28:0/1001055299 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe13c0047d0 0x7fe13c004c50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe140009ae0 tx=0x7fe14001ca50 comp rx=0 tx=0).stop 2023-11-16T02:30:08.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.268+0000 7fe1548c7640 1 -- 172.21.15.28:0/1001055299 reap_dead start 2023-11-16T02:30:08.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.268+0000 7fe15632a640 1 -- 172.21.15.28:0/1001055299 shutdown_connections 2023-11-16T02:30:08.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.268+0000 7fe15632a640 1 -- 172.21.15.28:0/1001055299 >> 172.21.15.28:0/1001055299 conn(0x7fe15006b770 msgr2=0x7fe15006bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:08.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.268+0000 7fe15632a640 1 -- 172.21.15.28:0/1001055299 shutdown_connections 2023-11-16T02:30:08.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.268+0000 7fe15632a640 1 -- 172.21.15.28:0/1001055299 wait complete. 2023-11-16T02:30:08.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe15632a640 1 Processor -- start 2023-11-16T02:30:08.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe15632a640 1 -- start start 2023-11-16T02:30:08.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe15632a640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe150138ea0 0x7fe1501e3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:08.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe15632a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1501e39a0 0x7fe150136ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:08.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe15632a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1501371e0 0x7fe150143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:08.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe15632a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15013fc70 con 0x7fe1501e39a0 2023-11-16T02:30:08.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe15632a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15013ff50 con 0x7fe1501371e0 2023-11-16T02:30:08.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe15632a640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1501e2f40 con 0x7fe150138ea0 2023-11-16T02:30:08.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe14f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1501e39a0 0x7fe150136ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:08.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe14f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1501e39a0 0x7fe150136ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50448/0 (socket says 172.21.15.28:50448) 2023-11-16T02:30:08.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe14f7fe640 1 -- 172.21.15.28:0/3154920535 learned_addr learned my addr 172.21.15.28:0/3154920535 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:08.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe14ffff640 1 --2- 172.21.15.28:0/3154920535 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe150138ea0 0x7fe1501e3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:08.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe1548c7640 1 --2- 172.21.15.28:0/3154920535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1501371e0 0x7fe150143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:08.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe14f7fe640 1 -- 172.21.15.28:0/3154920535 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe150138ea0 msgr2=0x7fe1501e3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:08.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe14f7fe640 1 --2- 172.21.15.28:0/3154920535 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe150138ea0 0x7fe1501e3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe14f7fe640 1 -- 172.21.15.28:0/3154920535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1501371e0 msgr2=0x7fe150143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:08.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe14f7fe640 1 --2- 172.21.15.28:0/3154920535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1501371e0 0x7fe150143110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe14f7fe640 1 -- 172.21.15.28:0/3154920535 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15014cb60 con 0x7fe1501e39a0 2023-11-16T02:30:08.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe14f7fe640 1 --2- 172.21.15.28:0/3154920535 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1501e39a0 0x7fe150136ca0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe140009ae0 tx=0x7fe1400197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:08.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe14cff9640 1 -- 172.21.15.28:0/3154920535 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe140004220 con 0x7fe1501e39a0 2023-11-16T02:30:08.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe14cff9640 1 -- 172.21.15.28:0/3154920535 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe140004380 con 0x7fe1501e39a0 2023-11-16T02:30:08.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe15632a640 1 -- 172.21.15.28:0/3154920535 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe150140230 con 0x7fe1501e39a0 2023-11-16T02:30:08.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe14cff9640 1 -- 172.21.15.28:0/3154920535 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe140003860 con 0x7fe1501e39a0 2023-11-16T02:30:08.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe15632a640 1 -- 172.21.15.28:0/3154920535 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe15014bc30 con 0x7fe1501e39a0 2023-11-16T02:30:08.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe15632a640 1 -- 172.21.15.28:0/3154920535 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1501e3100 con 0x7fe1501e39a0 2023-11-16T02:30:08.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe14cff9640 1 -- 172.21.15.28:0/3154920535 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe1400b4040 con 0x7fe1501e39a0 2023-11-16T02:30:08.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe14cff9640 1 --2- 172.21.15.28:0/3154920535 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe130065a90 0x7fe130067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:08.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe14cff9640 1 -- 172.21.15.28:0/3154920535 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe14011cb00 con 0x7fe1501e39a0 2023-11-16T02:30:08.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.272+0000 7fe14ffff640 1 --2- 172.21.15.28:0/3154920535 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe130065a90 0x7fe130067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:08.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.276+0000 7fe14ffff640 1 --2- 172.21.15.28:0/3154920535 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe130065a90 0x7fe130067f50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe138000fc0 tx=0x7fe138009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:08.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.276+0000 7fe14cff9640 1 -- 172.21.15.28:0/3154920535 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fe1400ea4c0 con 0x7fe1501e39a0 2023-11-16T02:30:08.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.468+0000 7fe15632a640 1 -- 172.21.15.28:0/3154920535 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1501375c0 con 0x7fe1501e39a0 2023-11-16T02:30:08.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.468+0000 7fe14cff9640 1 -- 172.21.15.28:0/3154920535 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3883 (secure 0 0 0) 0x7fe1501375c0 con 0x7fe1501e39a0 2023-11-16T02:30:08.471 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:30:08.471 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/4054669002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":4054669002},{"type":"v1","addr":"172.21.15.28:6836","nonce":4054669002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/903740631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":903740631},{"type":"v1","addr":"172.21.15.70:6833","nonce":903740631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-16T02:29:37.868031+0000","modified":"2023-11-16T02:29:40.877544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6837/1025130674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1025130674},{"type":"v1","addr":"172.21.15.28:6837","nonce":1025130674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-16T02:30:08.471 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 7 2023-11-16T02:30:08.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.472+0000 7fe15632a640 1 -- 172.21.15.28:0/3154920535 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe130065a90 msgr2=0x7fe130067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:08.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.472+0000 7fe15632a640 1 --2- 172.21.15.28:0/3154920535 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe130065a90 0x7fe130067f50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe138000fc0 tx=0x7fe138009040 comp rx=0 tx=0).stop 2023-11-16T02:30:08.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.472+0000 7fe15632a640 1 -- 172.21.15.28:0/3154920535 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1501e39a0 msgr2=0x7fe150136ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:08.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.472+0000 7fe15632a640 1 --2- 172.21.15.28:0/3154920535 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1501e39a0 0x7fe150136ca0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe140009ae0 tx=0x7fe1400197f0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.472+0000 7fe15632a640 1 -- 172.21.15.28:0/3154920535 shutdown_connections 2023-11-16T02:30:08.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.472+0000 7fe15632a640 1 --2- 172.21.15.28:0/3154920535 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe130065a90 0x7fe130067f50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.472+0000 7fe15632a640 1 --2- 172.21.15.28:0/3154920535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1501371e0 0x7fe150143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.472+0000 7fe15632a640 1 --2- 172.21.15.28:0/3154920535 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1501e39a0 0x7fe150136ca0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.472+0000 7fe15632a640 1 --2- 172.21.15.28:0/3154920535 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe150138ea0 0x7fe1501e3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.473 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.472+0000 7fe15632a640 1 -- 172.21.15.28:0/3154920535 >> 172.21.15.28:0/3154920535 conn(0x7fe15006b770 msgr2=0x7fe1500b7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:08.474 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.472+0000 7fe15632a640 1 -- 172.21.15.28:0/3154920535 shutdown_connections 2023-11-16T02:30:08.474 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.472+0000 7fe15632a640 1 -- 172.21.15.28:0/3154920535 wait complete. 2023-11-16T02:30:08.489 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-16T02:30:08.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.604+0000 7f8899b27640 1 Processor -- start 2023-11-16T02:30:08.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.604+0000 7f8899b27640 1 -- start start 2023-11-16T02:30:08.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.604+0000 7f8899b27640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f88940b2180 0x7f88941418d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:08.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.604+0000 7f8899b27640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f889406d790 con 0x7f8894141e10 2023-11-16T02:30:08.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.604+0000 7f8899b27640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f889406cbf0 con 0x7f88940b8c90 2023-11-16T02:30:08.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.604+0000 7f8899b27640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8894148840 con 0x7f88940b2180 2023-11-16T02:30:08.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.604+0000 7f8893fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f8894141e10 0x7f8894147910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:37322/0 (socket says 172.21.15.28:37322) 2023-11-16T02:30:08.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.604+0000 7f8893fff640 1 -- 172.21.15.28:0/1857339501 learned_addr learned my addr 172.21.15.28:0/1857339501 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:08.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.604+0000 7f8892ffd640 1 --2- 172.21.15.28:0/1857339501 >> v2:172.21.15.70:3300/0 conn(0x7f88940b2180 0x7f88941418d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:08.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.604+0000 7f88927fc640 1 -- 172.21.15.28:0/1857339501 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655179330 0 0) 0x7f888c0014f0 con 0x7f8894141e10 2023-11-16T02:30:08.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.604+0000 7f88927fc640 1 -- 172.21.15.28:0/1857339501 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f887c003530 con 0x7f8894141e10 2023-11-16T02:30:08.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.604+0000 7f88927fc640 1 -- 172.21.15.28:0/1857339501 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1347462704 0 0) 0x7f887c003530 con 0x7f8894141e10 2023-11-16T02:30:08.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.604+0000 7f88927fc640 1 -- 172.21.15.28:0/1857339501 >> v2:172.21.15.70:3300/0 conn(0x7f88940b2180 msgr2=0x7f88941418d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:08.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.604+0000 7f88927fc640 1 --2- 172.21.15.28:0/1857339501 >> v2:172.21.15.70:3300/0 conn(0x7f88940b2180 0x7f88941418d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.604+0000 7f88927fc640 1 -- 172.21.15.28:0/1857339501 >> v1:172.21.15.70:6789/0 conn(0x7f88940b8c90 legacy=0x7f889406d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:08.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.604+0000 7f88927fc640 1 -- 172.21.15.28:0/1857339501 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8894148560 con 0x7f8894141e10 2023-11-16T02:30:08.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f88927fc640 1 -- 172.21.15.28:0/1857339501 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7f888c001be0 con 0x7f8894141e10 2023-11-16T02:30:08.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f88927fc640 1 -- 172.21.15.28:0/1857339501 >> v1:172.21.15.28:6789/0 conn(0x7f8894141e10 legacy=0x7f8894147910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:08.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f88927fc640 1 --2- 172.21.15.28:0/1857339501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f887c003980 0x7f887c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:08.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f88927fc640 1 --2- 172.21.15.28:0/1857339501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f887c0047d0 0x7f887c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:08.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f88927fc640 1 --2- 172.21.15.28:0/1857339501 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f887c005190 0x7f887c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:08.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f88927fc640 1 -- 172.21.15.28:0/1857339501 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8894148840 con 0x7f887c0047d0 2023-11-16T02:30:08.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f88927fc640 1 -- 172.21.15.28:0/1857339501 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c00c030 con 0x7f887c003980 2023-11-16T02:30:08.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f88927fc640 1 -- 172.21.15.28:0/1857339501 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887c00c1f0 con 0x7f887c005190 2023-11-16T02:30:08.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f8892ffd640 1 --2- 172.21.15.28:0/1857339501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f887c0047d0 0x7f887c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:08.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f88937fe640 1 --2- 172.21.15.28:0/1857339501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f887c003980 0x7f887c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:08.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f8892ffd640 1 -- 172.21.15.28:0/1857339501 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f887c005190 msgr2=0x7f887c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:08.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f8892ffd640 1 --2- 172.21.15.28:0/1857339501 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f887c005190 0x7f887c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f8892ffd640 1 -- 172.21.15.28:0/1857339501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f887c003980 msgr2=0x7f887c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:08.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f8892ffd640 1 --2- 172.21.15.28:0/1857339501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f887c003980 0x7f887c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f8892ffd640 1 -- 172.21.15.28:0/1857339501 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887c003530 con 0x7f887c0047d0 2023-11-16T02:30:08.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f8893fff640 1 -- 172.21.15.28:0/1857339501 reap_dead start 2023-11-16T02:30:08.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f8892ffd640 1 --2- 172.21.15.28:0/1857339501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f887c0047d0 0x7f887c004c50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f888800bd80 tx=0x7f888801f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b357fe8adeb37a55 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:08.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f88927fc640 1 -- 172.21.15.28:0/1857339501 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88880ae5f0 con 0x7f887c0047d0 2023-11-16T02:30:08.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f88927fc640 1 -- 172.21.15.28:0/1857339501 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88880ae750 con 0x7f887c0047d0 2023-11-16T02:30:08.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f88927fc640 1 -- 172.21.15.28:0/1857339501 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88880aeb00 con 0x7f887c0047d0 2023-11-16T02:30:08.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f8899b27640 1 -- 172.21.15.28:0/1857339501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f887c0047d0 msgr2=0x7f887c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:08.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f8899b27640 1 --2- 172.21.15.28:0/1857339501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f887c0047d0 0x7f887c004c50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f888800bd80 tx=0x7f888801f3a0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f8899b27640 1 -- 172.21.15.28:0/1857339501 shutdown_connections 2023-11-16T02:30:08.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f8899b27640 1 --2- 172.21.15.28:0/1857339501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f887c0047d0 0x7f887c004c50 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f8899b27640 1 -- 172.21.15.28:0/1857339501 >> 172.21.15.28:0/1857339501 conn(0x7f88940b9b20 msgr2=0x7f88940b9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:08.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f8899b27640 1 -- 172.21.15.28:0/1857339501 shutdown_connections 2023-11-16T02:30:08.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.608+0000 7f8899b27640 1 -- 172.21.15.28:0/1857339501 wait complete. 2023-11-16T02:30:08.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f8899b27640 1 Processor -- start 2023-11-16T02:30:08.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f8899b27640 1 -- start start 2023-11-16T02:30:08.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f8899b27640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f887c0047d0 0x7f8894140e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:08.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f8899b27640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88941401b0 0x7f88940a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:08.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f8899b27640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88940a0f70 0x7f88941d1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:08.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f8899b27640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88941413c0 con 0x7f88941401b0 2023-11-16T02:30:08.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f8899b27640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88940a2440 con 0x7f88940a0f70 2023-11-16T02:30:08.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f8899b27640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88940a13f0 con 0x7f887c0047d0 2023-11-16T02:30:08.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f8892ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88941401b0 0x7f88940a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:08.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f8892ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88941401b0 0x7f88940a0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50462/0 (socket says 172.21.15.28:50462) 2023-11-16T02:30:08.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f8892ffd640 1 -- 172.21.15.28:0/3317938055 learned_addr learned my addr 172.21.15.28:0/3317938055 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:08.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f88937fe640 1 --2- 172.21.15.28:0/3317938055 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f887c0047d0 0x7f8894140e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:08.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f8893fff640 1 --2- 172.21.15.28:0/3317938055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88940a0f70 0x7f88941d1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:08.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f8892ffd640 1 -- 172.21.15.28:0/3317938055 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f887c0047d0 msgr2=0x7f8894140e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:08.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f8892ffd640 1 --2- 172.21.15.28:0/3317938055 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f887c0047d0 0x7f8894140e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f8892ffd640 1 -- 172.21.15.28:0/3317938055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88940a0f70 msgr2=0x7f88941d1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:08.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f8892ffd640 1 --2- 172.21.15.28:0/3317938055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88940a0f70 0x7f88941d1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f8892ffd640 1 -- 172.21.15.28:0/3317938055 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88940bce50 con 0x7f88941401b0 2023-11-16T02:30:08.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f8892ffd640 1 --2- 172.21.15.28:0/3317938055 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88941401b0 0x7f88940a0a30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f88880b0040 tx=0x7f887c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:08.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f887bfff640 1 -- 172.21.15.28:0/3317938055 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88880ae5b0 con 0x7f88941401b0 2023-11-16T02:30:08.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f887bfff640 1 -- 172.21.15.28:0/3317938055 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88880aead0 con 0x7f88941401b0 2023-11-16T02:30:08.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f8899b27640 1 -- 172.21.15.28:0/3317938055 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88940a21a0 con 0x7f88941401b0 2023-11-16T02:30:08.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f887bfff640 1 -- 172.21.15.28:0/3317938055 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88880aee40 con 0x7f88941401b0 2023-11-16T02:30:08.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f8899b27640 1 -- 172.21.15.28:0/3317938055 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88940bcae0 con 0x7f88941401b0 2023-11-16T02:30:08.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f8899b27640 1 -- 172.21.15.28:0/3317938055 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8894066f00 con 0x7f88941401b0 2023-11-16T02:30:08.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f887bfff640 1 -- 172.21.15.28:0/3317938055 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8888005fa0 con 0x7f88941401b0 2023-11-16T02:30:08.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f887bfff640 1 --2- 172.21.15.28:0/3317938055 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8880065a90 0x7f8880067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:08.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f887bfff640 1 -- 172.21.15.28:0/3317938055 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88880ab050 con 0x7f88941401b0 2023-11-16T02:30:08.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.612+0000 7f88937fe640 1 --2- 172.21.15.28:0/3317938055 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8880065a90 0x7f8880067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:08.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.616+0000 7f88937fe640 1 --2- 172.21.15.28:0/3317938055 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8880065a90 0x7f8880067f50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8884000c10 tx=0x7f8884009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:08.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.620+0000 7f887bfff640 1 -- 172.21.15.28:0/3317938055 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f88880ef900 con 0x7f88941401b0 2023-11-16T02:30:08.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.804+0000 7f8899b27640 1 -- 172.21.15.28:0/3317938055 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88940bc660 con 0x7f88941401b0 2023-11-16T02:30:08.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.804+0000 7f887bfff640 1 -- 172.21.15.28:0/3317938055 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3883 (secure 0 0 0) 0x7f88940bc660 con 0x7f88941401b0 2023-11-16T02:30:08.806 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:30:08.807 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/4054669002","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":4054669002},{"type":"v1","addr":"172.21.15.28:6836","nonce":4054669002}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/903740631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":903740631},{"type":"v1","addr":"172.21.15.70:6833","nonce":903740631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-16T02:29:37.868031+0000","modified":"2023-11-16T02:29:40.877544+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6837/1025130674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":1025130674},{"type":"v1","addr":"172.21.15.28:6837","nonce":1025130674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-16T02:30:08.807 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 7 2023-11-16T02:30:08.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.808+0000 7f8899b27640 1 -- 172.21.15.28:0/3317938055 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8880065a90 msgr2=0x7f8880067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:08.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.808+0000 7f8899b27640 1 --2- 172.21.15.28:0/3317938055 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8880065a90 0x7f8880067f50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8884000c10 tx=0x7f8884009040 comp rx=0 tx=0).stop 2023-11-16T02:30:08.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.808+0000 7f8899b27640 1 -- 172.21.15.28:0/3317938055 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88941401b0 msgr2=0x7f88940a0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:08.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.808+0000 7f8899b27640 1 --2- 172.21.15.28:0/3317938055 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88941401b0 0x7f88940a0a30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f88880b0040 tx=0x7f887c005800 comp rx=0 tx=0).stop 2023-11-16T02:30:08.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.808+0000 7f8899b27640 1 -- 172.21.15.28:0/3317938055 shutdown_connections 2023-11-16T02:30:08.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.808+0000 7f8899b27640 1 --2- 172.21.15.28:0/3317938055 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8880065a90 0x7f8880067f50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.808+0000 7f8899b27640 1 --2- 172.21.15.28:0/3317938055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88940a0f70 0x7f88941d1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.808+0000 7f8899b27640 1 --2- 172.21.15.28:0/3317938055 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f88941401b0 0x7f88940a0a30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.808+0000 7f8899b27640 1 --2- 172.21.15.28:0/3317938055 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f887c0047d0 0x7f8894140e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.808+0000 7f8899b27640 1 -- 172.21.15.28:0/3317938055 >> 172.21.15.28:0/3317938055 conn(0x7f88940b9b20 msgr2=0x7f8894069d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:08.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.808+0000 7f8899b27640 1 -- 172.21.15.28:0/3317938055 shutdown_connections 2023-11-16T02:30:08.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.808+0000 7f8899b27640 1 -- 172.21.15.28:0/3317938055 wait complete. 2023-11-16T02:30:08.824 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-16T02:30:08.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.936+0000 7fe0a344c640 1 Processor -- start 2023-11-16T02:30:08.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.936+0000 7fe0a344c640 1 -- start start 2023-11-16T02:30:08.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.936+0000 7fe0a344c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe09c148960 0x7fe09c0b3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:08.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.936+0000 7fe0a344c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe09c148df0 0x7fe09c0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:08.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.936+0000 7fe0a344c640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe09c0b52b0 con 0x7fe09c0b8240 2023-11-16T02:30:08.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.936+0000 7fe0a344c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09c0bcdb0 con 0x7fe09c148960 2023-11-16T02:30:08.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.936+0000 7fe0a344c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09c0b6220 con 0x7fe09c148df0 2023-11-16T02:30:08.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.936+0000 7fe0a09e7640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe09c148960 0x7fe09c0b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:08.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.936+0000 7fe0a09e7640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe09c148960 0x7fe09c0b3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50476/0 (socket says 172.21.15.28:50476) 2023-11-16T02:30:08.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.936+0000 7fe0a09e7640 1 -- 172.21.15.28:0/3219974243 learned_addr learned my addr 172.21.15.28:0/3219974243 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:08.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.936+0000 7fe0a19e9640 1 --2- 172.21.15.28:0/3219974243 >> v2:172.21.15.70:3300/0 conn(0x7fe09c148df0 0x7fe09c0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:08.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.936+0000 7fe0a09e7640 1 -- 172.21.15.28:0/3219974243 >> v2:172.21.15.70:3300/0 conn(0x7fe09c148df0 msgr2=0x7fe09c0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:08.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.936+0000 7fe0a09e7640 1 --2- 172.21.15.28:0/3219974243 >> v2:172.21.15.70:3300/0 conn(0x7fe09c148df0 0x7fe09c0b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.936+0000 7fe0a09e7640 1 -- 172.21.15.28:0/3219974243 >> v1:172.21.15.28:6789/0 conn(0x7fe09c0b8240 legacy=0x7fe09c0bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:08.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.936+0000 7fe0a09e7640 1 -- 172.21.15.28:0/3219974243 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c0b4040 con 0x7fe09c148960 2023-11-16T02:30:08.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.936+0000 7fe0a19e9640 1 --2- 172.21.15.28:0/3219974243 >> v2:172.21.15.70:3300/0 conn(0x7fe09c148df0 0x7fe09c0b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:08.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.940+0000 7fe0a09e7640 1 --2- 172.21.15.28:0/3219974243 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe09c148960 0x7fe09c0b3450 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe09c1464f0 tx=0x7fe09801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa64b407e9486bb server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:08.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.940+0000 7fe093fff640 1 -- 172.21.15.28:0/3219974243 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0980aa430 con 0x7fe09c148960 2023-11-16T02:30:08.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.940+0000 7fe093fff640 1 -- 172.21.15.28:0/3219974243 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0980aa590 con 0x7fe09c148960 2023-11-16T02:30:08.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.940+0000 7fe093fff640 1 -- 172.21.15.28:0/3219974243 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0980aa920 con 0x7fe09c148960 2023-11-16T02:30:08.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.940+0000 7fe0a344c640 1 -- 172.21.15.28:0/3219974243 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe09c148960 msgr2=0x7fe09c0b3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:08.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.940+0000 7fe0a344c640 1 --2- 172.21.15.28:0/3219974243 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe09c148960 0x7fe09c0b3450 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe09c1464f0 tx=0x7fe09801c4d0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.940+0000 7fe0a344c640 1 -- 172.21.15.28:0/3219974243 shutdown_connections 2023-11-16T02:30:08.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.940+0000 7fe0a344c640 1 --2- 172.21.15.28:0/3219974243 >> v2:172.21.15.70:3300/0 conn(0x7fe09c148df0 0x7fe09c0b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.940+0000 7fe0a344c640 1 --2- 172.21.15.28:0/3219974243 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe09c148960 0x7fe09c0b3450 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.940+0000 7fe0a344c640 1 -- 172.21.15.28:0/3219974243 >> 172.21.15.28:0/3219974243 conn(0x7fe09c0b9050 msgr2=0x7fe09c0bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:08.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.940+0000 7fe0a344c640 1 -- 172.21.15.28:0/3219974243 shutdown_connections 2023-11-16T02:30:08.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.940+0000 7fe0a344c640 1 -- 172.21.15.28:0/3219974243 wait complete. 2023-11-16T02:30:08.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.940+0000 7fe0a344c640 1 Processor -- start 2023-11-16T02:30:08.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.940+0000 7fe0a344c640 1 -- start start 2023-11-16T02:30:08.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.940+0000 7fe0a344c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe09c0b8240 0x7fe09c1381c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:08.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.940+0000 7fe0a344c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe09c148960 0x7fe09c0706c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:08.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.940+0000 7fe0a344c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe09c148df0 0x7fe09c13cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:08.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.940+0000 7fe0a344c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c138700 con 0x7fe09c148df0 2023-11-16T02:30:08.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.940+0000 7fe0a344c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c13dd50 con 0x7fe09c148960 2023-11-16T02:30:08.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.940+0000 7fe0a344c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c070c00 con 0x7fe09c0b8240 2023-11-16T02:30:08.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.944+0000 7fe0a19e9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe09c148df0 0x7fe09c13cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:08.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.944+0000 7fe0a19e9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe09c148df0 0x7fe09c13cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50488/0 (socket says 172.21.15.28:50488) 2023-11-16T02:30:08.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.944+0000 7fe0a19e9640 1 -- 172.21.15.28:0/3832930702 learned_addr learned my addr 172.21.15.28:0/3832930702 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:08.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.944+0000 7fe0a11e8640 1 --2- 172.21.15.28:0/3832930702 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe09c0b8240 0x7fe09c1381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:08.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.944+0000 7fe0a09e7640 1 --2- 172.21.15.28:0/3832930702 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe09c148960 0x7fe09c0706c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:08.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.944+0000 7fe0a19e9640 1 -- 172.21.15.28:0/3832930702 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe09c0b8240 msgr2=0x7fe09c1381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:08.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.944+0000 7fe0a19e9640 1 --2- 172.21.15.28:0/3832930702 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe09c0b8240 0x7fe09c1381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.944+0000 7fe0a19e9640 1 -- 172.21.15.28:0/3832930702 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe09c148960 msgr2=0x7fe09c0706c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:08.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.944+0000 7fe0a19e9640 1 --2- 172.21.15.28:0/3832930702 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe09c148960 0x7fe09c0706c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:08.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.944+0000 7fe0a19e9640 1 -- 172.21.15.28:0/3832930702 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0980094d0 con 0x7fe09c148df0 2023-11-16T02:30:08.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.944+0000 7fe0a09e7640 1 --2- 172.21.15.28:0/3832930702 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe09c148960 0x7fe09c0706c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:08.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.944+0000 7fe0a19e9640 1 --2- 172.21.15.28:0/3832930702 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe09c148df0 0x7fe09c13cc20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe09400cd50 tx=0x7fe09400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:08.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.944+0000 7fe091ffb640 1 -- 172.21.15.28:0/3832930702 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09400f680 con 0x7fe09c148df0 2023-11-16T02:30:08.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.944+0000 7fe091ffb640 1 -- 172.21.15.28:0/3832930702 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09400f800 con 0x7fe09c148df0 2023-11-16T02:30:08.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.944+0000 7fe0a344c640 1 -- 172.21.15.28:0/3832930702 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09c13dff0 con 0x7fe09c148df0 2023-11-16T02:30:08.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.944+0000 7fe091ffb640 1 -- 172.21.15.28:0/3832930702 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09400fbb0 con 0x7fe09c148df0 2023-11-16T02:30:08.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.944+0000 7fe0a344c640 1 -- 172.21.15.28:0/3832930702 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09c13fb30 con 0x7fe09c148df0 2023-11-16T02:30:08.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.944+0000 7fe0a344c640 1 -- 172.21.15.28:0/3832930702 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe09c04e8a0 con 0x7fe09c148df0 2023-11-16T02:30:08.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.944+0000 7fe091ffb640 1 -- 172.21.15.28:0/3832930702 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe09400b040 con 0x7fe09c148df0 2023-11-16T02:30:08.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.944+0000 7fe091ffb640 1 --2- 172.21.15.28:0/3832930702 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe080065a60 0x7fe080067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:08.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.944+0000 7fe091ffb640 1 -- 172.21.15.28:0/3832930702 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe094083b20 con 0x7fe09c148df0 2023-11-16T02:30:08.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.944+0000 7fe0a11e8640 1 --2- 172.21.15.28:0/3832930702 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe080065a60 0x7fe080067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:08.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.944+0000 7fe0a11e8640 1 --2- 172.21.15.28:0/3832930702 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe080065a60 0x7fe080067f20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe08c000f70 tx=0x7fe08c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:08.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:08.948+0000 7fe091ffb640 1 -- 172.21.15.28:0/3832930702 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fe094051570 con 0x7fe09c148df0 2023-11-16T02:30:09.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.104+0000 7fe0a344c640 1 -- 172.21.15.28:0/3832930702 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe09c0b6420 con 0x7fe09c148df0 2023-11-16T02:30:09.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.108+0000 7fe091ffb640 1 -- 172.21.15.28:0/3832930702 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15989 (secure 0 0 0) 0x7fe094054b90 con 0x7fe09c148df0 2023-11-16T02:30:09.109 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:30:09.109 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":22,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","created":"2023-11-16T02:29:13.710567+0000","modified":"2023-11-16T02:29:38.871066+0000","last_up_change":"2023-11-16T02:29:24.841087+0000","last_in_change":"2023-11-16T02:29:16.024490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-16T02:29:26.490910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-16T02:29:36.133224+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-16T02:29:36.866156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dfa8b58d-3481-4e68-86e8-21873d31d0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":38722},{"type":"v1","addr":"172.21.15.28:6809","nonce":38722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":38722},{"type":"v1","addr":"172.21.15.28:6811","nonce":38722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":38722},{"type":"v1","addr":"172.21.15.28:6815","nonce":38722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":38722},{"type":"v1","addr":"172.21.15.28:6813","nonce":38722}]},"public_addr":"172.21.15.28:6809/38722","cluster_addr":"172.21.15.28:6811/38722","heartbeat_back_addr":"172.21.15.28:6815/38722","heartbeat_front_addr":"172.21.15.28:6813/38722","state":["exists","up"]},{"osd":1,"uuid":"1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":38724},{"type":"v1","addr":"172.21.15.28:6824","nonce":38724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":38724},{"type":"v1","addr":"172.21.15.28:6827","nonce":38724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":38724},{"type":"v1","addr":"172.21.15.28:6831","nonce":38724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":38724},{"type":"v1","addr":"172.21.15.28:6829","nonce":38724}]},"public_addr":"172.21.15.28:6824/38724","cluster_addr":"172.21.15.28:6827/38724","heartbeat_back_addr":"172.21.15.28:6831/38724","heartbeat_front_addr":"172.21.15.28:6829/38724","state":["exists","up"]},{"osd":2,"uuid":"e18f39cd-6a35-4d36-9eed-3877794bf2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":38723},{"type":"v1","addr":"172.21.15.28:6801","nonce":38723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":38723},{"type":"v1","addr":"172.21.15.28:6803","nonce":38723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":38723},{"type":"v1","addr":"172.21.15.28:6807","nonce":38723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":38723},{"type":"v1","addr":"172.21.15.28:6805","nonce":38723}]},"public_addr":"172.21.15.28:6801/38723","cluster_addr":"172.21.15.28:6803/38723","heartbeat_back_addr":"172.21.15.28:6807/38723","heartbeat_front_addr":"172.21.15.28:6805/38723","state":["exists","up"]},{"osd":3,"uuid":"303d0728-409d-47d7-b7a6-6eb273f602fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":38725},{"type":"v1","addr":"172.21.15.28:6817","nonce":38725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":38725},{"type":"v1","addr":"172.21.15.28:6819","nonce":38725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":38725},{"type":"v1","addr":"172.21.15.28:6825","nonce":38725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":38725},{"type":"v1","addr":"172.21.15.28:6821","nonce":38725}]},"public_addr":"172.21.15.28:6817/38725","cluster_addr":"172.21.15.28:6819/38725","heartbeat_back_addr":"172.21.15.28:6825/38725","heartbeat_front_addr":"172.21.15.28:6821/38725","state":["exists","up"]},{"osd":4,"uuid":"df0bf0ac-6efe-4964-ad27-7c1771a70c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":38828},{"type":"v1","addr":"172.21.15.70:6801","nonce":38828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":38828},{"type":"v1","addr":"172.21.15.70:6803","nonce":38828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":38828},{"type":"v1","addr":"172.21.15.70:6807","nonce":38828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":38828},{"type":"v1","addr":"172.21.15.70:6805","nonce":38828}]},"public_addr":"172.21.15.70:6801/38828","cluster_addr":"172.21.15.70:6803/38828","heartbeat_back_addr":"172.21.15.70:6807/38828","heartbeat_front_addr":"172.21.15.70:6805/38828","state":["exists","up"]},{"osd":5,"uuid":"84921219-65cb-4c4e-b9ed-a773db639034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":38830},{"type":"v1","addr":"172.21.15.70:6810","nonce":38830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6813","nonce":38830},{"type":"v1","addr":"172.21.15.70:6814","nonce":38830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":38830},{"type":"v1","addr":"172.21.15.70:6824","nonce":38830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":38830},{"type":"v1","addr":"172.21.15.70:6819","nonce":38830}]},"public_addr":"172.21.15.70:6810/38830","cluster_addr":"172.21.15.70:6814/38830","heartbeat_back_addr":"172.21.15.70:6824/38830","heartbeat_front_addr":"172.21.15.70:6819/38830","state":["exists","up"]},{"osd":6,"uuid":"c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":38829},{"type":"v1","addr":"172.21.15.70:6812","nonce":38829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":38829},{"type":"v1","addr":"172.21.15.70:6820","nonce":38829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":38829},{"type":"v1","addr":"172.21.15.70:6828","nonce":38829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":38829},{"type":"v1","addr":"172.21.15.70:6825","nonce":38829}]},"public_addr":"172.21.15.70:6812/38829","cluster_addr":"172.21.15.70:6820/38829","heartbeat_back_addr":"172.21.15.70:6828/38829","heartbeat_front_addr":"172.21.15.70:6825/38829","state":["exists","up"]},{"osd":7,"uuid":"e2cdd418-12ce-4eea-9b22-efdad83eb76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":38839},{"type":"v1","addr":"172.21.15.70:6815","nonce":38839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":38839},{"type":"v1","addr":"172.21.15.70:6823","nonce":38839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":38839},{"type":"v1","addr":"172.21.15.70:6831","nonce":38839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6827","nonce":38839},{"type":"v1","addr":"172.21.15.70:6829","nonce":38839}]},"public_addr":"172.21.15.70:6815/38839","cluster_addr":"172.21.15.70:6823/38839","heartbeat_back_addr":"172.21.15.70:6831/38839","heartbeat_front_addr":"172.21.15.70:6829/38839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.544240+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.637637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.352115+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.652916+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.624477+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.570247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.706468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.696574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-16T02:30:09.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.108+0000 7fe0a344c640 1 -- 172.21.15.28:0/3832930702 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe080065a60 msgr2=0x7fe080067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:09.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.108+0000 7fe0a344c640 1 --2- 172.21.15.28:0/3832930702 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe080065a60 0x7fe080067f20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe08c000f70 tx=0x7fe08c009040 comp rx=0 tx=0).stop 2023-11-16T02:30:09.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.108+0000 7fe0a344c640 1 -- 172.21.15.28:0/3832930702 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe09c148df0 msgr2=0x7fe09c13cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:09.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.108+0000 7fe0a344c640 1 --2- 172.21.15.28:0/3832930702 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe09c148df0 0x7fe09c13cc20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe09400cd50 tx=0x7fe09400a650 comp rx=0 tx=0).stop 2023-11-16T02:30:09.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.108+0000 7fe0a344c640 1 -- 172.21.15.28:0/3832930702 shutdown_connections 2023-11-16T02:30:09.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.108+0000 7fe0a344c640 1 --2- 172.21.15.28:0/3832930702 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe080065a60 0x7fe080067f20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:09.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.108+0000 7fe0a344c640 1 --2- 172.21.15.28:0/3832930702 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe09c148df0 0x7fe09c13cc20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:09.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.108+0000 7fe0a344c640 1 --2- 172.21.15.28:0/3832930702 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe09c148960 0x7fe09c0706c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:09.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.108+0000 7fe0a344c640 1 --2- 172.21.15.28:0/3832930702 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe09c0b8240 0x7fe09c1381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:09.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.108+0000 7fe0a344c640 1 -- 172.21.15.28:0/3832930702 >> 172.21.15.28:0/3832930702 conn(0x7fe09c0b9050 msgr2=0x7fe09c0b9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:09.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.108+0000 7fe0a344c640 1 -- 172.21.15.28:0/3832930702 shutdown_connections 2023-11-16T02:30:09.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.108+0000 7fe0a344c640 1 -- 172.21.15.28:0/3832930702 wait complete. 2023-11-16T02:30:09.127 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-16T02:30:09.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.236+0000 7fc0452a0640 1 Processor -- start 2023-11-16T02:30:09.237 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.236+0000 7fc0452a0640 1 -- start start 2023-11-16T02:30:09.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.236+0000 7fc0452a0640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc04006a3d0 0x7fc040071000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:09.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.236+0000 7fc0452a0640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc040141890 0x7fc040152100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:09.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.236+0000 7fc0452a0640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc040147de0 con 0x7fc04006edb0 2023-11-16T02:30:09.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.236+0000 7fc0452a0640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc040071540 con 0x7fc040141890 2023-11-16T02:30:09.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.236+0000 7fc0452a0640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc040071740 con 0x7fc04006a3d0 2023-11-16T02:30:09.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.236+0000 7fc03f7fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc040141890 0x7fc040152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:09.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.236+0000 7fc03effd640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc04006a3d0 0x7fc040071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:09.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.236+0000 7fc037fff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fc04006edb0 0x7fc040148270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.28:46510/0 (socket says 172.21.15.28:46510) 2023-11-16T02:30:09.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.236+0000 7fc037fff640 1 -- 172.21.15.28:0/1524737932 learned_addr learned my addr 172.21.15.28:0/1524737932 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:09.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.240+0000 7fc03f7fe640 1 -- 172.21.15.28:0/1524737932 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc04006a3d0 msgr2=0x7fc040071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:09.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.240+0000 7fc03f7fe640 1 --2- 172.21.15.28:0/1524737932 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc04006a3d0 0x7fc040071000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:09.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.240+0000 7fc03f7fe640 1 -- 172.21.15.28:0/1524737932 >> v1:172.21.15.70:6789/0 conn(0x7fc04006edb0 legacy=0x7fc040148270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:09.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.240+0000 7fc03f7fe640 1 -- 172.21.15.28:0/1524737932 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc040147a70 con 0x7fc040141890 2023-11-16T02:30:09.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.240+0000 7fc03f7fe640 1 --2- 172.21.15.28:0/1524737932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc040141890 0x7fc040152100 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc038009dc0 tx=0x7fc03801c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48877b72cb569797 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:09.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.240+0000 7fc03e7fc640 1 -- 172.21.15.28:0/1524737932 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0380a5900 con 0x7fc040141890 2023-11-16T02:30:09.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.240+0000 7fc03e7fc640 1 -- 172.21.15.28:0/1524737932 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0380a5a60 con 0x7fc040141890 2023-11-16T02:30:09.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.240+0000 7fc03e7fc640 1 -- 172.21.15.28:0/1524737932 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0380a5df0 con 0x7fc040141890 2023-11-16T02:30:09.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.240+0000 7fc0452a0640 1 -- 172.21.15.28:0/1524737932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc040141890 msgr2=0x7fc040152100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:09.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.240+0000 7fc0452a0640 1 --2- 172.21.15.28:0/1524737932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc040141890 0x7fc040152100 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc038009dc0 tx=0x7fc03801c930 comp rx=0 tx=0).stop 2023-11-16T02:30:09.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.240+0000 7fc0452a0640 1 -- 172.21.15.28:0/1524737932 shutdown_connections 2023-11-16T02:30:09.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.240+0000 7fc0452a0640 1 --2- 172.21.15.28:0/1524737932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc040141890 0x7fc040152100 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:09.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.240+0000 7fc0452a0640 1 --2- 172.21.15.28:0/1524737932 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc04006a3d0 0x7fc040071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:09.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.240+0000 7fc0452a0640 1 -- 172.21.15.28:0/1524737932 >> 172.21.15.28:0/1524737932 conn(0x7fc0400bc3e0 msgr2=0x7fc0400bc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:09.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.240+0000 7fc0452a0640 1 -- 172.21.15.28:0/1524737932 shutdown_connections 2023-11-16T02:30:09.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.240+0000 7fc0452a0640 1 -- 172.21.15.28:0/1524737932 wait complete. 2023-11-16T02:30:09.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc0452a0640 1 Processor -- start 2023-11-16T02:30:09.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc0452a0640 1 -- start start 2023-11-16T02:30:09.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc0452a0640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc04006a3d0 0x7fc04013cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:09.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc0452a0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc04006edb0 0x7fc04013de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:09.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc0452a0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc040141890 0x7fc0401e0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:09.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc0452a0640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04013d3e0 con 0x7fc040141890 2023-11-16T02:30:09.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc0452a0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04013e380 con 0x7fc04006edb0 2023-11-16T02:30:09.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc0452a0640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc040145210 con 0x7fc04006a3d0 2023-11-16T02:30:09.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc03f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc040141890 0x7fc0401e0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:09.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc03f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc040141890 0x7fc0401e0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50502/0 (socket says 172.21.15.28:50502) 2023-11-16T02:30:09.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc03f7fe640 1 -- 172.21.15.28:0/225556012 learned_addr learned my addr 172.21.15.28:0/225556012 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:09.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc037fff640 1 --2- 172.21.15.28:0/225556012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc04006edb0 0x7fc04013de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:09.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc03effd640 1 --2- 172.21.15.28:0/225556012 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc04006a3d0 0x7fc04013cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:09.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc03f7fe640 1 -- 172.21.15.28:0/225556012 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc04006a3d0 msgr2=0x7fc04013cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:09.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc03f7fe640 1 --2- 172.21.15.28:0/225556012 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc04006a3d0 0x7fc04013cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:09.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc03f7fe640 1 -- 172.21.15.28:0/225556012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc04006edb0 msgr2=0x7fc04013de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:09.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc03f7fe640 1 --2- 172.21.15.28:0/225556012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc04006edb0 0x7fc04013de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:09.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc03f7fe640 1 -- 172.21.15.28:0/225556012 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc038009a70 con 0x7fc040141890 2023-11-16T02:30:09.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc03effd640 1 --2- 172.21.15.28:0/225556012 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc04006a3d0 0x7fc04013cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:30:09.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc03f7fe640 1 --2- 172.21.15.28:0/225556012 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc040141890 0x7fc0401e0d70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc03801afe0 tx=0x7fc0380196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:09.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc0377fe640 1 -- 172.21.15.28:0/225556012 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0380a5880 con 0x7fc040141890 2023-11-16T02:30:09.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc0377fe640 1 -- 172.21.15.28:0/225556012 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0380ad650 con 0x7fc040141890 2023-11-16T02:30:09.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc0452a0640 1 -- 172.21.15.28:0/225556012 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0400b7860 con 0x7fc040141890 2023-11-16T02:30:09.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc0377fe640 1 -- 172.21.15.28:0/225556012 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0380ada00 con 0x7fc040141890 2023-11-16T02:30:09.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc0452a0640 1 -- 172.21.15.28:0/225556012 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0400b7ab0 con 0x7fc040141890 2023-11-16T02:30:09.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc0452a0640 1 -- 172.21.15.28:0/225556012 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0400b7ca0 con 0x7fc040141890 2023-11-16T02:30:09.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc0377fe640 1 -- 172.21.15.28:0/225556012 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc0380adb60 con 0x7fc040141890 2023-11-16T02:30:09.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc0377fe640 1 --2- 172.21.15.28:0/225556012 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc020065a60 0x7fc020067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:09.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc0377fe640 1 -- 172.21.15.28:0/225556012 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc03811e5f0 con 0x7fc040141890 2023-11-16T02:30:09.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.244+0000 7fc03effd640 1 --2- 172.21.15.28:0/225556012 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc020065a60 0x7fc020067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:09.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.248+0000 7fc03effd640 1 --2- 172.21.15.28:0/225556012 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc020065a60 0x7fc020067f20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc030009bb0 tx=0x7fc030008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:09.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.248+0000 7fc0377fe640 1 -- 172.21.15.28:0/225556012 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fc0380ec1e0 con 0x7fc040141890 2023-11-16T02:30:09.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.432+0000 7fc0452a0640 1 -- 172.21.15.28:0/225556012 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc04004e8a0 con 0x7fc040141890 2023-11-16T02:30:09.435 INFO:tasks.ceph.mon.a.smithi028.stderr:2023-11-16T02:30:09.432+0000 7f0abc503640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-16T02:30:09.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.452+0000 7fc0377fe640 1 -- 172.21.15.28:0/225556012 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc0380bc090 con 0x7fc040141890 2023-11-16T02:30:09.452 INFO:teuthology.orchestra.run.smithi028.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-16T02:30:09.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.452+0000 7fc0452a0640 1 -- 172.21.15.28:0/225556012 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc020065a60 msgr2=0x7fc020067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:09.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.452+0000 7fc0452a0640 1 --2- 172.21.15.28:0/225556012 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc020065a60 0x7fc020067f20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc030009bb0 tx=0x7fc030008040 comp rx=0 tx=0).stop 2023-11-16T02:30:09.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.452+0000 7fc0452a0640 1 -- 172.21.15.28:0/225556012 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc040141890 msgr2=0x7fc0401e0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:09.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.452+0000 7fc0452a0640 1 --2- 172.21.15.28:0/225556012 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc040141890 0x7fc0401e0d70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc03801afe0 tx=0x7fc0380196d0 comp rx=0 tx=0).stop 2023-11-16T02:30:09.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.452+0000 7fc0452a0640 1 -- 172.21.15.28:0/225556012 shutdown_connections 2023-11-16T02:30:09.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.452+0000 7fc0452a0640 1 --2- 172.21.15.28:0/225556012 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc020065a60 0x7fc020067f20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:09.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.452+0000 7fc0452a0640 1 --2- 172.21.15.28:0/225556012 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc040141890 0x7fc0401e0d70 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:09.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.452+0000 7fc0452a0640 1 --2- 172.21.15.28:0/225556012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc04006edb0 0x7fc04013de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:09.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.452+0000 7fc0452a0640 1 --2- 172.21.15.28:0/225556012 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc04006a3d0 0x7fc04013cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:09.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.452+0000 7fc0452a0640 1 -- 172.21.15.28:0/225556012 >> 172.21.15.28:0/225556012 conn(0x7fc0400bc3e0 msgr2=0x7fc040140500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:09.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.452+0000 7fc0452a0640 1 -- 172.21.15.28:0/225556012 shutdown_connections 2023-11-16T02:30:09.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.452+0000 7fc0452a0640 1 -- 172.21.15.28:0/225556012 wait complete. 2023-11-16T02:30:09.458 INFO:tasks.ceph.mds.a.smithi028.stderr: -4693> 2023-11-16T02:29:42.673+0000 7fed5b389640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-16T02:30:09.471 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-16T02:30:09.497 INFO:tasks.ceph.mds.a.smithi028.stdout:starting mds.a at 2023-11-16T02:30:09.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.584+0000 7fad08299640 1 Processor -- start 2023-11-16T02:30:09.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.584+0000 7fad08299640 1 -- start start 2023-11-16T02:30:09.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.584+0000 7fad08299640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fad00071340 0x7fad000b9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:09.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.584+0000 7fad08299640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fad00070560 0x7fad00148970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:09.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.584+0000 7fad08299640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad000717d0 con 0x7fad000b69b0 2023-11-16T02:30:09.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.584+0000 7fad08299640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad00070140 con 0x7fad00070560 2023-11-16T02:30:09.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.584+0000 7fad08299640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad00148eb0 con 0x7fad00071340 2023-11-16T02:30:09.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.584+0000 7fad06836640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fad00070560 0x7fad00148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:09.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.584+0000 7fad06836640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fad00070560 0x7fad00148970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50530/0 (socket says 172.21.15.28:50530) 2023-11-16T02:30:09.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.584+0000 7fad06836640 1 -- 172.21.15.28:0/1761951194 learned_addr learned my addr 172.21.15.28:0/1761951194 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:09.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.584+0000 7fad06836640 1 -- 172.21.15.28:0/1761951194 >> v2:172.21.15.70:3300/0 conn(0x7fad00071340 msgr2=0x7fad000b9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:09.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.584+0000 7fad05834640 1 --2- 172.21.15.28:0/1761951194 >> v2:172.21.15.70:3300/0 conn(0x7fad00071340 0x7fad000b9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:09.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.584+0000 7fad06836640 1 --2- 172.21.15.28:0/1761951194 >> v2:172.21.15.70:3300/0 conn(0x7fad00071340 0x7fad000b9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:09.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.584+0000 7fad06836640 1 -- 172.21.15.28:0/1761951194 >> v1:172.21.15.70:6789/0 conn(0x7fad000b69b0 legacy=0x7fad00142960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:09.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.584+0000 7fad06836640 1 -- 172.21.15.28:0/1761951194 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad00071ab0 con 0x7fad00070560 2023-11-16T02:30:09.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.588+0000 7fad06836640 1 --2- 172.21.15.28:0/1761951194 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad00070560 0x7fad00148970 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fad00148ff0 tx=0x7facf801f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db57b190c739f865 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:09.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.588+0000 7fad05033640 1 -- 172.21.15.28:0/1761951194 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf80af400 con 0x7fad00070560 2023-11-16T02:30:09.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.588+0000 7fad05033640 1 -- 172.21.15.28:0/1761951194 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf80ab050 con 0x7fad00070560 2023-11-16T02:30:09.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.588+0000 7fad05033640 1 -- 172.21.15.28:0/1761951194 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf80af780 con 0x7fad00070560 2023-11-16T02:30:09.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.588+0000 7fad08299640 1 -- 172.21.15.28:0/1761951194 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad00070560 msgr2=0x7fad00148970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:09.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.588+0000 7fad08299640 1 --2- 172.21.15.28:0/1761951194 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad00070560 0x7fad00148970 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fad00148ff0 tx=0x7facf801f180 comp rx=0 tx=0).stop 2023-11-16T02:30:09.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.588+0000 7fad08299640 1 -- 172.21.15.28:0/1761951194 shutdown_connections 2023-11-16T02:30:09.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.588+0000 7fad08299640 1 --2- 172.21.15.28:0/1761951194 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad00070560 0x7fad00148970 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:09.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.588+0000 7fad08299640 1 --2- 172.21.15.28:0/1761951194 >> v2:172.21.15.70:3300/0 conn(0x7fad00071340 0x7fad000b9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:09.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.588+0000 7fad08299640 1 -- 172.21.15.28:0/1761951194 >> 172.21.15.28:0/1761951194 conn(0x7fad000bd310 msgr2=0x7fad000bd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:09.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.588+0000 7fad08299640 1 -- 172.21.15.28:0/1761951194 shutdown_connections 2023-11-16T02:30:09.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.588+0000 7fad08299640 1 -- 172.21.15.28:0/1761951194 wait complete. 2023-11-16T02:30:09.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.588+0000 7fad08299640 1 Processor -- start 2023-11-16T02:30:09.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.588+0000 7fad08299640 1 -- start start 2023-11-16T02:30:09.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.592+0000 7fad08299640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad00070560 0x7fad00145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:09.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.592+0000 7fad08299640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad000b69b0 0x7fad001df950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:09.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.592+0000 7fad08299640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fad001dfe90 0x7fad0013a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:09.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.592+0000 7fad08299640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad00145b50 con 0x7fad00070560 2023-11-16T02:30:09.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.592+0000 7fad08299640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad000a7650 con 0x7fad000b69b0 2023-11-16T02:30:09.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.592+0000 7fad08299640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad001e0300 con 0x7fad001dfe90 2023-11-16T02:30:09.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.592+0000 7fad06035640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad00070560 0x7fad00145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:09.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.592+0000 7fad06035640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad00070560 0x7fad00145610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50546/0 (socket says 172.21.15.28:50546) 2023-11-16T02:30:09.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.592+0000 7fad06035640 1 -- 172.21.15.28:0/4049831199 learned_addr learned my addr 172.21.15.28:0/4049831199 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:09.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.592+0000 7fad06035640 1 -- 172.21.15.28:0/4049831199 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fad001dfe90 msgr2=0x7fad0013a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:09.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.592+0000 7fad06035640 1 --2- 172.21.15.28:0/4049831199 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fad001dfe90 0x7fad0013a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:09.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.592+0000 7fad06035640 1 -- 172.21.15.28:0/4049831199 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad000b69b0 msgr2=0x7fad001df950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:09.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.592+0000 7fad06035640 1 --2- 172.21.15.28:0/4049831199 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad000b69b0 0x7fad001df950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:09.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.592+0000 7fad06035640 1 -- 172.21.15.28:0/4049831199 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf8009b30 con 0x7fad00070560 2023-11-16T02:30:09.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.592+0000 7fad06035640 1 --2- 172.21.15.28:0/4049831199 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad00070560 0x7fad00145610 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7facfc00b440 tx=0x7facfc00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:09.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.592+0000 7facf6ffd640 1 -- 172.21.15.28:0/4049831199 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc011890 con 0x7fad00070560 2023-11-16T02:30:09.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.592+0000 7facf6ffd640 1 -- 172.21.15.28:0/4049831199 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc0119f0 con 0x7fad00070560 2023-11-16T02:30:09.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.592+0000 7fad08299640 1 -- 172.21.15.28:0/4049831199 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad000a7ef0 con 0x7fad00070560 2023-11-16T02:30:09.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.592+0000 7facf6ffd640 1 -- 172.21.15.28:0/4049831199 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc011da0 con 0x7fad00070560 2023-11-16T02:30:09.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.592+0000 7fad08299640 1 -- 172.21.15.28:0/4049831199 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad000a78a0 con 0x7fad00070560 2023-11-16T02:30:09.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.592+0000 7fad08299640 1 -- 172.21.15.28:0/4049831199 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0004e8a0 con 0x7fad00070560 2023-11-16T02:30:09.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.592+0000 7facf6ffd640 1 -- 172.21.15.28:0/4049831199 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7facfc004020 con 0x7fad00070560 2023-11-16T02:30:09.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.592+0000 7facf6ffd640 1 --2- 172.21.15.28:0/4049831199 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7face4065a60 0x7face4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:09.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.592+0000 7facf6ffd640 1 -- 172.21.15.28:0/4049831199 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5795+0+0 (secure 0 0 0) 0x7facfc0831c0 con 0x7fad00070560 2023-11-16T02:30:09.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.592+0000 7fad05834640 1 --2- 172.21.15.28:0/4049831199 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7face4065a60 0x7face4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:09.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.592+0000 7fad05834640 1 --2- 172.21.15.28:0/4049831199 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7face4065a60 0x7face4067f20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fad001d9f40 tx=0x7facf0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:09.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.596+0000 7facf6ffd640 1 -- 172.21.15.28:0/4049831199 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7facfc050bb0 con 0x7fad00070560 2023-11-16T02:30:09.780 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:09.780+0000 7fad08299640 1 -- 172.21.15.28:0/4049831199 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fad000a8f80 con 0x7fad00070560 2023-11-16T02:30:10.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.456+0000 7facf6ffd640 1 -- 172.21.15.28:0/4049831199 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7facfc0541d0 con 0x7fad00070560 2023-11-16T02:30:10.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.460+0000 7fad08299640 1 -- 172.21.15.28:0/4049831199 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7face4065a60 msgr2=0x7face4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:10.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.460+0000 7fad08299640 1 --2- 172.21.15.28:0/4049831199 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7face4065a60 0x7face4067f20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fad001d9f40 tx=0x7facf0008040 comp rx=0 tx=0).stop 2023-11-16T02:30:10.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.460+0000 7fad08299640 1 -- 172.21.15.28:0/4049831199 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad00070560 msgr2=0x7fad00145610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:10.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.460+0000 7fad08299640 1 --2- 172.21.15.28:0/4049831199 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad00070560 0x7fad00145610 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7facfc00b440 tx=0x7facfc00b900 comp rx=0 tx=0).stop 2023-11-16T02:30:10.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.460+0000 7fad08299640 1 -- 172.21.15.28:0/4049831199 shutdown_connections 2023-11-16T02:30:10.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.460+0000 7fad08299640 1 --2- 172.21.15.28:0/4049831199 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7face4065a60 0x7face4067f20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:10.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.460+0000 7fad08299640 1 --2- 172.21.15.28:0/4049831199 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fad001dfe90 0x7fad0013a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:10.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.460+0000 7fad08299640 1 --2- 172.21.15.28:0/4049831199 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad000b69b0 0x7fad001df950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:10.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.460+0000 7fad08299640 1 --2- 172.21.15.28:0/4049831199 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad00070560 0x7fad00145610 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:10.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.460+0000 7fad08299640 1 -- 172.21.15.28:0/4049831199 >> 172.21.15.28:0/4049831199 conn(0x7fad000bd310 msgr2=0x7fad000bd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:10.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.460+0000 7fad08299640 1 -- 172.21.15.28:0/4049831199 shutdown_connections 2023-11-16T02:30:10.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.460+0000 7fad08299640 1 -- 172.21.15.28:0/4049831199 wait complete. 2023-11-16T02:30:10.484 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-16T02:30:10.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.668+0000 7face3293640 1 Processor -- start 2023-11-16T02:30:10.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.668+0000 7face3293640 1 -- start start 2023-11-16T02:30:10.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.668+0000 7face3293640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7facdc1420f0 0x7facdc070b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:10.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.668+0000 7face3293640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facdc14b100 con 0x7facdc147c00 2023-11-16T02:30:10.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.668+0000 7face3293640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facdc14b350 con 0x7facdc0b82a0 2023-11-16T02:30:10.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.668+0000 7face3293640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facdc14b630 con 0x7facdc1420f0 2023-11-16T02:30:10.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7face082e640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7facdc147c00 0x7facdc0b7b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36888/0 (socket says 172.21.15.28:36888) 2023-11-16T02:30:10.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7face082e640 1 -- 172.21.15.28:0/1716412576 learned_addr learned my addr 172.21.15.28:0/1716412576 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:10.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7face102f640 1 --2- 172.21.15.28:0/1716412576 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7facdc1420f0 0x7facdc070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:10.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7facd3fff640 1 -- 172.21.15.28:0/1716412576 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3050888557 0 0) 0x7facdc14b100 con 0x7facdc147c00 2023-11-16T02:30:10.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7facd3fff640 1 -- 172.21.15.28:0/1716412576 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facc8003530 con 0x7facdc147c00 2023-11-16T02:30:10.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7facd3fff640 1 -- 172.21.15.28:0/1716412576 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 37708904 0 0) 0x7facc8003530 con 0x7facdc147c00 2023-11-16T02:30:10.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7facd3fff640 1 -- 172.21.15.28:0/1716412576 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7facdc1420f0 msgr2=0x7facdc070b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:10.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7facd3fff640 1 --2- 172.21.15.28:0/1716412576 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7facdc1420f0 0x7facdc070b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:10.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7facd3fff640 1 -- 172.21.15.28:0/1716412576 >> v1:172.21.15.70:6789/0 conn(0x7facdc0b82a0 legacy=0x7facdc152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:10.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7facd3fff640 1 -- 172.21.15.28:0/1716412576 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facdc14b910 con 0x7facdc147c00 2023-11-16T02:30:10.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7facd3fff640 1 -- 172.21.15.28:0/1716412576 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7faccc001680 con 0x7facdc147c00 2023-11-16T02:30:10.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7facd3fff640 1 -- 172.21.15.28:0/1716412576 >> v1:172.21.15.28:6789/0 conn(0x7facdc147c00 legacy=0x7facdc0b7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:10.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7facd3fff640 1 --2- 172.21.15.28:0/1716412576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7facc80039b0 0x7facc8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:10.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7facd3fff640 1 --2- 172.21.15.28:0/1716412576 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7facdc1420f0 0x7facc80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:10.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7facd3fff640 1 --2- 172.21.15.28:0/1716412576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facc8004d10 0x7facc8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:10.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7facd3fff640 1 -- 172.21.15.28:0/1716412576 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc14b630 con 0x7facc80039b0 2023-11-16T02:30:10.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7facd3fff640 1 -- 172.21.15.28:0/1716412576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc800b990 con 0x7facc8004d10 2023-11-16T02:30:10.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7facd3fff640 1 -- 172.21.15.28:0/1716412576 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc800bb50 con 0x7facdc1420f0 2023-11-16T02:30:10.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7face102f640 1 --2- 172.21.15.28:0/1716412576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7facc80039b0 0x7facc8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:10.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7face082e640 1 --2- 172.21.15.28:0/1716412576 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7facdc1420f0 0x7facc80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:10.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7face1830640 1 --2- 172.21.15.28:0/1716412576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facc8004d10 0x7facc8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:10.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7face102f640 1 -- 172.21.15.28:0/1716412576 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7facdc1420f0 msgr2=0x7facc80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:10.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7face102f640 1 --2- 172.21.15.28:0/1716412576 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7facdc1420f0 0x7facc80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:10.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7face102f640 1 -- 172.21.15.28:0/1716412576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facc8004d10 msgr2=0x7facc8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:10.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7face102f640 1 --2- 172.21.15.28:0/1716412576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facc8004d10 0x7facc8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:10.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7face102f640 1 -- 172.21.15.28:0/1716412576 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc8003530 con 0x7facc80039b0 2023-11-16T02:30:10.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7face102f640 1 --2- 172.21.15.28:0/1716412576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7facc80039b0 0x7facc8003d90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7facd8009ae0 tx=0x7facd801c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c0aaa86105e62c server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:10.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7facd3fff640 1 -- 172.21.15.28:0/1716412576 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd80a5580 con 0x7facc80039b0 2023-11-16T02:30:10.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7facd3fff640 1 -- 172.21.15.28:0/1716412576 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd80a56e0 con 0x7facc80039b0 2023-11-16T02:30:10.679 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.672+0000 7facd3fff640 1 -- 172.21.15.28:0/1716412576 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd80a5a90 con 0x7facc80039b0 2023-11-16T02:30:10.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face3293640 1 -- 172.21.15.28:0/1716412576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7facc80039b0 msgr2=0x7facc8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:10.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face3293640 1 --2- 172.21.15.28:0/1716412576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7facc80039b0 0x7facc8003d90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7facd8009ae0 tx=0x7facd801c990 comp rx=0 tx=0).stop 2023-11-16T02:30:10.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face1830640 1 -- 172.21.15.28:0/1716412576 reap_dead start 2023-11-16T02:30:10.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face3293640 1 -- 172.21.15.28:0/1716412576 shutdown_connections 2023-11-16T02:30:10.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face3293640 1 -- 172.21.15.28:0/1716412576 >> 172.21.15.28:0/1716412576 conn(0x7facdc0bc070 msgr2=0x7facdc0bc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:10.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face3293640 1 -- 172.21.15.28:0/1716412576 shutdown_connections 2023-11-16T02:30:10.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face3293640 1 -- 172.21.15.28:0/1716412576 wait complete. 2023-11-16T02:30:10.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face3293640 1 Processor -- start 2023-11-16T02:30:10.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face3293640 1 -- start start 2023-11-16T02:30:10.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face3293640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facc80039b0 0x7facdc146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:10.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face3293640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7facdc148cf0 0x7facdc0b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:10.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face3293640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7facdc0b09d0 0x7facdc1e1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:10.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face3293640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc1471f0 con 0x7facdc0b09d0 2023-11-16T02:30:10.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face3293640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc14a2e0 con 0x7facc80039b0 2023-11-16T02:30:10.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face3293640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facdc149240 con 0x7facdc148cf0 2023-11-16T02:30:10.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face1830640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7facdc0b09d0 0x7facdc1e1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:10.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face1830640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7facdc0b09d0 0x7facdc1e1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50548/0 (socket says 172.21.15.28:50548) 2023-11-16T02:30:10.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face1830640 1 -- 172.21.15.28:0/4143811183 learned_addr learned my addr 172.21.15.28:0/4143811183 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:10.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face1830640 1 -- 172.21.15.28:0/4143811183 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7facdc148cf0 msgr2=0x7facdc0b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:10.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face1830640 1 --2- 172.21.15.28:0/4143811183 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7facdc148cf0 0x7facdc0b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:10.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face1830640 1 -- 172.21.15.28:0/4143811183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facc80039b0 msgr2=0x7facdc146cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:10.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face102f640 1 --2- 172.21.15.28:0/4143811183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facc80039b0 0x7facdc146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:10.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face1830640 1 --2- 172.21.15.28:0/4143811183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facc80039b0 0x7facdc146cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:10.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face1830640 1 -- 172.21.15.28:0/4143811183 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facdc149520 con 0x7facdc0b09d0 2023-11-16T02:30:10.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face102f640 1 --2- 172.21.15.28:0/4143811183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facc80039b0 0x7facdc146cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:10.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face1830640 1 --2- 172.21.15.28:0/4143811183 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7facdc0b09d0 0x7facdc1e1830 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7facdc148cc0 tx=0x7facd4010f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:10.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7facd1ffb640 1 -- 172.21.15.28:0/4143811183 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd4003d90 con 0x7facdc0b09d0 2023-11-16T02:30:10.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7facd1ffb640 1 -- 172.21.15.28:0/4143811183 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd400d070 con 0x7facdc0b09d0 2023-11-16T02:30:10.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face3293640 1 -- 172.21.15.28:0/4143811183 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facdc149800 con 0x7facdc0b09d0 2023-11-16T02:30:10.682 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7facd1ffb640 1 -- 172.21.15.28:0/4143811183 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd400ead0 con 0x7facdc0b09d0 2023-11-16T02:30:10.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.676+0000 7face3293640 1 -- 172.21.15.28:0/4143811183 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facdc149dc0 con 0x7facdc0b09d0 2023-11-16T02:30:10.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.680+0000 7face3293640 1 -- 172.21.15.28:0/4143811183 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facdc149fe0 con 0x7facdc0b09d0 2023-11-16T02:30:10.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.680+0000 7facd1ffb640 1 -- 172.21.15.28:0/4143811183 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7facd400ec30 con 0x7facdc0b09d0 2023-11-16T02:30:10.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.680+0000 7facd1ffb640 1 --2- 172.21.15.28:0/4143811183 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7facc0065a90 0x7facc0067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:10.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.680+0000 7facd1ffb640 1 -- 172.21.15.28:0/4143811183 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5795+0+0 (secure 0 0 0) 0x7facd40863c0 con 0x7facdc0b09d0 2023-11-16T02:30:10.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.680+0000 7face102f640 1 --2- 172.21.15.28:0/4143811183 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7facc0065a90 0x7facc0067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:10.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.680+0000 7face102f640 1 --2- 172.21.15.28:0/4143811183 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7facc0065a90 0x7facc0067f50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7facd80af000 tx=0x7facd80046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:10.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.684+0000 7facd1ffb640 1 -- 172.21.15.28:0/4143811183 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7facd4053d20 con 0x7facdc0b09d0 2023-11-16T02:30:10.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:10.844+0000 7face3293640 1 -- 172.21.15.28:0/4143811183 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7facdc04e8a0 con 0x7facdc0b09d0 2023-11-16T02:30:11.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.588+0000 7facd1ffb640 1 -- 172.21.15.28:0/4143811183 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7facd4057340 con 0x7facdc0b09d0 2023-11-16T02:30:11.590 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_metadata' removed 2023-11-16T02:30:11.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.596+0000 7face3293640 1 -- 172.21.15.28:0/4143811183 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7facc0065a90 msgr2=0x7facc0067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:11.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.596+0000 7face3293640 1 --2- 172.21.15.28:0/4143811183 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7facc0065a90 0x7facc0067f50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7facd80af000 tx=0x7facd80046d0 comp rx=0 tx=0).stop 2023-11-16T02:30:11.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.596+0000 7face3293640 1 -- 172.21.15.28:0/4143811183 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7facdc0b09d0 msgr2=0x7facdc1e1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:11.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.596+0000 7face3293640 1 --2- 172.21.15.28:0/4143811183 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7facdc0b09d0 0x7facdc1e1830 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7facdc148cc0 tx=0x7facd4010f20 comp rx=0 tx=0).stop 2023-11-16T02:30:11.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.600+0000 7face3293640 1 -- 172.21.15.28:0/4143811183 shutdown_connections 2023-11-16T02:30:11.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.600+0000 7face3293640 1 --2- 172.21.15.28:0/4143811183 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7facc0065a90 0x7facc0067f50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:11.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.600+0000 7face3293640 1 --2- 172.21.15.28:0/4143811183 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7facdc0b09d0 0x7facdc1e1830 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:11.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.600+0000 7face3293640 1 --2- 172.21.15.28:0/4143811183 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7facdc148cf0 0x7facdc0b0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:11.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.600+0000 7face3293640 1 --2- 172.21.15.28:0/4143811183 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7facc80039b0 0x7facdc146cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:11.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.600+0000 7face3293640 1 -- 172.21.15.28:0/4143811183 >> 172.21.15.28:0/4143811183 conn(0x7facdc0bc070 msgr2=0x7facdc0b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:11.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.600+0000 7face3293640 1 -- 172.21.15.28:0/4143811183 shutdown_connections 2023-11-16T02:30:11.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.600+0000 7face3293640 1 -- 172.21.15.28:0/4143811183 wait complete. 2023-11-16T02:30:11.624 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-16T02:30:11.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.756+0000 7f86faeb2640 1 Processor -- start 2023-11-16T02:30:11.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.756+0000 7f86faeb2640 1 -- start start 2023-11-16T02:30:11.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.756+0000 7f86faeb2640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f86f40b36d0 0x7f86f40b8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:11.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.756+0000 7f86faeb2640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f86f40b7b00 0x7f86f4142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:11.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.756+0000 7f86faeb2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86f4143230 0x7f86f40b5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:11.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.756+0000 7f86faeb2640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f4071590 con 0x7f86f40b7b00 2023-11-16T02:30:11.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.756+0000 7f86faeb2640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f4070fa0 con 0x7f86f40b36d0 2023-11-16T02:30:11.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.756+0000 7f86faeb2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f40719b0 con 0x7f86f4143230 2023-11-16T02:30:11.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.756+0000 7f86f3fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f86f40b7b00 0x7f86f4142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:11.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.756+0000 7f86f3fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f86f40b7b00 0x7f86f4142cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50556/0 (socket says 172.21.15.28:50556) 2023-11-16T02:30:11.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.756+0000 7f86f3fff640 1 -- 172.21.15.28:0/3283742781 learned_addr learned my addr 172.21.15.28:0/3283742781 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:11.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.756+0000 7f86f944f640 1 --2- 172.21.15.28:0/3283742781 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86f4143230 0x7f86f40b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:11.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.756+0000 7f86f8c4e640 1 --2- 172.21.15.28:0/3283742781 >> v2:172.21.15.70:3300/0 conn(0x7f86f40b36d0 0x7f86f40b8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:11.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.756+0000 7f86f3fff640 1 -- 172.21.15.28:0/3283742781 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86f4143230 msgr2=0x7f86f40b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:11.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.756+0000 7f86f3fff640 1 --2- 172.21.15.28:0/3283742781 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86f4143230 0x7f86f40b5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:11.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.756+0000 7f86f3fff640 1 -- 172.21.15.28:0/3283742781 >> v2:172.21.15.70:3300/0 conn(0x7f86f40b36d0 msgr2=0x7f86f40b8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:11.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.756+0000 7f86f3fff640 1 --2- 172.21.15.28:0/3283742781 >> v2:172.21.15.70:3300/0 conn(0x7f86f40b36d0 0x7f86f40b8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:11.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.756+0000 7f86f3fff640 1 -- 172.21.15.28:0/3283742781 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f40b69f0 con 0x7f86f40b7b00 2023-11-16T02:30:11.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.756+0000 7f86f8c4e640 1 --2- 172.21.15.28:0/3283742781 >> v2:172.21.15.70:3300/0 conn(0x7f86f40b36d0 0x7f86f40b8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:11.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.760+0000 7f86f3fff640 1 --2- 172.21.15.28:0/3283742781 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86f40b7b00 0x7f86f4142cf0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f86f406adb0 tx=0x7f86e801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff3d28961399773 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:11.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.760+0000 7f86f37fe640 1 -- 172.21.15.28:0/3283742781 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e80ab600 con 0x7f86f40b7b00 2023-11-16T02:30:11.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.760+0000 7f86f37fe640 1 -- 172.21.15.28:0/3283742781 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e80a7050 con 0x7f86f40b7b00 2023-11-16T02:30:11.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.760+0000 7f86f37fe640 1 -- 172.21.15.28:0/3283742781 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e80ab980 con 0x7f86f40b7b00 2023-11-16T02:30:11.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.760+0000 7f86faeb2640 1 -- 172.21.15.28:0/3283742781 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86f40b7b00 msgr2=0x7f86f4142cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:11.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.760+0000 7f86faeb2640 1 --2- 172.21.15.28:0/3283742781 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86f40b7b00 0x7f86f4142cf0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f86f406adb0 tx=0x7f86e801c500 comp rx=0 tx=0).stop 2023-11-16T02:30:11.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.760+0000 7f86faeb2640 1 -- 172.21.15.28:0/3283742781 shutdown_connections 2023-11-16T02:30:11.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.760+0000 7f86faeb2640 1 --2- 172.21.15.28:0/3283742781 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86f4143230 0x7f86f40b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:11.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.760+0000 7f86faeb2640 1 --2- 172.21.15.28:0/3283742781 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86f40b7b00 0x7f86f4142cf0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:11.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.760+0000 7f86faeb2640 1 --2- 172.21.15.28:0/3283742781 >> v2:172.21.15.70:3300/0 conn(0x7f86f40b36d0 0x7f86f40b8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:11.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.760+0000 7f86faeb2640 1 -- 172.21.15.28:0/3283742781 >> 172.21.15.28:0/3283742781 conn(0x7f86f40bc070 msgr2=0x7f86f40bc480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:11.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.760+0000 7f86faeb2640 1 -- 172.21.15.28:0/3283742781 shutdown_connections 2023-11-16T02:30:11.762 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.760+0000 7f86faeb2640 1 -- 172.21.15.28:0/3283742781 wait complete. 2023-11-16T02:30:11.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.760+0000 7f86faeb2640 1 Processor -- start 2023-11-16T02:30:11.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.760+0000 7f86faeb2640 1 -- start start 2023-11-16T02:30:11.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.760+0000 7f86faeb2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86f40b36d0 0x7f86f4147a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:11.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.760+0000 7f86faeb2640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86f40b7b00 0x7f86f41e7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:11.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.760+0000 7f86faeb2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86f4143230 0x7f86f413ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:11.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.760+0000 7f86faeb2640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f413d000 con 0x7f86f4143230 2023-11-16T02:30:11.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.760+0000 7f86faeb2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f41e69a0 con 0x7f86f40b36d0 2023-11-16T02:30:11.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.760+0000 7f86faeb2640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f41e34f0 con 0x7f86f40b7b00 2023-11-16T02:30:11.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.760+0000 7f86f944f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86f4143230 0x7f86f413ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:11.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.764+0000 7f86f944f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86f4143230 0x7f86f413ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50572/0 (socket says 172.21.15.28:50572) 2023-11-16T02:30:11.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.764+0000 7f86f944f640 1 -- 172.21.15.28:0/675810895 learned_addr learned my addr 172.21.15.28:0/675810895 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:11.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.764+0000 7f86f3fff640 1 --2- 172.21.15.28:0/675810895 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86f40b7b00 0x7f86f41e7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:11.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.764+0000 7f86f8c4e640 1 --2- 172.21.15.28:0/675810895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86f40b36d0 0x7f86f4147a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:11.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.764+0000 7f86f944f640 1 -- 172.21.15.28:0/675810895 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86f40b7b00 msgr2=0x7f86f41e7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:11.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.764+0000 7f86f944f640 1 --2- 172.21.15.28:0/675810895 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86f40b7b00 0x7f86f41e7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:11.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.764+0000 7f86f944f640 1 -- 172.21.15.28:0/675810895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86f40b36d0 msgr2=0x7f86f4147a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:11.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.764+0000 7f86f944f640 1 --2- 172.21.15.28:0/675810895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86f40b36d0 0x7f86f4147a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:11.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.764+0000 7f86f944f640 1 -- 172.21.15.28:0/675810895 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e80094d0 con 0x7f86f4143230 2023-11-16T02:30:11.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.764+0000 7f86f944f640 1 --2- 172.21.15.28:0/675810895 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86f4143230 0x7f86f413ae20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f86ec007d40 tx=0x7f86ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:11.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.764+0000 7f86f17fa640 1 -- 172.21.15.28:0/675810895 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec014420 con 0x7f86f4143230 2023-11-16T02:30:11.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.764+0000 7f86f17fa640 1 -- 172.21.15.28:0/675810895 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ec0145a0 con 0x7f86f4143230 2023-11-16T02:30:11.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.764+0000 7f86faeb2640 1 -- 172.21.15.28:0/675810895 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f413ca40 con 0x7f86f4143230 2023-11-16T02:30:11.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.764+0000 7f86f17fa640 1 -- 172.21.15.28:0/675810895 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec014950 con 0x7f86f4143230 2023-11-16T02:30:11.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.764+0000 7f86faeb2640 1 -- 172.21.15.28:0/675810895 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f41e6c00 con 0x7f86f4143230 2023-11-16T02:30:11.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.764+0000 7f86faeb2640 1 -- 172.21.15.28:0/675810895 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f41e6df0 con 0x7f86f4143230 2023-11-16T02:30:11.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.764+0000 7f86f17fa640 1 -- 172.21.15.28:0/675810895 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f86ec014ab0 con 0x7f86f4143230 2023-11-16T02:30:11.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.764+0000 7f86f17fa640 1 --2- 172.21.15.28:0/675810895 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f86e0065a60 0x7f86e0067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:11.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.764+0000 7f86f17fa640 1 -- 172.21.15.28:0/675810895 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f86ec083920 con 0x7f86f4143230 2023-11-16T02:30:11.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.764+0000 7f86f8c4e640 1 --2- 172.21.15.28:0/675810895 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f86e0065a60 0x7f86e0067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:11.769 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.764+0000 7f86f8c4e640 1 --2- 172.21.15.28:0/675810895 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f86e0065a60 0x7f86e0067f20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f86e4006b20 tx=0x7f86e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:11.770 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.768+0000 7f86f17fa640 1 -- 172.21.15.28:0/675810895 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f86ec051430 con 0x7f86f4143230 2023-11-16T02:30:11.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:11.924+0000 7f86faeb2640 1 -- 172.21.15.28:0/675810895 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f86f404e8a0 con 0x7f86f4143230 2023-11-16T02:30:12.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.612+0000 7f86f17fa640 1 -- 172.21.15.28:0/675810895 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f86ec054a50 con 0x7f86f4143230 2023-11-16T02:30:12.615 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data' removed 2023-11-16T02:30:12.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.616+0000 7f86faeb2640 1 -- 172.21.15.28:0/675810895 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f86e0065a60 msgr2=0x7f86e0067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:12.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.616+0000 7f86faeb2640 1 --2- 172.21.15.28:0/675810895 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f86e0065a60 0x7f86e0067f20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f86e4006b20 tx=0x7f86e4008040 comp rx=0 tx=0).stop 2023-11-16T02:30:12.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.616+0000 7f86faeb2640 1 -- 172.21.15.28:0/675810895 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86f4143230 msgr2=0x7f86f413ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:12.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.616+0000 7f86faeb2640 1 --2- 172.21.15.28:0/675810895 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86f4143230 0x7f86f413ae20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f86ec007d40 tx=0x7f86ec00e4b0 comp rx=0 tx=0).stop 2023-11-16T02:30:12.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.616+0000 7f86faeb2640 1 -- 172.21.15.28:0/675810895 shutdown_connections 2023-11-16T02:30:12.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.616+0000 7f86faeb2640 1 --2- 172.21.15.28:0/675810895 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f86e0065a60 0x7f86e0067f20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:12.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.616+0000 7f86faeb2640 1 --2- 172.21.15.28:0/675810895 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86f4143230 0x7f86f413ae20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:12.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.616+0000 7f86faeb2640 1 --2- 172.21.15.28:0/675810895 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f86f40b7b00 0x7f86f41e7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:12.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.616+0000 7f86faeb2640 1 --2- 172.21.15.28:0/675810895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f86f40b36d0 0x7f86f4147a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:12.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.616+0000 7f86faeb2640 1 -- 172.21.15.28:0/675810895 >> 172.21.15.28:0/675810895 conn(0x7f86f40bc070 msgr2=0x7f86f4140ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:12.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.616+0000 7f86faeb2640 1 -- 172.21.15.28:0/675810895 shutdown_connections 2023-11-16T02:30:12.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.616+0000 7f86faeb2640 1 -- 172.21.15.28:0/675810895 wait complete. 2023-11-16T02:30:12.643 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-16T02:30:12.643 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-16T02:30:12.643 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-16T02:30:12.643 INFO:teuthology.orchestra.run:waiting for 300 2023-11-16T02:30:12.644 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-16T02:30:12.644 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-16T02:30:12.644 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-16T02:30:12.644 INFO:teuthology.orchestra.run:waiting for 300 2023-11-16T02:30:12.644 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-16T02:30:12.644 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-16T02:30:12.644 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-16T02:30:12.645 INFO:teuthology.orchestra.run:waiting for 300 2023-11-16T02:30:12.658 INFO:tasks.ceph.mds.a:Stopped 2023-11-16T02:30:12.658 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-16T02:30:12.660 INFO:tasks.ceph.mds.c:Stopped 2023-11-16T02:30:12.660 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-16T02:30:12.663 INFO:tasks.ceph.mds.b:Stopped 2023-11-16T02:30:12.663 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-16T02:30:12.704 INFO:tasks.ceph.mds.a:Started 2023-11-16T02:30:12.705 DEBUG:teuthology.parallel:result is None 2023-11-16T02:30:12.706 INFO:tasks.ceph.mds.c:Started 2023-11-16T02:30:12.706 DEBUG:teuthology.parallel:result is None 2023-11-16T02:30:12.706 INFO:tasks.ceph.mds.b:Started 2023-11-16T02:30:12.706 DEBUG:teuthology.parallel:result is None 2023-11-16T02:30:12.707 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-16T02:30:12.771 INFO:tasks.ceph.mds.b.smithi070.stdout:starting mds.b at 2023-11-16T02:30:12.772 INFO:tasks.ceph.mds.a.smithi028.stdout:starting mds.a at 2023-11-16T02:30:12.772 INFO:tasks.ceph.mds.c.smithi028.stdout:starting mds.c at 2023-11-16T02:30:12.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.836+0000 7f1bb85a7640 1 Processor -- start 2023-11-16T02:30:12.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.836+0000 7f1bb85a7640 1 -- start start 2023-11-16T02:30:12.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.836+0000 7f1bb85a7640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1bb00b50c0 0x7f1bb00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:12.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.836+0000 7f1bb85a7640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bb00b5ff0 con 0x7f1bb0071240 2023-11-16T02:30:12.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.836+0000 7f1bb85a7640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bb0071980 con 0x7f1bb00b4620 2023-11-16T02:30:12.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.836+0000 7f1bb85a7640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bb00bef00 con 0x7f1bb00b50c0 2023-11-16T02:30:12.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.840+0000 7f1bb6343640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f1bb0071240 0x7f1bb0142850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36922/0 (socket says 172.21.15.28:36922) 2023-11-16T02:30:12.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.840+0000 7f1bb6343640 1 -- 172.21.15.28:0/1007946298 learned_addr learned my addr 172.21.15.28:0/1007946298 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:12.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.840+0000 7f1bb5b42640 1 --2- 172.21.15.28:0/1007946298 >> v2:172.21.15.70:3300/0 conn(0x7f1bb00b50c0 0x7f1bb00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:12.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.840+0000 7f1bb5341640 1 -- 172.21.15.28:0/1007946298 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942521094 0 0) 0x7f1bb00b5ff0 con 0x7f1bb0071240 2023-11-16T02:30:12.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.840+0000 7f1bb5341640 1 -- 172.21.15.28:0/1007946298 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b9c003530 con 0x7f1bb0071240 2023-11-16T02:30:12.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.840+0000 7f1bb5341640 1 -- 172.21.15.28:0/1007946298 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3216299319 0 0) 0x7f1bb0071980 con 0x7f1bb00b4620 2023-11-16T02:30:12.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.840+0000 7f1bb5341640 1 -- 172.21.15.28:0/1007946298 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bb00b5ff0 con 0x7f1bb00b4620 2023-11-16T02:30:12.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.840+0000 7f1bb5b42640 1 -- 172.21.15.28:0/1007946298 >> v1:172.21.15.70:6789/0 conn(0x7f1bb00b4620 legacy=0x7f1bb01531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:12.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.840+0000 7f1bb5b42640 1 -- 172.21.15.28:0/1007946298 >> v1:172.21.15.28:6789/0 conn(0x7f1bb0071240 legacy=0x7f1bb0142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:12.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.840+0000 7f1bb5341640 1 -- 172.21.15.28:0/1007946298 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 887189842 0 0) 0x7f1b9c003530 con 0x7f1bb0071240 2023-11-16T02:30:12.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.840+0000 7f1bb5b42640 1 -- 172.21.15.28:0/1007946298 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb0071c60 con 0x7f1bb00b50c0 2023-11-16T02:30:12.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.840+0000 7f1bb5b42640 1 --2- 172.21.15.28:0/1007946298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bb00b50c0 0x7f1bb00b7820 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1ba00097c0 tx=0x7f1ba001eb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b84474384b4717a server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:12.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.840+0000 7f1bb5341640 1 -- 172.21.15.28:0/1007946298 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac001680 con 0x7f1bb00b50c0 2023-11-16T02:30:12.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.840+0000 7f1bb5341640 1 -- 172.21.15.28:0/1007946298 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba00a8610 con 0x7f1bb00b50c0 2023-11-16T02:30:12.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.840+0000 7f1bb5341640 1 -- 172.21.15.28:0/1007946298 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba00a89a0 con 0x7f1bb00b50c0 2023-11-16T02:30:12.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.840+0000 7f1bb85a7640 1 -- 172.21.15.28:0/1007946298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bb00b50c0 msgr2=0x7f1bb00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:12.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.840+0000 7f1bb85a7640 1 --2- 172.21.15.28:0/1007946298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bb00b50c0 0x7f1bb00b7820 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1ba00097c0 tx=0x7f1ba001eb90 comp rx=0 tx=0).stop 2023-11-16T02:30:12.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.840+0000 7f1bb85a7640 1 -- 172.21.15.28:0/1007946298 shutdown_connections 2023-11-16T02:30:12.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.840+0000 7f1bb85a7640 1 --2- 172.21.15.28:0/1007946298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bb00b50c0 0x7f1bb00b7820 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:12.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.840+0000 7f1bb85a7640 1 -- 172.21.15.28:0/1007946298 >> 172.21.15.28:0/1007946298 conn(0x7f1bb00be1d0 msgr2=0x7f1bb00be5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:12.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.840+0000 7f1bb85a7640 1 -- 172.21.15.28:0/1007946298 shutdown_connections 2023-11-16T02:30:12.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.840+0000 7f1bb85a7640 1 -- 172.21.15.28:0/1007946298 wait complete. 2023-11-16T02:30:12.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.844+0000 7f1bb85a7640 1 Processor -- start 2023-11-16T02:30:12.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.844+0000 7f1bb85a7640 1 -- start start 2023-11-16T02:30:12.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.844+0000 7f1bb85a7640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1bb0071240 0x7f1bb014bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:12.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.844+0000 7f1bb85a7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bb00b4620 0x7f1bb0143a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:12.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.844+0000 7f1bb85a7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bb00b50c0 0x7f1bb01e1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:12.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.844+0000 7f1bb85a7640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb013b130 con 0x7f1bb00b50c0 2023-11-16T02:30:12.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.844+0000 7f1bb85a7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb014b7b0 con 0x7f1bb00b4620 2023-11-16T02:30:12.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.844+0000 7f1bb85a7640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb01440d0 con 0x7f1bb0071240 2023-11-16T02:30:12.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.844+0000 7f1bb6b44640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bb00b50c0 0x7f1bb01e1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:12.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.844+0000 7f1bb6b44640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bb00b50c0 0x7f1bb01e1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50602/0 (socket says 172.21.15.28:50602) 2023-11-16T02:30:12.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.844+0000 7f1bb6b44640 1 -- 172.21.15.28:0/3697857424 learned_addr learned my addr 172.21.15.28:0/3697857424 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:12.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.844+0000 7f1bb5b42640 1 --2- 172.21.15.28:0/3697857424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bb00b4620 0x7f1bb0143a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:12.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.844+0000 7f1bb6343640 1 --2- 172.21.15.28:0/3697857424 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1bb0071240 0x7f1bb014bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:12.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.844+0000 7f1bb6b44640 1 -- 172.21.15.28:0/3697857424 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1bb0071240 msgr2=0x7f1bb014bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:12.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.844+0000 7f1bb6b44640 1 --2- 172.21.15.28:0/3697857424 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1bb0071240 0x7f1bb014bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:12.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.844+0000 7f1bb6b44640 1 -- 172.21.15.28:0/3697857424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bb00b4620 msgr2=0x7f1bb0143a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:12.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.844+0000 7f1bb6b44640 1 --2- 172.21.15.28:0/3697857424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bb00b4620 0x7f1bb0143a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:12.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.844+0000 7f1bb6b44640 1 -- 172.21.15.28:0/3697857424 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba0009420 con 0x7f1bb00b50c0 2023-11-16T02:30:12.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.844+0000 7f1bb6b44640 1 --2- 172.21.15.28:0/3697857424 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bb00b50c0 0x7f1bb01e1120 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1ba800c7c0 tx=0x7f1ba800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:12.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.844+0000 7f1ba6ffd640 1 -- 172.21.15.28:0/3697857424 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba8003b80 con 0x7f1bb00b50c0 2023-11-16T02:30:12.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.844+0000 7f1ba6ffd640 1 -- 172.21.15.28:0/3697857424 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba8003ce0 con 0x7f1bb00b50c0 2023-11-16T02:30:12.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.844+0000 7f1bb85a7640 1 -- 172.21.15.28:0/3697857424 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bb013b380 con 0x7f1bb00b50c0 2023-11-16T02:30:12.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.844+0000 7f1ba6ffd640 1 -- 172.21.15.28:0/3697857424 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba800a9f0 con 0x7f1bb00b50c0 2023-11-16T02:30:12.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.844+0000 7f1bb85a7640 1 -- 172.21.15.28:0/3697857424 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb014cb40 con 0x7f1bb00b50c0 2023-11-16T02:30:12.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.844+0000 7f1bb85a7640 1 -- 172.21.15.28:0/3697857424 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bb013b5c0 con 0x7f1bb00b50c0 2023-11-16T02:30:12.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.844+0000 7f1ba6ffd640 1 -- 172.21.15.28:0/3697857424 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1ba800ab50 con 0x7f1bb00b50c0 2023-11-16T02:30:12.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.848+0000 7f1ba6ffd640 1 --2- 172.21.15.28:0/3697857424 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1b94065a60 0x7f1b94067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:12.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.848+0000 7f1ba6ffd640 1 -- 172.21.15.28:0/3697857424 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1ba8082be0 con 0x7f1bb00b50c0 2023-11-16T02:30:12.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.848+0000 7f1bb6343640 1 --2- 172.21.15.28:0/3697857424 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1b94065a60 0x7f1b94067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:12.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.848+0000 7f1bb6343640 1 --2- 172.21.15.28:0/3697857424 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1b94065a60 0x7f1b94067f20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1bac000f70 tx=0x7f1bac0016c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:12.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:12.852+0000 7f1ba6ffd640 1 -- 172.21.15.28:0/3697857424 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f1ba8050940 con 0x7f1bb00b50c0 2023-11-16T02:30:13.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.020+0000 7f1bb85a7640 1 -- 172.21.15.28:0/3697857424 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1bb0066e80 con 0x7f1bb00b50c0 2023-11-16T02:30:13.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.812+0000 7f1ba6ffd640 1 -- 172.21.15.28:0/3697857424 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1ba8053f60 con 0x7f1bb00b50c0 2023-11-16T02:30:13.813 INFO:teuthology.orchestra.run.smithi028.stderr: removed all blocklist entries 2023-11-16T02:30:13.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.812+0000 7f1bb85a7640 1 -- 172.21.15.28:0/3697857424 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1b94065a60 msgr2=0x7f1b94067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:13.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.812+0000 7f1bb85a7640 1 --2- 172.21.15.28:0/3697857424 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1b94065a60 0x7f1b94067f20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1bac000f70 tx=0x7f1bac0016c0 comp rx=0 tx=0).stop 2023-11-16T02:30:13.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.812+0000 7f1bb85a7640 1 -- 172.21.15.28:0/3697857424 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bb00b50c0 msgr2=0x7f1bb01e1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:13.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.812+0000 7f1bb85a7640 1 --2- 172.21.15.28:0/3697857424 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bb00b50c0 0x7f1bb01e1120 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1ba800c7c0 tx=0x7f1ba800cc80 comp rx=0 tx=0).stop 2023-11-16T02:30:13.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.816+0000 7f1bb85a7640 1 -- 172.21.15.28:0/3697857424 shutdown_connections 2023-11-16T02:30:13.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.816+0000 7f1bb85a7640 1 --2- 172.21.15.28:0/3697857424 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1b94065a60 0x7f1b94067f20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:13.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.816+0000 7f1bb85a7640 1 --2- 172.21.15.28:0/3697857424 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1bb00b50c0 0x7f1bb01e1120 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:13.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.816+0000 7f1bb85a7640 1 --2- 172.21.15.28:0/3697857424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bb00b4620 0x7f1bb0143a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:13.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.816+0000 7f1bb85a7640 1 --2- 172.21.15.28:0/3697857424 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1bb0071240 0x7f1bb014bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:13.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.816+0000 7f1bb85a7640 1 -- 172.21.15.28:0/3697857424 >> 172.21.15.28:0/3697857424 conn(0x7f1bb00be1d0 msgr2=0x7f1bb00731d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:13.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.816+0000 7f1bb85a7640 1 -- 172.21.15.28:0/3697857424 shutdown_connections 2023-11-16T02:30:13.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.816+0000 7f1bb85a7640 1 -- 172.21.15.28:0/3697857424 wait complete. 2023-11-16T02:30:13.840 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-16T02:30:13.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.956+0000 7fdde31f5640 1 Processor -- start 2023-11-16T02:30:13.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.956+0000 7fdde31f5640 1 -- start start 2023-11-16T02:30:13.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.960+0000 7fdde31f5640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdddc0b86d0 0x7fdddc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:13.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.960+0000 7fdde31f5640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdddc06c260 con 0x7fdddc1446a0 2023-11-16T02:30:13.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.960+0000 7fdde31f5640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdddc0ba470 con 0x7fdddc14b710 2023-11-16T02:30:13.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.960+0000 7fdde31f5640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc0ba6e0 con 0x7fdddc0b86d0 2023-11-16T02:30:13.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.960+0000 7fdddbfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fdddc1446a0 0x7fdddc14b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36924/0 (socket says 172.21.15.28:36924) 2023-11-16T02:30:13.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.960+0000 7fdddbfff640 1 -- 172.21.15.28:0/3821134879 learned_addr learned my addr 172.21.15.28:0/3821134879 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:13.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.960+0000 7fdde0f91640 1 --2- 172.21.15.28:0/3821134879 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdddc0b86d0 0x7fdddc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:13.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.960+0000 7fdddb7fe640 1 -- 172.21.15.28:0/3821134879 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1688977298 0 0) 0x7fdddc06c260 con 0x7fdddc1446a0 2023-11-16T02:30:13.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.960+0000 7fdddb7fe640 1 -- 172.21.15.28:0/3821134879 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddc4003530 con 0x7fdddc1446a0 2023-11-16T02:30:13.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.960+0000 7fdddb7fe640 1 -- 172.21.15.28:0/3821134879 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 293150897 0 0) 0x7fdddc0ba470 con 0x7fdddc14b710 2023-11-16T02:30:13.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.960+0000 7fdddb7fe640 1 -- 172.21.15.28:0/3821134879 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdddc06c260 con 0x7fdddc14b710 2023-11-16T02:30:13.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.960+0000 7fdddb7fe640 1 -- 172.21.15.28:0/3821134879 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4107189672 0 0) 0x7fddc4003530 con 0x7fdddc1446a0 2023-11-16T02:30:13.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.960+0000 7fdde0f91640 1 -- 172.21.15.28:0/3821134879 >> v1:172.21.15.70:6789/0 conn(0x7fdddc14b710 legacy=0x7fdddc1553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:13.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.960+0000 7fdde0f91640 1 -- 172.21.15.28:0/3821134879 >> v1:172.21.15.28:6789/0 conn(0x7fdddc1446a0 legacy=0x7fdddc14b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:13.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.960+0000 7fdde0f91640 1 -- 172.21.15.28:0/3821134879 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc14aae0 con 0x7fdddc0b86d0 2023-11-16T02:30:13.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.960+0000 7fdde0f91640 1 --2- 172.21.15.28:0/3821134879 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdddc0b86d0 0x7fdddc0b8ab0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fddcc0097f0 tx=0x7fddcc01c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef7e10df3d16c541 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:13.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdddb7fe640 1 -- 172.21.15.28:0/3821134879 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0001680 con 0x7fdddc0b86d0 2023-11-16T02:30:13.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdddb7fe640 1 -- 172.21.15.28:0/3821134879 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddcc0a7050 con 0x7fdddc0b86d0 2023-11-16T02:30:13.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdddb7fe640 1 -- 172.21.15.28:0/3821134879 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc004230 con 0x7fdddc0b86d0 2023-11-16T02:30:13.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdde31f5640 1 -- 172.21.15.28:0/3821134879 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdddc0b86d0 msgr2=0x7fdddc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:13.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdde31f5640 1 --2- 172.21.15.28:0/3821134879 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdddc0b86d0 0x7fdddc0b8ab0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fddcc0097f0 tx=0x7fddcc01c3b0 comp rx=0 tx=0).stop 2023-11-16T02:30:13.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdde31f5640 1 -- 172.21.15.28:0/3821134879 shutdown_connections 2023-11-16T02:30:13.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdde31f5640 1 --2- 172.21.15.28:0/3821134879 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdddc0b86d0 0x7fdddc0b8ab0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:13.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdde31f5640 1 -- 172.21.15.28:0/3821134879 >> 172.21.15.28:0/3821134879 conn(0x7fdddc06b770 msgr2=0x7fdddc06bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:13.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdde31f5640 1 -- 172.21.15.28:0/3821134879 shutdown_connections 2023-11-16T02:30:13.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdde31f5640 1 -- 172.21.15.28:0/3821134879 wait complete. 2023-11-16T02:30:13.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdde31f5640 1 Processor -- start 2023-11-16T02:30:13.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdde31f5640 1 -- start start 2023-11-16T02:30:13.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdde31f5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdddc1446a0 0x7fdddc14c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:13.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdde31f5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdddc14b710 0x7fdddc1366a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:13.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdde31f5640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdddc139650 0x7fdddc14dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:13.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdde31f5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc14a4b0 con 0x7fdddc14b710 2023-11-16T02:30:13.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdde31f5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc136210 con 0x7fdddc1446a0 2023-11-16T02:30:13.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdde31f5640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc13a150 con 0x7fdddc139650 2023-11-16T02:30:13.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdddbfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdddc14b710 0x7fdddc1366a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:13.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdddbfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdddc14b710 0x7fdddc1366a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50616/0 (socket says 172.21.15.28:50616) 2023-11-16T02:30:13.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdddbfff640 1 -- 172.21.15.28:0/1806938025 learned_addr learned my addr 172.21.15.28:0/1806938025 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:13.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdde1792640 1 --2- 172.21.15.28:0/1806938025 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdddc139650 0x7fdddc14dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:13.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdde0f91640 1 --2- 172.21.15.28:0/1806938025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdddc1446a0 0x7fdddc14c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:13.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdddbfff640 1 -- 172.21.15.28:0/1806938025 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdddc139650 msgr2=0x7fdddc14dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:13.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdddbfff640 1 --2- 172.21.15.28:0/1806938025 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdddc139650 0x7fdddc14dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:13.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdddbfff640 1 -- 172.21.15.28:0/1806938025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdddc1446a0 msgr2=0x7fdddc14c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:13.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdddbfff640 1 --2- 172.21.15.28:0/1806938025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdddc1446a0 0x7fdddc14c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:13.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdddbfff640 1 -- 172.21.15.28:0/1806938025 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc009420 con 0x7fdddc14b710 2023-11-16T02:30:13.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdde0f91640 1 --2- 172.21.15.28:0/1806938025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdddc1446a0 0x7fdddc14c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:30:13.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdddbfff640 1 --2- 172.21.15.28:0/1806938025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdddc14b710 0x7fdddc1366a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fddd000c7a0 tx=0x7fddd000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:13.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fddd97fa640 1 -- 172.21.15.28:0/1806938025 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0005cf0 con 0x7fdddc14b710 2023-11-16T02:30:13.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fddd97fa640 1 -- 172.21.15.28:0/1806938025 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd0005e50 con 0x7fdddc14b710 2023-11-16T02:30:13.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdde31f5640 1 -- 172.21.15.28:0/1806938025 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdddc139ab0 con 0x7fdddc14b710 2023-11-16T02:30:13.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fddd97fa640 1 -- 172.21.15.28:0/1806938025 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0007270 con 0x7fdddc14b710 2023-11-16T02:30:13.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.964+0000 7fdde31f5640 1 -- 172.21.15.28:0/1806938025 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdddc14ee40 con 0x7fdddc14b710 2023-11-16T02:30:13.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.968+0000 7fdde31f5640 1 -- 172.21.15.28:0/1806938025 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdddc04e8a0 con 0x7fdddc14b710 2023-11-16T02:30:13.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.968+0000 7fddd97fa640 1 -- 172.21.15.28:0/1806938025 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fddd00073d0 con 0x7fdddc14b710 2023-11-16T02:30:13.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.968+0000 7fddd97fa640 1 --2- 172.21.15.28:0/1806938025 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fddc8065a90 0x7fddc8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:13.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.968+0000 7fdde0f91640 1 --2- 172.21.15.28:0/1806938025 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fddc8065a90 0x7fddc8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:13.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.968+0000 7fddd97fa640 1 -- 172.21.15.28:0/1806938025 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fddd0082c10 con 0x7fdddc14b710 2023-11-16T02:30:13.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.968+0000 7fdde0f91640 1 --2- 172.21.15.28:0/1806938025 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fddc8065a90 0x7fddc8067f50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fddcc0ad000 tx=0x7fddcc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:13.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:13.972+0000 7fddd97fa640 1 -- 172.21.15.28:0/1806938025 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fddd0050990 con 0x7fdddc14b710 2023-11-16T02:30:14.185 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.184+0000 7fdde31f5640 1 -- 172.21.15.28:0/1806938025 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fdddc136350 con 0x7fdddc14b710 2023-11-16T02:30:14.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.184+0000 7fddd97fa640 1 -- 172.21.15.28:0/1806938025 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+5491 (secure 0 0 0) 0x7fddd0053fb0 con 0x7fdddc14b710 2023-11-16T02:30:14.186 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:30:14.186 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2023-11-16T02:30:14.186 INFO:teuthology.orchestra.run.smithi028.stdout: "auth_dump": [ 2023-11-16T02:30:14.186 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-16T02:30:14.186 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mds.a", 2023-11-16T02:30:14.186 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBUflVljiWUMxAA+sE7u7qHhK7hDwKgtVxb6g==", 2023-11-16T02:30:14.187 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-16T02:30:14.187 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2023-11-16T02:30:14.187 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2023-11-16T02:30:14.187 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2023-11-16T02:30:14.187 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-16T02:30:14.187 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-16T02:30:14.187 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-16T02:30:14.187 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-16T02:30:14.187 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mds.b", 2023-11-16T02:30:14.187 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBVflVlUEdGBhAANpvXXd/EtwwYy6Ko+T0NFQ==", 2023-11-16T02:30:14.187 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-16T02:30:14.188 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2023-11-16T02:30:14.188 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2023-11-16T02:30:14.188 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2023-11-16T02:30:14.188 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-16T02:30:14.188 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-16T02:30:14.188 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-16T02:30:14.188 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-16T02:30:14.188 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mds.c", 2023-11-16T02:30:14.188 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBVflVlBYhhABAA7jEAy16KdHWtJ5/qz/IAng==", 2023-11-16T02:30:14.188 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-16T02:30:14.188 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2023-11-16T02:30:14.188 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2023-11-16T02:30:14.189 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2023-11-16T02:30:14.189 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-16T02:30:14.189 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-16T02:30:14.189 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-16T02:30:14.189 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-16T02:30:14.189 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.0", 2023-11-16T02:30:14.189 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBWflVlM/B9ExAAu7SJYp5M6O2OvenymzoHVw==", 2023-11-16T02:30:14.189 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-16T02:30:14.189 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-11-16T02:30:14.189 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-11-16T02:30:14.189 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-16T02:30:14.189 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-16T02:30:14.190 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-16T02:30:14.190 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-16T02:30:14.190 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.1", 2023-11-16T02:30:14.190 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBZflVlJ1uuGRAAKCxqUgMnSi/p3iAAURnb7Q==", 2023-11-16T02:30:14.190 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-16T02:30:14.190 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-11-16T02:30:14.190 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-11-16T02:30:14.190 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-16T02:30:14.190 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-16T02:30:14.190 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-16T02:30:14.190 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-16T02:30:14.190 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.2", 2023-11-16T02:30:14.191 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBcflVlcdBmIhAARpMHKX07S4dUI0J4Wkmx2A==", 2023-11-16T02:30:14.191 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-16T02:30:14.191 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-11-16T02:30:14.191 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-11-16T02:30:14.191 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-16T02:30:14.191 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-16T02:30:14.191 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-16T02:30:14.191 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-16T02:30:14.191 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.3", 2023-11-16T02:30:14.191 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBfflVlcBJOKxAAfjVg3ry29k5y9EasXHKDWw==", 2023-11-16T02:30:14.191 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-16T02:30:14.191 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-11-16T02:30:14.191 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-11-16T02:30:14.192 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-16T02:30:14.192 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-16T02:30:14.192 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-16T02:30:14.192 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-16T02:30:14.192 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.4", 2023-11-16T02:30:14.192 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBjflVlqamPNRAAMHO6wtCJ0Rs+m3YufYtpoQ==", 2023-11-16T02:30:14.192 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-16T02:30:14.192 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-11-16T02:30:14.192 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-11-16T02:30:14.192 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-16T02:30:14.192 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-16T02:30:14.192 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-16T02:30:14.193 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-16T02:30:14.193 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.5", 2023-11-16T02:30:14.193 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBoflVlKtzaKxAAltnkDv0/qsyMY9+z1lgAgg==", 2023-11-16T02:30:14.193 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-16T02:30:14.193 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-11-16T02:30:14.193 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-11-16T02:30:14.193 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-16T02:30:14.193 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-16T02:30:14.193 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-16T02:30:14.193 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-16T02:30:14.193 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.6", 2023-11-16T02:30:14.193 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBrflVlARn8MxAAs7740VTYxmaXjLTEj78B3g==", 2023-11-16T02:30:14.194 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-16T02:30:14.194 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-11-16T02:30:14.194 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-11-16T02:30:14.194 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-16T02:30:14.194 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-16T02:30:14.194 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-16T02:30:14.194 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-16T02:30:14.194 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.7", 2023-11-16T02:30:14.194 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBvflVlBqaGABAAw0/Ul/uJhGBfFmIxjp7iVw==", 2023-11-16T02:30:14.194 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-16T02:30:14.194 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-11-16T02:30:14.194 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-11-16T02:30:14.195 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-16T02:30:14.195 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-16T02:30:14.195 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-16T02:30:14.195 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-16T02:30:14.195 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.0", 2023-11-16T02:30:14.195 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBVflVlOOSiDBAA3p61o2obsK9XJScqqKRstA==", 2023-11-16T02:30:14.195 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-16T02:30:14.195 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2023-11-16T02:30:14.195 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow r", 2023-11-16T02:30:14.195 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow rw", 2023-11-16T02:30:14.195 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow rwx" 2023-11-16T02:30:14.195 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-16T02:30:14.196 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-16T02:30:14.196 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-16T02:30:14.196 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.admin", 2023-11-16T02:30:14.196 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBUflVlX9NKFxAA4p7Zp8Uf7upt8EYYFgRbcg==", 2023-11-16T02:30:14.196 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-16T02:30:14.196 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow *", 2023-11-16T02:30:14.196 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2023-11-16T02:30:14.196 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2023-11-16T02:30:14.196 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-16T02:30:14.196 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-16T02:30:14.196 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-16T02:30:14.196 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-16T02:30:14.197 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.bootstrap-mds", 2023-11-16T02:30:14.197 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQB5flVltQB2KhAAERBVUoAFROHnWXq3tJatKA==", 2023-11-16T02:30:14.197 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-16T02:30:14.197 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile bootstrap-mds" 2023-11-16T02:30:14.197 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-16T02:30:14.197 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-16T02:30:14.197 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-16T02:30:14.197 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.bootstrap-mgr", 2023-11-16T02:30:14.197 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQB5flVlhBt2KhAAdzEFU1tSeRoDf4rjaWJITg==", 2023-11-16T02:30:14.197 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-16T02:30:14.197 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-16T02:30:14.197 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-16T02:30:14.198 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-16T02:30:14.198 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-16T02:30:14.198 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.bootstrap-osd", 2023-11-16T02:30:14.198 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQB5flVlujJ2KhAABdYyCLyPvgSHNZsKghrxuA==", 2023-11-16T02:30:14.198 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-16T02:30:14.198 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile bootstrap-osd" 2023-11-16T02:30:14.198 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-16T02:30:14.198 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-16T02:30:14.198 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-16T02:30:14.198 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.bootstrap-rbd", 2023-11-16T02:30:14.198 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQB5flVlJ0p2KhAA3KZZhM8Ty1tHuZfw32RHoQ==", 2023-11-16T02:30:14.199 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-16T02:30:14.199 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-16T02:30:14.199 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-16T02:30:14.199 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-16T02:30:14.199 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-16T02:30:14.199 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-16T02:30:14.199 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQB5flVlmmJ2KhAAtEXptD+EzHiaZJNV19gB0w==", 2023-11-16T02:30:14.199 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-16T02:30:14.199 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-16T02:30:14.199 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-16T02:30:14.199 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-16T02:30:14.199 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-16T02:30:14.199 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.bootstrap-rgw", 2023-11-16T02:30:14.200 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQB5flVl7Hl2KhAAQcu/RYx4gCJUags6vMPVDQ==", 2023-11-16T02:30:14.200 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-16T02:30:14.200 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-16T02:30:14.200 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-16T02:30:14.200 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-16T02:30:14.200 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-16T02:30:14.200 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mgr.x", 2023-11-16T02:30:14.200 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBUflVlCH4rMBAAQffwun5A4cYlRyJZSV5ZGg==", 2023-11-16T02:30:14.200 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-16T02:30:14.200 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow *", 2023-11-16T02:30:14.200 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile mgr", 2023-11-16T02:30:14.200 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-16T02:30:14.201 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-16T02:30:14.201 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-16T02:30:14.201 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-16T02:30:14.201 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mgr.y", 2023-11-16T02:30:14.201 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQBUflVl3zeeLRAAucjaGZ6mcrghNmwmpurSJQ==", 2023-11-16T02:30:14.201 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-16T02:30:14.201 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow *", 2023-11-16T02:30:14.201 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile mgr", 2023-11-16T02:30:14.201 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-16T02:30:14.201 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-16T02:30:14.201 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-16T02:30:14.201 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2023-11-16T02:30:14.202 INFO:teuthology.orchestra.run.smithi028.stdout:} 2023-11-16T02:30:14.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.188+0000 7fdde31f5640 1 -- 172.21.15.28:0/1806938025 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fddc8065a90 msgr2=0x7fddc8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:14.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.188+0000 7fdde31f5640 1 --2- 172.21.15.28:0/1806938025 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fddc8065a90 0x7fddc8067f50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fddcc0ad000 tx=0x7fddcc008040 comp rx=0 tx=0).stop 2023-11-16T02:30:14.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.188+0000 7fdde31f5640 1 -- 172.21.15.28:0/1806938025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdddc14b710 msgr2=0x7fdddc1366a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:14.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.188+0000 7fdde31f5640 1 --2- 172.21.15.28:0/1806938025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdddc14b710 0x7fdddc1366a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fddd000c7a0 tx=0x7fddd000cc60 comp rx=0 tx=0).stop 2023-11-16T02:30:14.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.188+0000 7fdde31f5640 1 -- 172.21.15.28:0/1806938025 shutdown_connections 2023-11-16T02:30:14.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.188+0000 7fdde31f5640 1 --2- 172.21.15.28:0/1806938025 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fddc8065a90 0x7fddc8067f50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:14.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.188+0000 7fdde31f5640 1 --2- 172.21.15.28:0/1806938025 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdddc139650 0x7fdddc14dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:14.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.188+0000 7fdde31f5640 1 --2- 172.21.15.28:0/1806938025 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdddc14b710 0x7fdddc1366a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:14.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.188+0000 7fdde31f5640 1 --2- 172.21.15.28:0/1806938025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdddc1446a0 0x7fdddc14c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:14.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.188+0000 7fdde31f5640 1 -- 172.21.15.28:0/1806938025 >> 172.21.15.28:0/1806938025 conn(0x7fdddc06b770 msgr2=0x7fdddc1438e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:14.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.188+0000 7fdde31f5640 1 -- 172.21.15.28:0/1806938025 shutdown_connections 2023-11-16T02:30:14.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.188+0000 7fdde31f5640 1 -- 172.21.15.28:0/1806938025 wait complete. 2023-11-16T02:30:14.205 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-16T02:30:14.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.332+0000 7f27b7245640 1 Processor -- start 2023-11-16T02:30:14.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.332+0000 7f27b7245640 1 -- start start 2023-11-16T02:30:14.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27b7245640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f27b006a3d0 0x7f27b0071000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:14.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27b7245640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27b0147de0 con 0x7f27b006edb0 2023-11-16T02:30:14.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27b7245640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27b0071740 con 0x7f27b0141890 2023-11-16T02:30:14.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27b7245640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27b0071540 con 0x7f27b006a3d0 2023-11-16T02:30:14.336 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27affff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f27b006edb0 0x7f27b0148270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36930/0 (socket says 172.21.15.28:36930) 2023-11-16T02:30:14.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27affff640 1 -- 172.21.15.28:0/2454891927 learned_addr learned my addr 172.21.15.28:0/2454891927 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:14.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27b4fe1640 1 --2- 172.21.15.28:0/2454891927 >> v2:172.21.15.70:3300/0 conn(0x7f27b006a3d0 0x7f27b0071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:14.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27af7fe640 1 -- 172.21.15.28:0/2454891927 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3332660529 0 0) 0x7f27b0147de0 con 0x7f27b006edb0 2023-11-16T02:30:14.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27af7fe640 1 -- 172.21.15.28:0/2454891927 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2798003530 con 0x7f27b006edb0 2023-11-16T02:30:14.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27af7fe640 1 -- 172.21.15.28:0/2454891927 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 421089769 0 0) 0x7f2798003530 con 0x7f27b006edb0 2023-11-16T02:30:14.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27af7fe640 1 -- 172.21.15.28:0/2454891927 >> v2:172.21.15.70:3300/0 conn(0x7f27b006a3d0 msgr2=0x7f27b0071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:14.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27af7fe640 1 --2- 172.21.15.28:0/2454891927 >> v2:172.21.15.70:3300/0 conn(0x7f27b006a3d0 0x7f27b0071000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:14.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27af7fe640 1 -- 172.21.15.28:0/2454891927 >> v1:172.21.15.70:6789/0 conn(0x7f27b0141890 legacy=0x7f27b0152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:14.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27af7fe640 1 -- 172.21.15.28:0/2454891927 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b0147a70 con 0x7f27b006edb0 2023-11-16T02:30:14.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27af7fe640 1 -- 172.21.15.28:0/2454891927 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7f27a4001680 con 0x7f27b006edb0 2023-11-16T02:30:14.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27af7fe640 1 -- 172.21.15.28:0/2454891927 >> v1:172.21.15.28:6789/0 conn(0x7f27b006edb0 legacy=0x7f27b0148270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:14.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27af7fe640 1 --2- 172.21.15.28:0/2454891927 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2798003980 0x7f2798003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:14.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27af7fe640 1 --2- 172.21.15.28:0/2454891927 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f27980047d0 0x7f2798004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:14.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27af7fe640 1 --2- 172.21.15.28:0/2454891927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2798005190 0x7f279800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:14.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27af7fe640 1 -- 172.21.15.28:0/2454891927 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b0071540 con 0x7f2798003980 2023-11-16T02:30:14.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27af7fe640 1 -- 172.21.15.28:0/2454891927 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279800c030 con 0x7f2798005190 2023-11-16T02:30:14.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27af7fe640 1 -- 172.21.15.28:0/2454891927 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279800c1f0 con 0x7f27980047d0 2023-11-16T02:30:14.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27b4fe1640 1 --2- 172.21.15.28:0/2454891927 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2798003980 0x7f2798003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:14.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27b57e2640 1 --2- 172.21.15.28:0/2454891927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2798005190 0x7f279800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:14.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27affff640 1 --2- 172.21.15.28:0/2454891927 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f27980047d0 0x7f2798004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:14.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27b4fe1640 1 -- 172.21.15.28:0/2454891927 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f27980047d0 msgr2=0x7f2798004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:14.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27b4fe1640 1 --2- 172.21.15.28:0/2454891927 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f27980047d0 0x7f2798004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:14.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27b4fe1640 1 -- 172.21.15.28:0/2454891927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2798005190 msgr2=0x7f279800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:14.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27b4fe1640 1 --2- 172.21.15.28:0/2454891927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2798005190 0x7f279800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:14.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27b4fe1640 1 -- 172.21.15.28:0/2454891927 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2798003530 con 0x7f2798003980 2023-11-16T02:30:14.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27b57e2640 1 --2- 172.21.15.28:0/2454891927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2798005190 0x7f279800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:14.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.336+0000 7f27b57e2640 1 -- 172.21.15.28:0/2454891927 reap_dead start 2023-11-16T02:30:14.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b4fe1640 1 --2- 172.21.15.28:0/2454891927 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2798003980 0x7f2798003da0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f27a0009ae0 tx=0x7f27a001c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34d19790855b135 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:14.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27af7fe640 1 -- 172.21.15.28:0/2454891927 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a00a4a80 con 0x7f2798003980 2023-11-16T02:30:14.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27af7fe640 1 -- 172.21.15.28:0/2454891927 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a00a4be0 con 0x7f2798003980 2023-11-16T02:30:14.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27af7fe640 1 -- 172.21.15.28:0/2454891927 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a00ac440 con 0x7f2798003980 2023-11-16T02:30:14.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b7245640 1 -- 172.21.15.28:0/2454891927 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2798003980 msgr2=0x7f2798003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:14.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b7245640 1 --2- 172.21.15.28:0/2454891927 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2798003980 0x7f2798003da0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f27a0009ae0 tx=0x7f27a001c730 comp rx=0 tx=0).stop 2023-11-16T02:30:14.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b7245640 1 -- 172.21.15.28:0/2454891927 shutdown_connections 2023-11-16T02:30:14.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b7245640 1 --2- 172.21.15.28:0/2454891927 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2798003980 0x7f2798003da0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:14.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b7245640 1 -- 172.21.15.28:0/2454891927 >> 172.21.15.28:0/2454891927 conn(0x7f27b00bc3e0 msgr2=0x7f27b00bc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:14.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b7245640 1 -- 172.21.15.28:0/2454891927 shutdown_connections 2023-11-16T02:30:14.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b7245640 1 -- 172.21.15.28:0/2454891927 wait complete. 2023-11-16T02:30:14.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b7245640 1 Processor -- start 2023-11-16T02:30:14.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b7245640 1 -- start start 2023-11-16T02:30:14.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b7245640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2798003980 0x7f27b00bb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:14.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b7245640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f27b00bbb80 0x7f27b0142b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:14.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b7245640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f27b0144a10 0x7f27b0143060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:14.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b7245640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b014a400 con 0x7f27b0144a10 2023-11-16T02:30:14.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b7245640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b00bb650 con 0x7f2798003980 2023-11-16T02:30:14.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b7245640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b0144fa0 con 0x7f27b00bbb80 2023-11-16T02:30:14.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b57e2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f27b0144a10 0x7f27b0143060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:14.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b57e2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f27b0144a10 0x7f27b0143060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50638/0 (socket says 172.21.15.28:50638) 2023-11-16T02:30:14.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b57e2640 1 -- 172.21.15.28:0/2616204671 learned_addr learned my addr 172.21.15.28:0/2616204671 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:14.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b4fe1640 1 --2- 172.21.15.28:0/2616204671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2798003980 0x7f27b00bb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:14.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27affff640 1 --2- 172.21.15.28:0/2616204671 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f27b00bbb80 0x7f27b0142b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:14.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b57e2640 1 -- 172.21.15.28:0/2616204671 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f27b00bbb80 msgr2=0x7f27b0142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:14.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b57e2640 1 --2- 172.21.15.28:0/2616204671 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f27b00bbb80 0x7f27b0142b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:14.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b57e2640 1 -- 172.21.15.28:0/2616204671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2798003980 msgr2=0x7f27b00bb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:14.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b57e2640 1 --2- 172.21.15.28:0/2616204671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2798003980 0x7f27b00bb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:14.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b57e2640 1 -- 172.21.15.28:0/2616204671 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b0149db0 con 0x7f27b0144a10 2023-11-16T02:30:14.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b57e2640 1 --2- 172.21.15.28:0/2616204671 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f27b0144a10 0x7f27b0143060 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f27b00b89b0 tx=0x7f27a800d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:14.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27ad7fa640 1 -- 172.21.15.28:0/2616204671 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a8003d90 con 0x7f27b0144a10 2023-11-16T02:30:14.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27ad7fa640 1 -- 172.21.15.28:0/2616204671 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a8005070 con 0x7f27b0144a10 2023-11-16T02:30:14.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b7245640 1 -- 172.21.15.28:0/2616204671 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b014a090 con 0x7f27b0144a10 2023-11-16T02:30:14.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27ad7fa640 1 -- 172.21.15.28:0/2616204671 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a8005420 con 0x7f27b0144a10 2023-11-16T02:30:14.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.340+0000 7f27b7245640 1 -- 172.21.15.28:0/2616204671 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b00b25e0 con 0x7f27b0144a10 2023-11-16T02:30:14.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.344+0000 7f27b7245640 1 -- 172.21.15.28:0/2616204671 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27b0070c90 con 0x7f27b0144a10 2023-11-16T02:30:14.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.344+0000 7f27ad7fa640 1 -- 172.21.15.28:0/2616204671 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f27a8005580 con 0x7f27b0144a10 2023-11-16T02:30:14.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.344+0000 7f27ad7fa640 1 --2- 172.21.15.28:0/2616204671 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f279c065a60 0x7f279c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:14.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.344+0000 7f27ad7fa640 1 -- 172.21.15.28:0/2616204671 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f27a8082690 con 0x7f27b0144a10 2023-11-16T02:30:14.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.344+0000 7f27b4fe1640 1 --2- 172.21.15.28:0/2616204671 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f279c065a60 0x7f279c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:14.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.344+0000 7f27b4fe1640 1 --2- 172.21.15.28:0/2616204671 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f279c065a60 0x7f279c067f20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f27a00ae000 tx=0x7f27a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:14.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.348+0000 7f27ad7fa640 1 -- 172.21.15.28:0/2616204671 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f27b0070c90 con 0x7f27b0144a10 2023-11-16T02:30:14.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.564+0000 7f27b7245640 1 -- 172.21.15.28:0/2616204671 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f27b0070c90 con 0x7f27b0144a10 2023-11-16T02:30:14.572 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.572+0000 7f27ad7fa640 1 -- 172.21.15.28:0/2616204671 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f27b0070c90 con 0x7f27b0144a10 2023-11-16T02:30:14.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.572+0000 7f27b7245640 1 -- 172.21.15.28:0/2616204671 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f279c065a60 msgr2=0x7f279c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:14.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.572+0000 7f27b7245640 1 --2- 172.21.15.28:0/2616204671 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f279c065a60 0x7f279c067f20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f27a00ae000 tx=0x7f27a0008040 comp rx=0 tx=0).stop 2023-11-16T02:30:14.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.572+0000 7f27b7245640 1 -- 172.21.15.28:0/2616204671 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f27b0144a10 msgr2=0x7f27b0143060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:14.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.572+0000 7f27b7245640 1 --2- 172.21.15.28:0/2616204671 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f27b0144a10 0x7f27b0143060 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f27b00b89b0 tx=0x7f27a800d9d0 comp rx=0 tx=0).stop 2023-11-16T02:30:14.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.572+0000 7f27b7245640 1 -- 172.21.15.28:0/2616204671 shutdown_connections 2023-11-16T02:30:14.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.572+0000 7f27b7245640 1 --2- 172.21.15.28:0/2616204671 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f279c065a60 0x7f279c067f20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:14.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.572+0000 7f27b7245640 1 --2- 172.21.15.28:0/2616204671 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f27b0144a10 0x7f27b0143060 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:14.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.572+0000 7f27b7245640 1 --2- 172.21.15.28:0/2616204671 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f27b00bbb80 0x7f27b0142b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:14.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.572+0000 7f27b7245640 1 --2- 172.21.15.28:0/2616204671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2798003980 0x7f27b00bb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:14.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.572+0000 7f27b7245640 1 -- 172.21.15.28:0/2616204671 >> 172.21.15.28:0/2616204671 conn(0x7f27b00bc3e0 msgr2=0x7f27b014b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:14.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.572+0000 7f27b7245640 1 -- 172.21.15.28:0/2616204671 shutdown_connections 2023-11-16T02:30:14.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.572+0000 7f27b7245640 1 -- 172.21.15.28:0/2616204671 wait complete. 2023-11-16T02:30:14.593 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-16T02:30:14.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.708+0000 7fb316eb4640 1 Processor -- start 2023-11-16T02:30:14.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.708+0000 7fb316eb4640 1 -- start start 2023-11-16T02:30:14.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.708+0000 7fb316eb4640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb3101452e0 0x7fb3101566e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:14.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.708+0000 7fb316eb4640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3100b91f0 con 0x7fb3100b7330 2023-11-16T02:30:14.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.708+0000 7fb316eb4640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3100b93c0 con 0x7fb310144f00 2023-11-16T02:30:14.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.708+0000 7fb316eb4640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb31006ab20 con 0x7fb3101452e0 2023-11-16T02:30:14.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.708+0000 7fb315451640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb3101452e0 0x7fb3101566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:14.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.708+0000 7fb315451640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb3101452e0 0x7fb3101566e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50646/0 (socket says 172.21.15.28:50646) 2023-11-16T02:30:14.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.708+0000 7fb315451640 1 -- 172.21.15.28:0/1041892886 learned_addr learned my addr 172.21.15.28:0/1041892886 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:14.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.708+0000 7fb30ffff640 1 --1- 172.21.15.28:0/1041892886 >> v1:172.21.15.28:6789/0 conn(0x7fb3100b7330 0x7fb31006ff20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36932/0 (socket says 172.21.15.28:36932) 2023-11-16T02:30:14.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.712+0000 7fb315451640 1 -- 172.21.15.28:0/1041892886 >> v1:172.21.15.70:6789/0 conn(0x7fb310144f00 legacy=0x7fb31006a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:14.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.712+0000 7fb315451640 1 -- 172.21.15.28:0/1041892886 >> v1:172.21.15.28:6789/0 conn(0x7fb3100b7330 legacy=0x7fb31006ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:14.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.712+0000 7fb315451640 1 -- 172.21.15.28:0/1041892886 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3100b96a0 con 0x7fb3101452e0 2023-11-16T02:30:14.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.712+0000 7fb315451640 1 --2- 172.21.15.28:0/1041892886 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3101452e0 0x7fb3101566e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb308009e50 tx=0x7fb30801f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da23c22bdab614f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:14.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.712+0000 7fb30f7fe640 1 -- 172.21.15.28:0/1041892886 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3080af400 con 0x7fb3101452e0 2023-11-16T02:30:14.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.712+0000 7fb30f7fe640 1 -- 172.21.15.28:0/1041892886 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3080ab050 con 0x7fb3101452e0 2023-11-16T02:30:14.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.712+0000 7fb30f7fe640 1 -- 172.21.15.28:0/1041892886 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3080af780 con 0x7fb3101452e0 2023-11-16T02:30:14.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.712+0000 7fb316eb4640 1 -- 172.21.15.28:0/1041892886 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3101452e0 msgr2=0x7fb3101566e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:14.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.712+0000 7fb316eb4640 1 --2- 172.21.15.28:0/1041892886 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3101452e0 0x7fb3101566e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb308009e50 tx=0x7fb30801f1f0 comp rx=0 tx=0).stop 2023-11-16T02:30:14.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.712+0000 7fb316eb4640 1 -- 172.21.15.28:0/1041892886 shutdown_connections 2023-11-16T02:30:14.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.712+0000 7fb316eb4640 1 --2- 172.21.15.28:0/1041892886 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3101452e0 0x7fb3101566e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:14.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.712+0000 7fb316eb4640 1 -- 172.21.15.28:0/1041892886 >> 172.21.15.28:0/1041892886 conn(0x7fb3100bd0c0 msgr2=0x7fb3100bd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:14.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.712+0000 7fb316eb4640 1 -- 172.21.15.28:0/1041892886 shutdown_connections 2023-11-16T02:30:14.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.712+0000 7fb316eb4640 1 -- 172.21.15.28:0/1041892886 wait complete. 2023-11-16T02:30:14.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.716+0000 7fb316eb4640 1 Processor -- start 2023-11-16T02:30:14.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.716+0000 7fb316eb4640 1 -- start start 2023-11-16T02:30:14.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.716+0000 7fb316eb4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3100b7330 0x7fb3101d4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:14.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.716+0000 7fb316eb4640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb310144f00 0x7fb3101e3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:14.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.716+0000 7fb316eb4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3101452e0 0x7fb3100b98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:14.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.716+0000 7fb316eb4640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3101d4bc0 con 0x7fb3101452e0 2023-11-16T02:30:14.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.716+0000 7fb316eb4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3101e3140 con 0x7fb3100b7330 2023-11-16T02:30:14.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.716+0000 7fb316eb4640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3101d2f10 con 0x7fb310144f00 2023-11-16T02:30:14.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.716+0000 7fb315451640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3101452e0 0x7fb3100b98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:14.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.716+0000 7fb315451640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3101452e0 0x7fb3100b98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50656/0 (socket says 172.21.15.28:50656) 2023-11-16T02:30:14.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.716+0000 7fb315451640 1 -- 172.21.15.28:0/2807904409 learned_addr learned my addr 172.21.15.28:0/2807904409 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:14.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.716+0000 7fb314c50640 1 --2- 172.21.15.28:0/2807904409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3100b7330 0x7fb3101d4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:14.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.716+0000 7fb315451640 1 -- 172.21.15.28:0/2807904409 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb310144f00 msgr2=0x7fb3101e3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:14.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.716+0000 7fb315451640 1 --2- 172.21.15.28:0/2807904409 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb310144f00 0x7fb3101e3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:14.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.716+0000 7fb315451640 1 -- 172.21.15.28:0/2807904409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3100b7330 msgr2=0x7fb3101d4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:14.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.716+0000 7fb315451640 1 --2- 172.21.15.28:0/2807904409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3100b7330 0x7fb3101d4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:14.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.716+0000 7fb315451640 1 -- 172.21.15.28:0/2807904409 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb308009b30 con 0x7fb3101452e0 2023-11-16T02:30:14.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.716+0000 7fb314c50640 1 --2- 172.21.15.28:0/2807904409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3100b7330 0x7fb3101d4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:14.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.716+0000 7fb315451640 1 --2- 172.21.15.28:0/2807904409 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3101452e0 0x7fb3100b98e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb30801be00 tx=0x7fb30801bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:14.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.716+0000 7fb30d7fa640 1 -- 172.21.15.28:0/2807904409 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3080afde0 con 0x7fb3101452e0 2023-11-16T02:30:14.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.716+0000 7fb30d7fa640 1 -- 172.21.15.28:0/2807904409 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb308009510 con 0x7fb3101452e0 2023-11-16T02:30:14.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.716+0000 7fb316eb4640 1 -- 172.21.15.28:0/2807904409 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3101df9c0 con 0x7fb3101452e0 2023-11-16T02:30:14.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.716+0000 7fb30d7fa640 1 -- 172.21.15.28:0/2807904409 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3080ba660 con 0x7fb3101452e0 2023-11-16T02:30:14.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.716+0000 7fb316eb4640 1 -- 172.21.15.28:0/2807904409 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3101d2c30 con 0x7fb3101452e0 2023-11-16T02:30:14.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.716+0000 7fb316eb4640 1 -- 172.21.15.28:0/2807904409 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3101e2f10 con 0x7fb3101452e0 2023-11-16T02:30:14.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.716+0000 7fb30d7fa640 1 -- 172.21.15.28:0/2807904409 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb3080b6040 con 0x7fb3101452e0 2023-11-16T02:30:14.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.720+0000 7fb30d7fa640 1 --2- 172.21.15.28:0/2807904409 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb2f4065a90 0x7fb2f4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:14.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.720+0000 7fb314c50640 1 --2- 172.21.15.28:0/2807904409 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb2f4065a90 0x7fb2f4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:14.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.720+0000 7fb30d7fa640 1 -- 172.21.15.28:0/2807904409 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb3081210a0 con 0x7fb3101452e0 2023-11-16T02:30:14.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.720+0000 7fb314c50640 1 --2- 172.21.15.28:0/2807904409 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb2f4065a90 0x7fb2f4067f50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb304000f70 tx=0x7fb304009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:14.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.724+0000 7fb30d7fa640 1 -- 172.21.15.28:0/2807904409 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fb3101e2f10 con 0x7fb3101452e0 2023-11-16T02:30:14.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.924+0000 7fb316eb4640 1 -- 172.21.15.28:0/2807904409 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fb3101e32b0 con 0x7fb3101452e0 2023-11-16T02:30:14.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.936+0000 7fb30d7fa640 1 -- 172.21.15.28:0/2807904409 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb3101e32b0 con 0x7fb3101452e0 2023-11-16T02:30:14.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.936+0000 7fb316eb4640 1 -- 172.21.15.28:0/2807904409 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb2f4065a90 msgr2=0x7fb2f4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:14.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.936+0000 7fb316eb4640 1 --2- 172.21.15.28:0/2807904409 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb2f4065a90 0x7fb2f4067f50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb304000f70 tx=0x7fb304009040 comp rx=0 tx=0).stop 2023-11-16T02:30:14.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.936+0000 7fb316eb4640 1 -- 172.21.15.28:0/2807904409 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3101452e0 msgr2=0x7fb3100b98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:14.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.936+0000 7fb316eb4640 1 --2- 172.21.15.28:0/2807904409 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3101452e0 0x7fb3100b98e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb30801be00 tx=0x7fb30801bf90 comp rx=0 tx=0).stop 2023-11-16T02:30:14.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.936+0000 7fb316eb4640 1 -- 172.21.15.28:0/2807904409 shutdown_connections 2023-11-16T02:30:14.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.936+0000 7fb316eb4640 1 --2- 172.21.15.28:0/2807904409 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb2f4065a90 0x7fb2f4067f50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:14.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.936+0000 7fb316eb4640 1 --2- 172.21.15.28:0/2807904409 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3101452e0 0x7fb3100b98e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:14.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.936+0000 7fb316eb4640 1 --2- 172.21.15.28:0/2807904409 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb310144f00 0x7fb3101e3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:14.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.936+0000 7fb316eb4640 1 --2- 172.21.15.28:0/2807904409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb3100b7330 0x7fb3101d4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:14.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.936+0000 7fb316eb4640 1 -- 172.21.15.28:0/2807904409 >> 172.21.15.28:0/2807904409 conn(0x7fb3100bd0c0 msgr2=0x7fb310144630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:14.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.936+0000 7fb316eb4640 1 -- 172.21.15.28:0/2807904409 shutdown_connections 2023-11-16T02:30:14.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:14.936+0000 7fb316eb4640 1 -- 172.21.15.28:0/2807904409 wait complete. 2023-11-16T02:30:14.953 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-16T02:30:15.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.064+0000 7f5f1c824640 1 Processor -- start 2023-11-16T02:30:15.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.064+0000 7f5f1c824640 1 -- start start 2023-11-16T02:30:15.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.064+0000 7f5f1c824640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f180b2a00 0x7f5f181489e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:15.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.064+0000 7f5f1c824640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5f180b6020 0x7f5f181532f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:15.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.064+0000 7f5f1c824640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f18148f20 con 0x7f5f180b38f0 2023-11-16T02:30:15.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.064+0000 7f5f1c824640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f1806a880 con 0x7f5f180b6020 2023-11-16T02:30:15.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.064+0000 7f5f1c824640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f180b3e10 con 0x7f5f180b2a00 2023-11-16T02:30:15.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.064+0000 7f5f16d9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5f180b6020 0x7f5f181532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:15.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.064+0000 7f5f16d9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5f180b6020 0x7f5f181532f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50672/0 (socket says 172.21.15.28:50672) 2023-11-16T02:30:15.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.064+0000 7f5f16d9d640 1 -- 172.21.15.28:0/3731498271 learned_addr learned my addr 172.21.15.28:0/3731498271 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:15.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.064+0000 7f5f1659c640 1 --2- 172.21.15.28:0/3731498271 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f180b2a00 0x7f5f181489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:15.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.064+0000 7f5f16d9d640 1 -- 172.21.15.28:0/3731498271 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f180b2a00 msgr2=0x7f5f181489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:15.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.064+0000 7f5f16d9d640 1 --2- 172.21.15.28:0/3731498271 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f180b2a00 0x7f5f181489e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:15.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.064+0000 7f5f16d9d640 1 -- 172.21.15.28:0/3731498271 >> v1:172.21.15.70:6789/0 conn(0x7f5f180b38f0 legacy=0x7f5f1806a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:15.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.064+0000 7f5f16d9d640 1 -- 172.21.15.28:0/3731498271 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f180b5820 con 0x7f5f180b6020 2023-11-16T02:30:15.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.068+0000 7f5f16d9d640 1 --2- 172.21.15.28:0/3731498271 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5f180b6020 0x7f5f181532f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009870 tx=0x7f5f0801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f37cd06540bbf9bc server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:15.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.068+0000 7f5f1559a640 1 -- 172.21.15.28:0/3731498271 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f080a89b0 con 0x7f5f180b6020 2023-11-16T02:30:15.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.068+0000 7f5f1559a640 1 -- 172.21.15.28:0/3731498271 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f080a8b10 con 0x7f5f180b6020 2023-11-16T02:30:15.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.068+0000 7f5f1559a640 1 -- 172.21.15.28:0/3731498271 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f080a8ea0 con 0x7f5f180b6020 2023-11-16T02:30:15.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.068+0000 7f5f1c824640 1 -- 172.21.15.28:0/3731498271 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5f180b6020 msgr2=0x7f5f181532f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:15.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.068+0000 7f5f1c824640 1 --2- 172.21.15.28:0/3731498271 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5f180b6020 0x7f5f181532f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009870 tx=0x7f5f0801ecf0 comp rx=0 tx=0).stop 2023-11-16T02:30:15.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.068+0000 7f5f1c824640 1 -- 172.21.15.28:0/3731498271 shutdown_connections 2023-11-16T02:30:15.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.068+0000 7f5f1c824640 1 --2- 172.21.15.28:0/3731498271 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5f180b6020 0x7f5f181532f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:15.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.068+0000 7f5f1c824640 1 --2- 172.21.15.28:0/3731498271 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f180b2a00 0x7f5f181489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:15.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.068+0000 7f5f1c824640 1 -- 172.21.15.28:0/3731498271 >> 172.21.15.28:0/3731498271 conn(0x7f5f180bc3e0 msgr2=0x7f5f180bc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:15.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.068+0000 7f5f1c824640 1 -- 172.21.15.28:0/3731498271 shutdown_connections 2023-11-16T02:30:15.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.068+0000 7f5f1c824640 1 -- 172.21.15.28:0/3731498271 wait complete. 2023-11-16T02:30:15.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.068+0000 7f5f1c824640 1 Processor -- start 2023-11-16T02:30:15.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.068+0000 7f5f1c824640 1 -- start start 2023-11-16T02:30:15.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.068+0000 7f5f1c824640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f180b2a00 0x7f5f181d1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:15.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.068+0000 7f5f1c824640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5f180b38f0 0x7f5f18145a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:15.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.068+0000 7f5f1c824640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f180b6020 0x7f5f18144eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:15.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.068+0000 7f5f1c824640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f18144600 con 0x7f5f180b38f0 2023-11-16T02:30:15.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.068+0000 7f5f1c824640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f181d2470 con 0x7f5f180b6020 2023-11-16T02:30:15.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.068+0000 7f5f1c824640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f18145790 con 0x7f5f180b2a00 2023-11-16T02:30:15.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.068+0000 7f5f15d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5f180b38f0 0x7f5f18145a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:15.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.072+0000 7f5f15d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5f180b38f0 0x7f5f18145a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50678/0 (socket says 172.21.15.28:50678) 2023-11-16T02:30:15.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.072+0000 7f5f15d9b640 1 -- 172.21.15.28:0/37593575 learned_addr learned my addr 172.21.15.28:0/37593575 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:15.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.072+0000 7f5f1659c640 1 --2- 172.21.15.28:0/37593575 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f180b2a00 0x7f5f181d1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:15.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.072+0000 7f5f16d9d640 1 --2- 172.21.15.28:0/37593575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f180b6020 0x7f5f18144eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:15.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.072+0000 7f5f15d9b640 1 -- 172.21.15.28:0/37593575 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f180b2a00 msgr2=0x7f5f181d1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:15.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.072+0000 7f5f15d9b640 1 --2- 172.21.15.28:0/37593575 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f180b2a00 0x7f5f181d1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:15.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.072+0000 7f5f15d9b640 1 -- 172.21.15.28:0/37593575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f180b6020 msgr2=0x7f5f18144eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:15.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.072+0000 7f5f15d9b640 1 --2- 172.21.15.28:0/37593575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f180b6020 0x7f5f18144eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:15.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.072+0000 7f5f15d9b640 1 -- 172.21.15.28:0/37593575 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f080094d0 con 0x7f5f180b38f0 2023-11-16T02:30:15.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.072+0000 7f5f15d9b640 1 --2- 172.21.15.28:0/37593575 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5f180b38f0 0x7f5f18145a00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5f0000c450 tx=0x7f5f0000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:15.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.072+0000 7f5f0effd640 1 -- 172.21.15.28:0/37593575 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f00012830 con 0x7f5f180b38f0 2023-11-16T02:30:15.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.072+0000 7f5f0effd640 1 -- 172.21.15.28:0/37593575 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f000129b0 con 0x7f5f180b38f0 2023-11-16T02:30:15.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.072+0000 7f5f1c824640 1 -- 172.21.15.28:0/37593575 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f181e1480 con 0x7f5f180b38f0 2023-11-16T02:30:15.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.072+0000 7f5f0effd640 1 -- 172.21.15.28:0/37593575 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f00012d60 con 0x7f5f180b38f0 2023-11-16T02:30:15.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.072+0000 7f5f1c824640 1 -- 172.21.15.28:0/37593575 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f181e19a0 con 0x7f5f180b38f0 2023-11-16T02:30:15.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.072+0000 7f5f1c824640 1 -- 172.21.15.28:0/37593575 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f181e16c0 con 0x7f5f180b38f0 2023-11-16T02:30:15.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.072+0000 7f5f0effd640 1 -- 172.21.15.28:0/37593575 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5f0001c460 con 0x7f5f180b38f0 2023-11-16T02:30:15.080 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.072+0000 7f5f0effd640 1 --2- 172.21.15.28:0/37593575 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5ef8065a60 0x7f5ef8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:15.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.072+0000 7f5f0effd640 1 -- 172.21.15.28:0/37593575 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5f00082c50 con 0x7f5f180b38f0 2023-11-16T02:30:15.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.072+0000 7f5f1659c640 1 --2- 172.21.15.28:0/37593575 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5ef8065a60 0x7f5ef8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:15.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.072+0000 7f5f1659c640 1 --2- 172.21.15.28:0/37593575 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5ef8065a60 0x7f5ef8067f20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5f100070b0 tx=0x7f5f10007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:15.081 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.076+0000 7f5f0effd640 1 -- 172.21.15.28:0/37593575 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f5f181e16c0 con 0x7f5f180b38f0 2023-11-16T02:30:15.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.288+0000 7f5f1c824640 1 -- 172.21.15.28:0/37593575 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f5f181e16c0 con 0x7f5f180b38f0 2023-11-16T02:30:15.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.296+0000 7f5f0effd640 1 -- 172.21.15.28:0/37593575 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5f181e16c0 con 0x7f5f180b38f0 2023-11-16T02:30:15.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.296+0000 7f5f1c824640 1 -- 172.21.15.28:0/37593575 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5ef8065a60 msgr2=0x7f5ef8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:15.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.296+0000 7f5f1c824640 1 --2- 172.21.15.28:0/37593575 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5ef8065a60 0x7f5ef8067f20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5f100070b0 tx=0x7f5f10007040 comp rx=0 tx=0).stop 2023-11-16T02:30:15.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.296+0000 7f5f1c824640 1 -- 172.21.15.28:0/37593575 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5f180b38f0 msgr2=0x7f5f18145a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:15.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.296+0000 7f5f1c824640 1 --2- 172.21.15.28:0/37593575 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5f180b38f0 0x7f5f18145a00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5f0000c450 tx=0x7f5f0000c910 comp rx=0 tx=0).stop 2023-11-16T02:30:15.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.296+0000 7f5f1c824640 1 -- 172.21.15.28:0/37593575 shutdown_connections 2023-11-16T02:30:15.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.296+0000 7f5f1c824640 1 --2- 172.21.15.28:0/37593575 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5ef8065a60 0x7f5ef8067f20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:15.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.296+0000 7f5f1c824640 1 --2- 172.21.15.28:0/37593575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f180b6020 0x7f5f18144eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:15.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.296+0000 7f5f1c824640 1 --2- 172.21.15.28:0/37593575 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5f180b38f0 0x7f5f18145a00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:15.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.296+0000 7f5f1c824640 1 --2- 172.21.15.28:0/37593575 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f5f180b2a00 0x7f5f181d1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:15.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.296+0000 7f5f1c824640 1 -- 172.21.15.28:0/37593575 >> 172.21.15.28:0/37593575 conn(0x7f5f180bc3e0 msgr2=0x7f5f18146c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:15.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.300+0000 7f5f1c824640 1 -- 172.21.15.28:0/37593575 shutdown_connections 2023-11-16T02:30:15.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.300+0000 7f5f1c824640 1 -- 172.21.15.28:0/37593575 wait complete. 2023-11-16T02:30:15.315 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-16T02:30:15.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.436+0000 7f10fc3f1640 1 Processor -- start 2023-11-16T02:30:15.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.436+0000 7f10fc3f1640 1 -- start start 2023-11-16T02:30:15.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.436+0000 7f10fc3f1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f10f4071240 0x7f10f4142850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:15.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.436+0000 7f10fc3f1640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f10f40b4620 0x7f10f41531e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:15.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.436+0000 7f10fc3f1640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f40b5ff0 con 0x7f10f40b50c0 2023-11-16T02:30:15.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.436+0000 7f10fc3f1640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f40bef00 con 0x7f10f4071240 2023-11-16T02:30:15.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.436+0000 7f10fc3f1640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f4071980 con 0x7f10f40b4620 2023-11-16T02:30:15.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.440+0000 7f10fa18d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f10f4071240 0x7f10f4142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:15.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.440+0000 7f10fa18d640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f10f4071240 0x7f10f4142850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.28:50396/0 (socket says 172.21.15.28:50396) 2023-11-16T02:30:15.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.440+0000 7f10fa18d640 1 -- 172.21.15.28:0/1669112759 learned_addr learned my addr 172.21.15.28:0/1669112759 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:15.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.440+0000 7f10fa98e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f10f40b4620 0x7f10f41531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:15.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.440+0000 7f10fa98e640 1 -- 172.21.15.28:0/1669112759 >> v2:172.21.15.70:3300/0 conn(0x7f10f4071240 msgr2=0x7f10f4142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:15.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.440+0000 7f10fa98e640 1 --2- 172.21.15.28:0/1669112759 >> v2:172.21.15.70:3300/0 conn(0x7f10f4071240 0x7f10f4142850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:15.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.440+0000 7f10fa98e640 1 -- 172.21.15.28:0/1669112759 >> v1:172.21.15.70:6789/0 conn(0x7f10f40b50c0 legacy=0x7f10f40b7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:15.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.440+0000 7f10fa98e640 1 -- 172.21.15.28:0/1669112759 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f4071c60 con 0x7f10f40b4620 2023-11-16T02:30:15.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.440+0000 7f10fa98e640 1 --2- 172.21.15.28:0/1669112759 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f10f40b4620 0x7f10f41531e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f10ec0097c0 tx=0x7f10ec01ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9eb17ec9b33272b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:15.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.440+0000 7f10f918b640 1 -- 172.21.15.28:0/1669112759 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec0a8970 con 0x7f10f40b4620 2023-11-16T02:30:15.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.440+0000 7f10f918b640 1 -- 172.21.15.28:0/1669112759 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec0a8ad0 con 0x7f10f40b4620 2023-11-16T02:30:15.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.440+0000 7f10f918b640 1 -- 172.21.15.28:0/1669112759 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec0a8e60 con 0x7f10f40b4620 2023-11-16T02:30:15.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.440+0000 7f10fc3f1640 1 -- 172.21.15.28:0/1669112759 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f10f40b4620 msgr2=0x7f10f41531e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:15.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.440+0000 7f10fc3f1640 1 --2- 172.21.15.28:0/1669112759 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f10f40b4620 0x7f10f41531e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f10ec0097c0 tx=0x7f10ec01ec70 comp rx=0 tx=0).stop 2023-11-16T02:30:15.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.440+0000 7f10fc3f1640 1 -- 172.21.15.28:0/1669112759 shutdown_connections 2023-11-16T02:30:15.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.440+0000 7f10fc3f1640 1 --2- 172.21.15.28:0/1669112759 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f10f40b4620 0x7f10f41531e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:15.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.440+0000 7f10fc3f1640 1 --2- 172.21.15.28:0/1669112759 >> v2:172.21.15.70:3300/0 conn(0x7f10f4071240 0x7f10f4142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:15.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.440+0000 7f10fc3f1640 1 -- 172.21.15.28:0/1669112759 >> 172.21.15.28:0/1669112759 conn(0x7f10f40be1d0 msgr2=0x7f10f40be5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:15.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.440+0000 7f10fc3f1640 1 -- 172.21.15.28:0/1669112759 shutdown_connections 2023-11-16T02:30:15.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.440+0000 7f10fc3f1640 1 -- 172.21.15.28:0/1669112759 wait complete. 2023-11-16T02:30:15.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.444+0000 7f10fc3f1640 1 Processor -- start 2023-11-16T02:30:15.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.444+0000 7f10fc3f1640 1 -- start start 2023-11-16T02:30:15.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.444+0000 7f10fc3f1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10f4071240 0x7f10f4149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:15.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.444+0000 7f10fc3f1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10f40b4620 0x7f10f414c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:15.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.444+0000 7f10fc3f1640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f10f40b50c0 0x7f10f414c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:15.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.444+0000 7f10fc3f1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f414a240 con 0x7f10f40b4620 2023-11-16T02:30:15.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.444+0000 7f10fc3f1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f414b1d0 con 0x7f10f4071240 2023-11-16T02:30:15.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.444+0000 7f10fc3f1640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f406cbd0 con 0x7f10f40b50c0 2023-11-16T02:30:15.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.444+0000 7f10f998c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10f40b4620 0x7f10f414c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:15.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.444+0000 7f10fa18d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10f4071240 0x7f10f4149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:15.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.444+0000 7f10f998c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10f40b4620 0x7f10f414c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50690/0 (socket says 172.21.15.28:50690) 2023-11-16T02:30:15.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.444+0000 7f10f998c640 1 -- 172.21.15.28:0/1096084057 learned_addr learned my addr 172.21.15.28:0/1096084057 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:15.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.444+0000 7f10fa98e640 1 --2- 172.21.15.28:0/1096084057 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f10f40b50c0 0x7f10f414c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:15.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.444+0000 7f10f998c640 1 -- 172.21.15.28:0/1096084057 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f10f40b50c0 msgr2=0x7f10f414c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:15.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.444+0000 7f10f998c640 1 --2- 172.21.15.28:0/1096084057 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f10f40b50c0 0x7f10f414c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:15.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.444+0000 7f10f998c640 1 -- 172.21.15.28:0/1096084057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10f4071240 msgr2=0x7f10f4149d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:15.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.444+0000 7f10f998c640 1 --2- 172.21.15.28:0/1096084057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10f4071240 0x7f10f4149d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:15.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.444+0000 7f10f998c640 1 -- 172.21.15.28:0/1096084057 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec009420 con 0x7f10f40b4620 2023-11-16T02:30:15.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.444+0000 7f10f998c640 1 --2- 172.21.15.28:0/1096084057 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10f40b4620 0x7f10f414c3c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f10e400c3c0 tx=0x7f10e400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:15.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.444+0000 7f10eaffd640 1 -- 172.21.15.28:0/1096084057 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e40052d0 con 0x7f10f40b4620 2023-11-16T02:30:15.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.444+0000 7f10eaffd640 1 -- 172.21.15.28:0/1096084057 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e4005430 con 0x7f10f40b4620 2023-11-16T02:30:15.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.444+0000 7f10eaffd640 1 -- 172.21.15.28:0/1096084057 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4003840 con 0x7f10f40b4620 2023-11-16T02:30:15.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.444+0000 7f10fc3f1640 1 -- 172.21.15.28:0/1096084057 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f406b510 con 0x7f10f40b4620 2023-11-16T02:30:15.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.444+0000 7f10fc3f1640 1 -- 172.21.15.28:0/1096084057 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f414bea0 con 0x7f10f40b4620 2023-11-16T02:30:15.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.444+0000 7f10fc3f1640 1 -- 172.21.15.28:0/1096084057 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f414c0c0 con 0x7f10f40b4620 2023-11-16T02:30:15.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.444+0000 7f10eaffd640 1 -- 172.21.15.28:0/1096084057 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f10e40039a0 con 0x7f10f40b4620 2023-11-16T02:30:15.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.448+0000 7f10eaffd640 1 --2- 172.21.15.28:0/1096084057 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f10d8065a90 0x7f10d8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:15.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.448+0000 7f10fa18d640 1 --2- 172.21.15.28:0/1096084057 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f10d8065a90 0x7f10d8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:15.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.448+0000 7f10eaffd640 1 -- 172.21.15.28:0/1096084057 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f10e4082380 con 0x7f10f40b4620 2023-11-16T02:30:15.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.448+0000 7f10fa18d640 1 --2- 172.21.15.28:0/1096084057 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f10d8065a90 0x7f10d8067f50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f10f00113e0 tx=0x7f10f000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:15.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.452+0000 7f10eaffd640 1 -- 172.21.15.28:0/1096084057 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f10e4050030 con 0x7f10f40b4620 2023-11-16T02:30:15.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.663+0000 7f10fc3f1640 1 -- 172.21.15.28:0/1096084057 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f10f404e8a0 con 0x7f10f40b4620 2023-11-16T02:30:15.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.671+0000 7f10eaffd640 1 -- 172.21.15.28:0/1096084057 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f10e4053650 con 0x7f10f40b4620 2023-11-16T02:30:15.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.671+0000 7f10fc3f1640 1 -- 172.21.15.28:0/1096084057 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f10d8065a90 msgr2=0x7f10d8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:15.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.671+0000 7f10fc3f1640 1 --2- 172.21.15.28:0/1096084057 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f10d8065a90 0x7f10d8067f50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f10f00113e0 tx=0x7f10f000b040 comp rx=0 tx=0).stop 2023-11-16T02:30:15.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.671+0000 7f10fc3f1640 1 -- 172.21.15.28:0/1096084057 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10f40b4620 msgr2=0x7f10f414c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:15.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.671+0000 7f10fc3f1640 1 --2- 172.21.15.28:0/1096084057 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10f40b4620 0x7f10f414c3c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f10e400c3c0 tx=0x7f10e400c880 comp rx=0 tx=0).stop 2023-11-16T02:30:15.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.671+0000 7f10fc3f1640 1 -- 172.21.15.28:0/1096084057 shutdown_connections 2023-11-16T02:30:15.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.671+0000 7f10fc3f1640 1 --2- 172.21.15.28:0/1096084057 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f10d8065a90 0x7f10d8067f50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:15.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.671+0000 7f10fc3f1640 1 --2- 172.21.15.28:0/1096084057 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f10f40b50c0 0x7f10f414c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:15.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.671+0000 7f10fc3f1640 1 --2- 172.21.15.28:0/1096084057 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10f40b4620 0x7f10f414c3c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:15.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.671+0000 7f10fc3f1640 1 --2- 172.21.15.28:0/1096084057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10f4071240 0x7f10f4149d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:15.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.671+0000 7f10fc3f1640 1 -- 172.21.15.28:0/1096084057 >> 172.21.15.28:0/1096084057 conn(0x7f10f40be1d0 msgr2=0x7f10f4146450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:15.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.671+0000 7f10fc3f1640 1 -- 172.21.15.28:0/1096084057 shutdown_connections 2023-11-16T02:30:15.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.671+0000 7f10fc3f1640 1 -- 172.21.15.28:0/1096084057 wait complete. 2023-11-16T02:30:15.695 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-16T02:30:15.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.823+0000 7f19b54c9640 1 Processor -- start 2023-11-16T02:30:15.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.823+0000 7f19b54c9640 1 -- start start 2023-11-16T02:30:15.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.823+0000 7f19b54c9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f19b0070a20 0x7f19b0070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:15.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.823+0000 7f19b54c9640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19b006edb0 0x7f19b0144370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:15.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.823+0000 7f19b54c9640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b00b30e0 con 0x7f19b01448b0 2023-11-16T02:30:15.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.823+0000 7f19b54c9640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b00703d0 con 0x7f19b0070a20 2023-11-16T02:30:15.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.823+0000 7f19b54c9640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b00b2e00 con 0x7f19b006edb0 2023-11-16T02:30:15.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.823+0000 7f19aeffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f19b0070a20 0x7f19b0070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:15.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.823+0000 7f19aeffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f19b0070a20 0x7f19b0070e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50704/0 (socket says 172.21.15.28:50704) 2023-11-16T02:30:15.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.823+0000 7f19aeffd640 1 -- 172.21.15.28:0/1838021920 learned_addr learned my addr 172.21.15.28:0/1838021920 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:15.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.823+0000 7f19ae7fc640 1 --2- 172.21.15.28:0/1838021920 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19b006edb0 0x7f19b0144370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:15.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.823+0000 7f19aeffd640 1 -- 172.21.15.28:0/1838021920 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19b006edb0 msgr2=0x7f19b0144370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:15.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.823+0000 7f19aeffd640 1 --2- 172.21.15.28:0/1838021920 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19b006edb0 0x7f19b0144370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:15.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.823+0000 7f19aeffd640 1 -- 172.21.15.28:0/1838021920 >> v1:172.21.15.70:6789/0 conn(0x7f19b01448b0 legacy=0x7f19b0147130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:15.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.823+0000 7f19aeffd640 1 -- 172.21.15.28:0/1838021920 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b006fff0 con 0x7f19b0070a20 2023-11-16T02:30:15.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.823+0000 7f19ae7fc640 1 --2- 172.21.15.28:0/1838021920 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19b006edb0 0x7f19b0144370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:15.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.827+0000 7f19aeffd640 1 --2- 172.21.15.28:0/1838021920 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19b0070a20 0x7f19b0070e00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009870 tx=0x7f19a001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7876a0558832ca server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:15.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.827+0000 7f19adffb640 1 -- 172.21.15.28:0/1838021920 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a00ab600 con 0x7f19b0070a20 2023-11-16T02:30:15.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.827+0000 7f19adffb640 1 -- 172.21.15.28:0/1838021920 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a00a7050 con 0x7f19b0070a20 2023-11-16T02:30:15.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.827+0000 7f19adffb640 1 -- 172.21.15.28:0/1838021920 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a00ab980 con 0x7f19b0070a20 2023-11-16T02:30:15.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.827+0000 7f19b54c9640 1 -- 172.21.15.28:0/1838021920 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19b0070a20 msgr2=0x7f19b0070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:15.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.827+0000 7f19b54c9640 1 --2- 172.21.15.28:0/1838021920 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19b0070a20 0x7f19b0070e00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009870 tx=0x7f19a001c3e0 comp rx=0 tx=0).stop 2023-11-16T02:30:15.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.827+0000 7f19b54c9640 1 -- 172.21.15.28:0/1838021920 shutdown_connections 2023-11-16T02:30:15.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.827+0000 7f19b54c9640 1 --2- 172.21.15.28:0/1838021920 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19b006edb0 0x7f19b0144370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:15.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.827+0000 7f19b54c9640 1 --2- 172.21.15.28:0/1838021920 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19b0070a20 0x7f19b0070e00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:15.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.827+0000 7f19b54c9640 1 -- 172.21.15.28:0/1838021920 >> 172.21.15.28:0/1838021920 conn(0x7f19b00bc3e0 msgr2=0x7f19b00bc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:15.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.827+0000 7f19b54c9640 1 -- 172.21.15.28:0/1838021920 shutdown_connections 2023-11-16T02:30:15.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.827+0000 7f19b54c9640 1 -- 172.21.15.28:0/1838021920 wait complete. 2023-11-16T02:30:15.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.827+0000 7f19b54c9640 1 Processor -- start 2023-11-16T02:30:15.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.827+0000 7f19b54c9640 1 -- start start 2023-11-16T02:30:15.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.827+0000 7f19b54c9640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19b006edb0 0x7f19b0146a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:15.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.827+0000 7f19b54c9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19b0070a20 0x7f19b00b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:15.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.827+0000 7f19b54c9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19b01448b0 0x7f19b0136d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:15.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.827+0000 7f19b54c9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b0146f80 con 0x7f19b0070a20 2023-11-16T02:30:15.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.827+0000 7f19b54c9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b01e6860 con 0x7f19b01448b0 2023-11-16T02:30:15.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.827+0000 7f19b54c9640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b01e6b40 con 0x7f19b006edb0 2023-11-16T02:30:15.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.827+0000 7f19ae7fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19b0070a20 0x7f19b00b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:15.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.827+0000 7f19ae7fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19b0070a20 0x7f19b00b4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50716/0 (socket says 172.21.15.28:50716) 2023-11-16T02:30:15.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.827+0000 7f19ae7fc640 1 -- 172.21.15.28:0/1565631028 learned_addr learned my addr 172.21.15.28:0/1565631028 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:15.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.827+0000 7f19af7fe640 1 --2- 172.21.15.28:0/1565631028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19b01448b0 0x7f19b0136d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:15.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.831+0000 7f19aeffd640 1 --2- 172.21.15.28:0/1565631028 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19b006edb0 0x7f19b0146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:15.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.831+0000 7f19ae7fc640 1 -- 172.21.15.28:0/1565631028 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19b006edb0 msgr2=0x7f19b0146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:15.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.831+0000 7f19ae7fc640 1 --2- 172.21.15.28:0/1565631028 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19b006edb0 0x7f19b0146a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:15.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.831+0000 7f19ae7fc640 1 -- 172.21.15.28:0/1565631028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19b01448b0 msgr2=0x7f19b0136d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:15.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.831+0000 7f19ae7fc640 1 --2- 172.21.15.28:0/1565631028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19b01448b0 0x7f19b0136d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:15.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.831+0000 7f19ae7fc640 1 -- 172.21.15.28:0/1565631028 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a00094d0 con 0x7f19b0070a20 2023-11-16T02:30:15.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.831+0000 7f19af7fe640 1 --2- 172.21.15.28:0/1565631028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19b01448b0 0x7f19b0136d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:30:15.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.831+0000 7f19ae7fc640 1 --2- 172.21.15.28:0/1565631028 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19b0070a20 0x7f19b00b4d60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f19a400c7f0 tx=0x7f19a400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:15.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.831+0000 7f19977fe640 1 -- 172.21.15.28:0/1565631028 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a400cea0 con 0x7f19b0070a20 2023-11-16T02:30:15.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.831+0000 7f19977fe640 1 -- 172.21.15.28:0/1565631028 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a4007a30 con 0x7f19b0070a20 2023-11-16T02:30:15.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.831+0000 7f19977fe640 1 -- 172.21.15.28:0/1565631028 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a4007dc0 con 0x7f19b0070a20 2023-11-16T02:30:15.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.831+0000 7f19b54c9640 1 -- 172.21.15.28:0/1565631028 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b01e6e20 con 0x7f19b0070a20 2023-11-16T02:30:15.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.831+0000 7f19b54c9640 1 -- 172.21.15.28:0/1565631028 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b01e64a0 con 0x7f19b0070a20 2023-11-16T02:30:15.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.831+0000 7f19b54c9640 1 -- 172.21.15.28:0/1565631028 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b004e8a0 con 0x7f19b0070a20 2023-11-16T02:30:15.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.831+0000 7f19977fe640 1 -- 172.21.15.28:0/1565631028 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f19a40113f0 con 0x7f19b0070a20 2023-11-16T02:30:15.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.831+0000 7f19977fe640 1 --2- 172.21.15.28:0/1565631028 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f199c065a60 0x7f199c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:15.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.831+0000 7f19977fe640 1 -- 172.21.15.28:0/1565631028 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f19a4082fe0 con 0x7f19b0070a20 2023-11-16T02:30:15.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.831+0000 7f19aeffd640 1 --2- 172.21.15.28:0/1565631028 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f199c065a60 0x7f199c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:15.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.831+0000 7f19aeffd640 1 --2- 172.21.15.28:0/1565631028 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f199c065a60 0x7f199c067f20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f19a00ad000 tx=0x7f19a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:15.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:15.835+0000 7f19977fe640 1 -- 172.21.15.28:0/1565631028 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f19a4050cf0 con 0x7f19b0070a20 2023-11-16T02:30:16.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.047+0000 7f19b54c9640 1 -- 172.21.15.28:0/1565631028 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f19b00b84a0 con 0x7f19b0070a20 2023-11-16T02:30:16.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.055+0000 7f19977fe640 1 -- 172.21.15.28:0/1565631028 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f19a4054310 con 0x7f19b0070a20 2023-11-16T02:30:16.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.055+0000 7f19b54c9640 1 -- 172.21.15.28:0/1565631028 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f199c065a60 msgr2=0x7f199c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:16.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.055+0000 7f19b54c9640 1 --2- 172.21.15.28:0/1565631028 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f199c065a60 0x7f199c067f20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f19a00ad000 tx=0x7f19a0008040 comp rx=0 tx=0).stop 2023-11-16T02:30:16.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.055+0000 7f19b54c9640 1 -- 172.21.15.28:0/1565631028 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19b0070a20 msgr2=0x7f19b00b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:16.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.055+0000 7f19b54c9640 1 --2- 172.21.15.28:0/1565631028 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19b0070a20 0x7f19b00b4d60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f19a400c7f0 tx=0x7f19a400ccb0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.055+0000 7f19b54c9640 1 -- 172.21.15.28:0/1565631028 shutdown_connections 2023-11-16T02:30:16.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.055+0000 7f19b54c9640 1 --2- 172.21.15.28:0/1565631028 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f199c065a60 0x7f199c067f20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.055+0000 7f19b54c9640 1 --2- 172.21.15.28:0/1565631028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19b01448b0 0x7f19b0136d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.055+0000 7f19b54c9640 1 --2- 172.21.15.28:0/1565631028 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f19b0070a20 0x7f19b00b4d60 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.055+0000 7f19b54c9640 1 --2- 172.21.15.28:0/1565631028 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f19b006edb0 0x7f19b0146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.055+0000 7f19b54c9640 1 -- 172.21.15.28:0/1565631028 >> 172.21.15.28:0/1565631028 conn(0x7f19b00bc3e0 msgr2=0x7f19b0139f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:16.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.055+0000 7f19b54c9640 1 -- 172.21.15.28:0/1565631028 shutdown_connections 2023-11-16T02:30:16.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.055+0000 7f19b54c9640 1 -- 172.21.15.28:0/1565631028 wait complete. 2023-11-16T02:30:16.076 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-16T02:30:16.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd3a6c0b640 1 Processor -- start 2023-11-16T02:30:16.194 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd3a6c0b640 1 -- start start 2023-11-16T02:30:16.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd3a6c0b640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fd3a00b8660 0x7fd3a014ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:16.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd3a6c0b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3a0144b00 0x7fd3a01553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:16.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd3a6c0b640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a00b7dc0 con 0x7fd3a014b3a0 2023-11-16T02:30:16.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd3a6c0b640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a00ba850 con 0x7fd3a00b8660 2023-11-16T02:30:16.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd3a6c0b640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a014b810 con 0x7fd3a0144b00 2023-11-16T02:30:16.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd39ffff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd3a014b3a0 0x7fd3a01443f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36948/0 (socket says 172.21.15.28:36948) 2023-11-16T02:30:16.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd39ffff640 1 -- 172.21.15.28:0/2071585980 learned_addr learned my addr 172.21.15.28:0/2071585980 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:16.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd3a49a7640 1 --2- 172.21.15.28:0/2071585980 >> v2:172.21.15.70:3300/0 conn(0x7fd3a00b8660 0x7fd3a014ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:16.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd3a51a8640 1 --2- 172.21.15.28:0/2071585980 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3a0144b00 0x7fd3a01553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:16.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd39f7fe640 1 -- 172.21.15.28:0/2071585980 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 203896529 0 0) 0x7fd3a00b7dc0 con 0x7fd3a014b3a0 2023-11-16T02:30:16.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd39f7fe640 1 -- 172.21.15.28:0/2071585980 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd390003530 con 0x7fd3a014b3a0 2023-11-16T02:30:16.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd39f7fe640 1 -- 172.21.15.28:0/2071585980 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4174464573 0 0) 0x7fd390003530 con 0x7fd3a014b3a0 2023-11-16T02:30:16.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd39f7fe640 1 -- 172.21.15.28:0/2071585980 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3a0144b00 msgr2=0x7fd3a01553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:16.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd39f7fe640 1 --2- 172.21.15.28:0/2071585980 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3a0144b00 0x7fd3a01553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd39f7fe640 1 -- 172.21.15.28:0/2071585980 >> v2:172.21.15.70:3300/0 conn(0x7fd3a00b8660 msgr2=0x7fd3a014ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:16.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd39f7fe640 1 --2- 172.21.15.28:0/2071585980 >> v2:172.21.15.70:3300/0 conn(0x7fd3a00b8660 0x7fd3a014ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd39f7fe640 1 -- 172.21.15.28:0/2071585980 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a00bcb80 con 0x7fd3a014b3a0 2023-11-16T02:30:16.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd39f7fe640 1 -- 172.21.15.28:0/2071585980 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7fd38c001680 con 0x7fd3a014b3a0 2023-11-16T02:30:16.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd3a49a7640 1 --2- 172.21.15.28:0/2071585980 >> v2:172.21.15.70:3300/0 conn(0x7fd3a00b8660 0x7fd3a014ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:30:16.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd39f7fe640 1 -- 172.21.15.28:0/2071585980 >> v1:172.21.15.28:6789/0 conn(0x7fd3a014b3a0 legacy=0x7fd3a01443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:16.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd39f7fe640 1 --2- 172.21.15.28:0/2071585980 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3a0144b00 0x7fd390003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:16.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd39f7fe640 1 --2- 172.21.15.28:0/2071585980 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd390003f00 0x7fd3900047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:16.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd39f7fe640 1 --2- 172.21.15.28:0/2071585980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd390004d10 0x7fd390005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:16.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd39f7fe640 1 -- 172.21.15.28:0/2071585980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a00ba850 con 0x7fd390004d10 2023-11-16T02:30:16.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd39f7fe640 1 -- 172.21.15.28:0/2071585980 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a014b810 con 0x7fd390003f00 2023-11-16T02:30:16.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.191+0000 7fd39f7fe640 1 -- 172.21.15.28:0/2071585980 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39000ba90 con 0x7fd3a0144b00 2023-11-16T02:30:16.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.195+0000 7fd3a51a8640 1 --2- 172.21.15.28:0/2071585980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd390004d10 0x7fd390005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:16.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.195+0000 7fd39ffff640 1 --2- 172.21.15.28:0/2071585980 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd390003f00 0x7fd3900047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:16.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.195+0000 7fd3a49a7640 1 --2- 172.21.15.28:0/2071585980 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3a0144b00 0x7fd390003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:16.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.195+0000 7fd3a51a8640 1 -- 172.21.15.28:0/2071585980 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3a0144b00 msgr2=0x7fd390003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:16.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.195+0000 7fd3a51a8640 1 --2- 172.21.15.28:0/2071585980 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3a0144b00 0x7fd390003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.195+0000 7fd3a51a8640 1 -- 172.21.15.28:0/2071585980 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd390003f00 msgr2=0x7fd3900047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:16.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.195+0000 7fd3a51a8640 1 --2- 172.21.15.28:0/2071585980 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd390003f00 0x7fd3900047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.195+0000 7fd3a51a8640 1 -- 172.21.15.28:0/2071585980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd390003530 con 0x7fd390004d10 2023-11-16T02:30:16.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.195+0000 7fd3a49a7640 1 --2- 172.21.15.28:0/2071585980 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3a0144b00 0x7fd390003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:16.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.195+0000 7fd3a51a8640 1 --2- 172.21.15.28:0/2071585980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd390004d10 0x7fd390005190 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd39800e170 tx=0x7fd39801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f284e09a195b856a server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:16.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.195+0000 7fd39f7fe640 1 -- 172.21.15.28:0/2071585980 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3980a5b40 con 0x7fd390004d10 2023-11-16T02:30:16.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.195+0000 7fd39f7fe640 1 -- 172.21.15.28:0/2071585980 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39800f040 con 0x7fd390004d10 2023-11-16T02:30:16.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.195+0000 7fd39f7fe640 1 -- 172.21.15.28:0/2071585980 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3980ad440 con 0x7fd390004d10 2023-11-16T02:30:16.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.195+0000 7fd3a6c0b640 1 -- 172.21.15.28:0/2071585980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd390004d10 msgr2=0x7fd390005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:16.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.195+0000 7fd3a6c0b640 1 --2- 172.21.15.28:0/2071585980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd390004d10 0x7fd390005190 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd39800e170 tx=0x7fd39801cc40 comp rx=0 tx=0).stop 2023-11-16T02:30:16.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.195+0000 7fd3a51a8640 1 -- 172.21.15.28:0/2071585980 reap_dead start 2023-11-16T02:30:16.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.195+0000 7fd3a6c0b640 1 -- 172.21.15.28:0/2071585980 shutdown_connections 2023-11-16T02:30:16.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.195+0000 7fd3a6c0b640 1 -- 172.21.15.28:0/2071585980 >> 172.21.15.28:0/2071585980 conn(0x7fd3a006b7e0 msgr2=0x7fd3a006bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:16.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.195+0000 7fd3a6c0b640 1 -- 172.21.15.28:0/2071585980 shutdown_connections 2023-11-16T02:30:16.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.195+0000 7fd3a6c0b640 1 -- 172.21.15.28:0/2071585980 wait complete. 2023-11-16T02:30:16.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd3a6c0b640 1 Processor -- start 2023-11-16T02:30:16.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd3a6c0b640 1 -- start start 2023-11-16T02:30:16.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd3a6c0b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd390004d10 0x7fd3a01d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:16.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd3a6c0b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3a01455e0 0x7fd3a01d2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:16.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd3a6c0b640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3a01d3380 0x7fd3a013c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:16.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd3a6c0b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a01d2450 con 0x7fd3a01455e0 2023-11-16T02:30:16.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd3a6c0b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a01d4550 con 0x7fd390004d10 2023-11-16T02:30:16.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd3a6c0b640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a01d3800 con 0x7fd3a01d3380 2023-11-16T02:30:16.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd39ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3a01455e0 0x7fd3a01d2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:16.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd39ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3a01455e0 0x7fd3a01d2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50726/0 (socket says 172.21.15.28:50726) 2023-11-16T02:30:16.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd39ffff640 1 -- 172.21.15.28:0/1300940640 learned_addr learned my addr 172.21.15.28:0/1300940640 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:16.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd3a49a7640 1 --2- 172.21.15.28:0/1300940640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd390004d10 0x7fd3a01d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:16.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd3a51a8640 1 --2- 172.21.15.28:0/1300940640 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3a01d3380 0x7fd3a013c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:16.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd39ffff640 1 -- 172.21.15.28:0/1300940640 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3a01d3380 msgr2=0x7fd3a013c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:16.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd39ffff640 1 --2- 172.21.15.28:0/1300940640 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3a01d3380 0x7fd3a013c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd39ffff640 1 -- 172.21.15.28:0/1300940640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd390004d10 msgr2=0x7fd3a01d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:16.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd39ffff640 1 --2- 172.21.15.28:0/1300940640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd390004d10 0x7fd3a01d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd39ffff640 1 -- 172.21.15.28:0/1300940640 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a01d28c0 con 0x7fd3a01455e0 2023-11-16T02:30:16.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd39ffff640 1 --2- 172.21.15.28:0/1300940640 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3a01455e0 0x7fd3a01d2e40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd38c011940 tx=0x7fd38c011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:16.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd39d7fa640 1 -- 172.21.15.28:0/1300940640 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c00fbc0 con 0x7fd3a01455e0 2023-11-16T02:30:16.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd39d7fa640 1 -- 172.21.15.28:0/1300940640 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38c00fd60 con 0x7fd3a01455e0 2023-11-16T02:30:16.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd3a6c0b640 1 -- 172.21.15.28:0/1300940640 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a01d4760 con 0x7fd3a01455e0 2023-11-16T02:30:16.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd39d7fa640 1 -- 172.21.15.28:0/1300940640 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c015650 con 0x7fd3a01455e0 2023-11-16T02:30:16.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd3a6c0b640 1 -- 172.21.15.28:0/1300940640 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a0145a60 con 0x7fd3a01455e0 2023-11-16T02:30:16.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd3a6c0b640 1 -- 172.21.15.28:0/1300940640 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a004e8a0 con 0x7fd3a01455e0 2023-11-16T02:30:16.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd39d7fa640 1 -- 172.21.15.28:0/1300940640 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd38c0157b0 con 0x7fd3a01455e0 2023-11-16T02:30:16.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd39d7fa640 1 --2- 172.21.15.28:0/1300940640 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fd384065a90 0x7fd384067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:16.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd39d7fa640 1 -- 172.21.15.28:0/1300940640 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd38c086140 con 0x7fd3a01455e0 2023-11-16T02:30:16.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.199+0000 7fd3a49a7640 1 --2- 172.21.15.28:0/1300940640 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fd384065a90 0x7fd384067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:16.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.203+0000 7fd3a49a7640 1 --2- 172.21.15.28:0/1300940640 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fd384065a90 0x7fd384067f50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd39400dae0 tx=0x7fd394008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:16.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.203+0000 7fd39d7fa640 1 -- 172.21.15.28:0/1300940640 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fd38c053fa0 con 0x7fd3a01455e0 2023-11-16T02:30:16.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.411+0000 7fd3a6c0b640 1 -- 172.21.15.28:0/1300940640 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fd3a00ba540 con 0x7fd3a01455e0 2023-11-16T02:30:16.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.415+0000 7fd39d7fa640 1 -- 172.21.15.28:0/1300940640 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd38c0575c0 con 0x7fd3a01455e0 2023-11-16T02:30:16.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.419+0000 7fd3a6c0b640 1 -- 172.21.15.28:0/1300940640 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fd384065a90 msgr2=0x7fd384067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:16.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.419+0000 7fd3a6c0b640 1 --2- 172.21.15.28:0/1300940640 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fd384065a90 0x7fd384067f50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd39400dae0 tx=0x7fd394008040 comp rx=0 tx=0).stop 2023-11-16T02:30:16.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.419+0000 7fd3a6c0b640 1 -- 172.21.15.28:0/1300940640 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3a01455e0 msgr2=0x7fd3a01d2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:16.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.419+0000 7fd3a6c0b640 1 --2- 172.21.15.28:0/1300940640 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3a01455e0 0x7fd3a01d2e40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd38c011940 tx=0x7fd38c011e00 comp rx=0 tx=0).stop 2023-11-16T02:30:16.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.419+0000 7fd3a6c0b640 1 -- 172.21.15.28:0/1300940640 shutdown_connections 2023-11-16T02:30:16.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.419+0000 7fd3a6c0b640 1 --2- 172.21.15.28:0/1300940640 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fd384065a90 0x7fd384067f50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.419+0000 7fd3a6c0b640 1 --2- 172.21.15.28:0/1300940640 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fd3a01d3380 0x7fd3a013c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.419+0000 7fd3a6c0b640 1 --2- 172.21.15.28:0/1300940640 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3a01455e0 0x7fd3a01d2e40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.419+0000 7fd3a6c0b640 1 --2- 172.21.15.28:0/1300940640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd390004d10 0x7fd3a01d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.419+0000 7fd3a6c0b640 1 -- 172.21.15.28:0/1300940640 >> 172.21.15.28:0/1300940640 conn(0x7fd3a006b7e0 msgr2=0x7fd3a00bb600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:16.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.419+0000 7fd3a6c0b640 1 -- 172.21.15.28:0/1300940640 shutdown_connections 2023-11-16T02:30:16.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.419+0000 7fd3a6c0b640 1 -- 172.21.15.28:0/1300940640 wait complete. 2023-11-16T02:30:16.438 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-16T02:30:16.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.543+0000 7f1e8c9fe640 1 Processor -- start 2023-11-16T02:30:16.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.543+0000 7f1e8c9fe640 1 -- start start 2023-11-16T02:30:16.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e8c9fe640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e88148960 0x7f1e88148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:16.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e8c9fe640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e880b52b0 con 0x7f1e880b8240 2023-11-16T02:30:16.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e8c9fe640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e880bcdb0 con 0x7f1e880b3450 2023-11-16T02:30:16.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e8c9fe640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880b6220 con 0x7f1e88148960 2023-11-16T02:30:16.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e8659c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f1e880b8240 0x7f1e880bc6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36962/0 (socket says 172.21.15.28:36962) 2023-11-16T02:30:16.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e8659c640 1 -- 172.21.15.28:0/95710296 learned_addr learned my addr 172.21.15.28:0/95710296 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:16.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e85d9b640 1 --2- 172.21.15.28:0/95710296 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e88148960 0x7f1e88148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:16.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e8559a640 1 -- 172.21.15.28:0/95710296 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424789719 0 0) 0x7f1e880b52b0 con 0x7f1e880b8240 2023-11-16T02:30:16.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e8559a640 1 -- 172.21.15.28:0/95710296 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e70003530 con 0x7f1e880b8240 2023-11-16T02:30:16.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e8559a640 1 -- 172.21.15.28:0/95710296 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1513453284 0 0) 0x7f1e70003530 con 0x7f1e880b8240 2023-11-16T02:30:16.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e8559a640 1 -- 172.21.15.28:0/95710296 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e88148960 msgr2=0x7f1e88148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:16.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e8559a640 1 --2- 172.21.15.28:0/95710296 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e88148960 0x7f1e88148dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e8559a640 1 -- 172.21.15.28:0/95710296 >> v1:172.21.15.70:6789/0 conn(0x7f1e880b3450 legacy=0x7f1e881532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:16.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e8559a640 1 -- 172.21.15.28:0/95710296 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e880b4040 con 0x7f1e880b8240 2023-11-16T02:30:16.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e8559a640 1 -- 172.21.15.28:0/95710296 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7f1e78001680 con 0x7f1e880b8240 2023-11-16T02:30:16.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e8559a640 1 -- 172.21.15.28:0/95710296 >> v1:172.21.15.28:6789/0 conn(0x7f1e880b8240 legacy=0x7f1e880bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:16.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e8559a640 1 --2- 172.21.15.28:0/95710296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e700039b0 0x7f1e70003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:16.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e8559a640 1 --2- 172.21.15.28:0/95710296 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e88148960 0x7f1e700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:16.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e8559a640 1 --2- 172.21.15.28:0/95710296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e70004d10 0x7f1e70005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:16.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e8559a640 1 -- 172.21.15.28:0/95710296 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880b6220 con 0x7f1e70004d10 2023-11-16T02:30:16.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e8559a640 1 -- 172.21.15.28:0/95710296 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7000ba40 con 0x7f1e700039b0 2023-11-16T02:30:16.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e8559a640 1 -- 172.21.15.28:0/95710296 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7000bc00 con 0x7f1e88148960 2023-11-16T02:30:16.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e86d9d640 1 --2- 172.21.15.28:0/95710296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e70004d10 0x7f1e70005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:16.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e85d9b640 1 --2- 172.21.15.28:0/95710296 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e88148960 0x7f1e700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:16.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e8659c640 1 --2- 172.21.15.28:0/95710296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e700039b0 0x7f1e70003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:16.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e86d9d640 1 -- 172.21.15.28:0/95710296 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e88148960 msgr2=0x7f1e700047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:16.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e86d9d640 1 --2- 172.21.15.28:0/95710296 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e88148960 0x7f1e700047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.554 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e86d9d640 1 -- 172.21.15.28:0/95710296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e700039b0 msgr2=0x7f1e70003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:16.555 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e86d9d640 1 --2- 172.21.15.28:0/95710296 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e700039b0 0x7f1e70003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.555 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e86d9d640 1 -- 172.21.15.28:0/95710296 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e70003530 con 0x7f1e70004d10 2023-11-16T02:30:16.555 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e85d9b640 1 --2- 172.21.15.28:0/95710296 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e88148960 0x7f1e700047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:30:16.555 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.547+0000 7f1e86d9d640 1 --2- 172.21.15.28:0/95710296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e70004d10 0x7f1e70005190 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1e80001e40 tx=0x7f1e8001c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d3988f6a3e51bb server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:16.555 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8559a640 1 -- 172.21.15.28:0/95710296 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e80003b80 con 0x7f1e70004d10 2023-11-16T02:30:16.555 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8559a640 1 -- 172.21.15.28:0/95710296 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e80003ce0 con 0x7f1e70004d10 2023-11-16T02:30:16.555 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8559a640 1 -- 172.21.15.28:0/95710296 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e800052c0 con 0x7f1e70004d10 2023-11-16T02:30:16.556 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8c9fe640 1 -- 172.21.15.28:0/95710296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e70004d10 msgr2=0x7f1e70005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:16.556 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8c9fe640 1 --2- 172.21.15.28:0/95710296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e70004d10 0x7f1e70005190 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1e80001e40 tx=0x7f1e8001c740 comp rx=0 tx=0).stop 2023-11-16T02:30:16.556 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e86d9d640 1 -- 172.21.15.28:0/95710296 reap_dead start 2023-11-16T02:30:16.556 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8c9fe640 1 -- 172.21.15.28:0/95710296 shutdown_connections 2023-11-16T02:30:16.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8c9fe640 1 -- 172.21.15.28:0/95710296 >> 172.21.15.28:0/95710296 conn(0x7f1e880b9050 msgr2=0x7f1e880bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:16.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8c9fe640 1 -- 172.21.15.28:0/95710296 shutdown_connections 2023-11-16T02:30:16.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8c9fe640 1 -- 172.21.15.28:0/95710296 wait complete. 2023-11-16T02:30:16.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8c9fe640 1 Processor -- start 2023-11-16T02:30:16.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8c9fe640 1 -- start start 2023-11-16T02:30:16.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8c9fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e70004d10 0x7f1e8814bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:16.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8c9fe640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e8814c830 0x7f1e8814a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:16.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8c9fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e8813d600 0x7f1e8813da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:16.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8c9fe640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8814c450 con 0x7f1e70004d10 2023-11-16T02:30:16.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8c9fe640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8814b320 con 0x7f1e8813d600 2023-11-16T02:30:16.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8c9fe640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e88145c70 con 0x7f1e8814c830 2023-11-16T02:30:16.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e70004d10 0x7f1e8814bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:16.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e70004d10 0x7f1e8814bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50732/0 (socket says 172.21.15.28:50732) 2023-11-16T02:30:16.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8659c640 1 -- 172.21.15.28:0/3200628485 learned_addr learned my addr 172.21.15.28:0/3200628485 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:16.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e86d9d640 1 --2- 172.21.15.28:0/3200628485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e8813d600 0x7f1e8813da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:16.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e85d9b640 1 --2- 172.21.15.28:0/3200628485 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e8814c830 0x7f1e8814a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:16.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8659c640 1 -- 172.21.15.28:0/3200628485 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e8814c830 msgr2=0x7f1e8814a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:16.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8659c640 1 --2- 172.21.15.28:0/3200628485 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e8814c830 0x7f1e8814a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8659c640 1 -- 172.21.15.28:0/3200628485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e8813d600 msgr2=0x7f1e8813da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:16.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8659c640 1 --2- 172.21.15.28:0/3200628485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e8813d600 0x7f1e8813da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8659c640 1 -- 172.21.15.28:0/3200628485 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8814a1d0 con 0x7f1e70004d10 2023-11-16T02:30:16.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e85d9b640 1 --2- 172.21.15.28:0/3200628485 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e8814c830 0x7f1e8814a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:16.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8659c640 1 --2- 172.21.15.28:0/3200628485 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e70004d10 0x7f1e8814bf10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1e7800e7f0 tx=0x7f1e7800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:16.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e76ffd640 1 -- 172.21.15.28:0/3200628485 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7800c8d0 con 0x7f1e70004d10 2023-11-16T02:30:16.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e76ffd640 1 -- 172.21.15.28:0/3200628485 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7800ca30 con 0x7f1e70004d10 2023-11-16T02:30:16.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8c9fe640 1 -- 172.21.15.28:0/3200628485 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e881d2300 con 0x7f1e70004d10 2023-11-16T02:30:16.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e76ffd640 1 -- 172.21.15.28:0/3200628485 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7800cde0 con 0x7f1e70004d10 2023-11-16T02:30:16.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.551+0000 7f1e8c9fe640 1 -- 172.21.15.28:0/3200628485 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e8813dfc0 con 0x7f1e70004d10 2023-11-16T02:30:16.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.555+0000 7f1e8c9fe640 1 -- 172.21.15.28:0/3200628485 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8804e8a0 con 0x7f1e70004d10 2023-11-16T02:30:16.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.555+0000 7f1e76ffd640 1 -- 172.21.15.28:0/3200628485 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1e7801d460 con 0x7f1e70004d10 2023-11-16T02:30:16.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.555+0000 7f1e76ffd640 1 --2- 172.21.15.28:0/3200628485 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1e68065a60 0x7f1e68067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:16.563 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.555+0000 7f1e76ffd640 1 -- 172.21.15.28:0/3200628485 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1e78082ec0 con 0x7f1e70004d10 2023-11-16T02:30:16.563 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.555+0000 7f1e85d9b640 1 --2- 172.21.15.28:0/3200628485 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1e68065a60 0x7f1e68067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:16.563 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.555+0000 7f1e85d9b640 1 --2- 172.21.15.28:0/3200628485 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1e68065a60 0x7f1e68067f20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1e880bbd50 tx=0x7f1e7c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:16.563 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.559+0000 7f1e76ffd640 1 -- 172.21.15.28:0/3200628485 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f1e78050b30 con 0x7f1e70004d10 2023-11-16T02:30:16.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.711+0000 7f1e8c9fe640 1 -- 172.21.15.28:0/3200628485 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e88149b40 con 0x7f1e70004d10 2023-11-16T02:30:16.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.711+0000 7f1e76ffd640 1 -- 172.21.15.28:0/3200628485 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12341 (secure 0 0 0) 0x7f1e78054150 con 0x7f1e70004d10 2023-11-16T02:30:16.715 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:30:16.715 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":29,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","created":"2023-11-16T02:29:13.710567+0000","modified":"2023-11-16T02:30:13.804848+0000","last_up_change":"2023-11-16T02:29:24.841087+0000","last_in_change":"2023-11-16T02:29:16.024490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-16T02:29:26.490910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dfa8b58d-3481-4e68-86e8-21873d31d0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":38722},{"type":"v1","addr":"172.21.15.28:6809","nonce":38722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":38722},{"type":"v1","addr":"172.21.15.28:6811","nonce":38722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":38722},{"type":"v1","addr":"172.21.15.28:6815","nonce":38722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":38722},{"type":"v1","addr":"172.21.15.28:6813","nonce":38722}]},"public_addr":"172.21.15.28:6809/38722","cluster_addr":"172.21.15.28:6811/38722","heartbeat_back_addr":"172.21.15.28:6815/38722","heartbeat_front_addr":"172.21.15.28:6813/38722","state":["exists","up"]},{"osd":1,"uuid":"1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":38724},{"type":"v1","addr":"172.21.15.28:6824","nonce":38724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":38724},{"type":"v1","addr":"172.21.15.28:6827","nonce":38724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":38724},{"type":"v1","addr":"172.21.15.28:6831","nonce":38724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":38724},{"type":"v1","addr":"172.21.15.28:6829","nonce":38724}]},"public_addr":"172.21.15.28:6824/38724","cluster_addr":"172.21.15.28:6827/38724","heartbeat_back_addr":"172.21.15.28:6831/38724","heartbeat_front_addr":"172.21.15.28:6829/38724","state":["exists","up"]},{"osd":2,"uuid":"e18f39cd-6a35-4d36-9eed-3877794bf2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":38723},{"type":"v1","addr":"172.21.15.28:6801","nonce":38723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":38723},{"type":"v1","addr":"172.21.15.28:6803","nonce":38723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":38723},{"type":"v1","addr":"172.21.15.28:6807","nonce":38723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":38723},{"type":"v1","addr":"172.21.15.28:6805","nonce":38723}]},"public_addr":"172.21.15.28:6801/38723","cluster_addr":"172.21.15.28:6803/38723","heartbeat_back_addr":"172.21.15.28:6807/38723","heartbeat_front_addr":"172.21.15.28:6805/38723","state":["exists","up"]},{"osd":3,"uuid":"303d0728-409d-47d7-b7a6-6eb273f602fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":38725},{"type":"v1","addr":"172.21.15.28:6817","nonce":38725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":38725},{"type":"v1","addr":"172.21.15.28:6819","nonce":38725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":38725},{"type":"v1","addr":"172.21.15.28:6825","nonce":38725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":38725},{"type":"v1","addr":"172.21.15.28:6821","nonce":38725}]},"public_addr":"172.21.15.28:6817/38725","cluster_addr":"172.21.15.28:6819/38725","heartbeat_back_addr":"172.21.15.28:6825/38725","heartbeat_front_addr":"172.21.15.28:6821/38725","state":["exists","up"]},{"osd":4,"uuid":"df0bf0ac-6efe-4964-ad27-7c1771a70c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":38828},{"type":"v1","addr":"172.21.15.70:6801","nonce":38828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":38828},{"type":"v1","addr":"172.21.15.70:6803","nonce":38828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":38828},{"type":"v1","addr":"172.21.15.70:6807","nonce":38828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":38828},{"type":"v1","addr":"172.21.15.70:6805","nonce":38828}]},"public_addr":"172.21.15.70:6801/38828","cluster_addr":"172.21.15.70:6803/38828","heartbeat_back_addr":"172.21.15.70:6807/38828","heartbeat_front_addr":"172.21.15.70:6805/38828","state":["exists","up"]},{"osd":5,"uuid":"84921219-65cb-4c4e-b9ed-a773db639034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":38830},{"type":"v1","addr":"172.21.15.70:6810","nonce":38830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6813","nonce":38830},{"type":"v1","addr":"172.21.15.70:6814","nonce":38830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":38830},{"type":"v1","addr":"172.21.15.70:6824","nonce":38830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":38830},{"type":"v1","addr":"172.21.15.70:6819","nonce":38830}]},"public_addr":"172.21.15.70:6810/38830","cluster_addr":"172.21.15.70:6814/38830","heartbeat_back_addr":"172.21.15.70:6824/38830","heartbeat_front_addr":"172.21.15.70:6819/38830","state":["exists","up"]},{"osd":6,"uuid":"c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":38829},{"type":"v1","addr":"172.21.15.70:6812","nonce":38829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":38829},{"type":"v1","addr":"172.21.15.70:6820","nonce":38829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":38829},{"type":"v1","addr":"172.21.15.70:6828","nonce":38829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":38829},{"type":"v1","addr":"172.21.15.70:6825","nonce":38829}]},"public_addr":"172.21.15.70:6812/38829","cluster_addr":"172.21.15.70:6820/38829","heartbeat_back_addr":"172.21.15.70:6828/38829","heartbeat_front_addr":"172.21.15.70:6825/38829","state":["exists","up"]},{"osd":7,"uuid":"e2cdd418-12ce-4eea-9b22-efdad83eb76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":38839},{"type":"v1","addr":"172.21.15.70:6815","nonce":38839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":38839},{"type":"v1","addr":"172.21.15.70:6823","nonce":38839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":38839},{"type":"v1","addr":"172.21.15.70:6831","nonce":38839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6827","nonce":38839},{"type":"v1","addr":"172.21.15.70:6829","nonce":38839}]},"public_addr":"172.21.15.70:6815/38839","cluster_addr":"172.21.15.70:6823/38839","heartbeat_back_addr":"172.21.15.70:6831/38839","heartbeat_front_addr":"172.21.15.70:6829/38839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.544240+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.637637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.352115+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.652916+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.624477+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.570247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.706468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.696574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-16T02:30:16.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.715+0000 7f1e8c9fe640 1 -- 172.21.15.28:0/3200628485 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1e68065a60 msgr2=0x7f1e68067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:16.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.715+0000 7f1e8c9fe640 1 --2- 172.21.15.28:0/3200628485 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1e68065a60 0x7f1e68067f20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1e880bbd50 tx=0x7f1e7c008040 comp rx=0 tx=0).stop 2023-11-16T02:30:16.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.715+0000 7f1e8c9fe640 1 -- 172.21.15.28:0/3200628485 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e70004d10 msgr2=0x7f1e8814bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:16.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.715+0000 7f1e8c9fe640 1 --2- 172.21.15.28:0/3200628485 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e70004d10 0x7f1e8814bf10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1e7800e7f0 tx=0x7f1e7800ecb0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.715+0000 7f1e8c9fe640 1 -- 172.21.15.28:0/3200628485 shutdown_connections 2023-11-16T02:30:16.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.715+0000 7f1e8c9fe640 1 --2- 172.21.15.28:0/3200628485 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1e68065a60 0x7f1e68067f20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.715+0000 7f1e8c9fe640 1 --2- 172.21.15.28:0/3200628485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e8813d600 0x7f1e8813da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.715+0000 7f1e8c9fe640 1 --2- 172.21.15.28:0/3200628485 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1e8814c830 0x7f1e8814a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.715+0000 7f1e8c9fe640 1 --2- 172.21.15.28:0/3200628485 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e70004d10 0x7f1e8814bf10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.715+0000 7f1e8c9fe640 1 -- 172.21.15.28:0/3200628485 >> 172.21.15.28:0/3200628485 conn(0x7f1e880b9050 msgr2=0x7f1e88071470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:16.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.715+0000 7f1e8c9fe640 1 -- 172.21.15.28:0/3200628485 shutdown_connections 2023-11-16T02:30:16.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.715+0000 7f1e8c9fe640 1 -- 172.21.15.28:0/3200628485 wait complete. 2023-11-16T02:30:16.732 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-16T02:29:26.490910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-16T02:30:16.733 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-16T02:30:16.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.847+0000 7f35341e0640 1 Processor -- start 2023-11-16T02:30:16.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.847+0000 7f35341e0640 1 -- start start 2023-11-16T02:30:16.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.847+0000 7f35341e0640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f352c1415b0 0x7f352c0ba410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:16.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.847+0000 7f35341e0640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f352c0b8340 0x7f352c0b87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:16.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.847+0000 7f35341e0640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f352c0b78a0 con 0x7f352c14e0f0 2023-11-16T02:30:16.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.847+0000 7f35341e0640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f352c0ba060 con 0x7f352c1415b0 2023-11-16T02:30:16.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.847+0000 7f35341e0640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352c0b9390 con 0x7f352c0b8340 2023-11-16T02:30:16.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.847+0000 7f3531f7c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f352c1415b0 0x7f352c0ba410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:16.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.847+0000 7f3531f7c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f352c1415b0 0x7f352c0ba410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50746/0 (socket says 172.21.15.28:50746) 2023-11-16T02:30:16.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.847+0000 7f3531f7c640 1 -- 172.21.15.28:0/2894461308 learned_addr learned my addr 172.21.15.28:0/2894461308 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:16.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.847+0000 7f3531f7c640 1 -- 172.21.15.28:0/2894461308 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f352c0b8340 msgr2=0x7f352c0b87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:16.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.847+0000 7f3531f7c640 1 --2- 172.21.15.28:0/2894461308 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f352c0b8340 0x7f352c0b87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.847+0000 7f3531f7c640 1 -- 172.21.15.28:0/2894461308 >> v1:172.21.15.28:6789/0 conn(0x7f352c14e0f0 legacy=0x7f352c14e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:16.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.847+0000 7f3531f7c640 1 -- 172.21.15.28:0/2894461308 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352c0b8ce0 con 0x7f352c1415b0 2023-11-16T02:30:16.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f3531f7c640 1 --2- 172.21.15.28:0/2894461308 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f352c1415b0 0x7f352c0ba410 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3528009870 tx=0x7f352801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22aee1d8841fb8f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:16.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f3530f7a640 1 -- 172.21.15.28:0/2894461308 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35280a9400 con 0x7f352c1415b0 2023-11-16T02:30:16.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f3530f7a640 1 -- 172.21.15.28:0/2894461308 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35280a9560 con 0x7f352c1415b0 2023-11-16T02:30:16.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f3530f7a640 1 -- 172.21.15.28:0/2894461308 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35280a98f0 con 0x7f352c1415b0 2023-11-16T02:30:16.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f35341e0640 1 -- 172.21.15.28:0/2894461308 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f352c1415b0 msgr2=0x7f352c0ba410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:16.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f35341e0640 1 --2- 172.21.15.28:0/2894461308 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f352c1415b0 0x7f352c0ba410 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3528009870 tx=0x7f352801c540 comp rx=0 tx=0).stop 2023-11-16T02:30:16.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f35341e0640 1 -- 172.21.15.28:0/2894461308 shutdown_connections 2023-11-16T02:30:16.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f35341e0640 1 --2- 172.21.15.28:0/2894461308 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f352c0b8340 0x7f352c0b87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f35341e0640 1 --2- 172.21.15.28:0/2894461308 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f352c1415b0 0x7f352c0ba410 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f35341e0640 1 -- 172.21.15.28:0/2894461308 >> 172.21.15.28:0/2894461308 conn(0x7f352c06b7e0 msgr2=0x7f352c06bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:16.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f35341e0640 1 -- 172.21.15.28:0/2894461308 shutdown_connections 2023-11-16T02:30:16.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f35341e0640 1 -- 172.21.15.28:0/2894461308 wait complete. 2023-11-16T02:30:16.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f35341e0640 1 Processor -- start 2023-11-16T02:30:16.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f35341e0640 1 -- start start 2023-11-16T02:30:16.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f35341e0640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f352c0b8340 0x7f352c136200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:16.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f35341e0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f352c1415b0 0x7f352c1e37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:16.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f35341e0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f352c14e0f0 0x7f352c13de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:16.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f35341e0640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352c13e3d0 con 0x7f352c1415b0 2023-11-16T02:30:16.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f35341e0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352c1e2d00 con 0x7f352c14e0f0 2023-11-16T02:30:16.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f35341e0640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352c137f40 con 0x7f352c0b8340 2023-11-16T02:30:16.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f353177b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f352c1415b0 0x7f352c1e37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:16.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f353177b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f352c1415b0 0x7f352c1e37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50754/0 (socket says 172.21.15.28:50754) 2023-11-16T02:30:16.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f353177b640 1 -- 172.21.15.28:0/1982471114 learned_addr learned my addr 172.21.15.28:0/1982471114 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:16.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f353277d640 1 --2- 172.21.15.28:0/1982471114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f352c14e0f0 0x7f352c13de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:16.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f3531f7c640 1 --2- 172.21.15.28:0/1982471114 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f352c0b8340 0x7f352c136200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:16.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f353177b640 1 -- 172.21.15.28:0/1982471114 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f352c0b8340 msgr2=0x7f352c136200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:16.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f353177b640 1 --2- 172.21.15.28:0/1982471114 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f352c0b8340 0x7f352c136200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f353177b640 1 -- 172.21.15.28:0/1982471114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f352c14e0f0 msgr2=0x7f352c13de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:16.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f353177b640 1 --2- 172.21.15.28:0/1982471114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f352c14e0f0 0x7f352c13de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:16.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f353177b640 1 -- 172.21.15.28:0/1982471114 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35280094d0 con 0x7f352c1415b0 2023-11-16T02:30:16.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f353277d640 1 --2- 172.21.15.28:0/1982471114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f352c14e0f0 0x7f352c13de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:16.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f3531f7c640 1 --2- 172.21.15.28:0/1982471114 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f352c0b8340 0x7f352c136200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:16.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f353177b640 1 --2- 172.21.15.28:0/1982471114 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f352c1415b0 0x7f352c1e37a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f351c00b410 tx=0x7f351c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:16.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f35227fc640 1 -- 172.21.15.28:0/1982471114 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c011830 con 0x7f352c1415b0 2023-11-16T02:30:16.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f35227fc640 1 -- 172.21.15.28:0/1982471114 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351c011990 con 0x7f352c1415b0 2023-11-16T02:30:16.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f35341e0640 1 -- 172.21.15.28:0/1982471114 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f352c1e2fa0 con 0x7f352c1415b0 2023-11-16T02:30:16.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f35227fc640 1 -- 172.21.15.28:0/1982471114 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c011d40 con 0x7f352c1415b0 2023-11-16T02:30:16.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.851+0000 7f35341e0640 1 -- 172.21.15.28:0/1982471114 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f352c142200 con 0x7f352c1415b0 2023-11-16T02:30:16.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.855+0000 7f35341e0640 1 -- 172.21.15.28:0/1982471114 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f352c1e34c0 con 0x7f352c1415b0 2023-11-16T02:30:16.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.855+0000 7f35227fc640 1 -- 172.21.15.28:0/1982471114 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f351c01a400 con 0x7f352c1415b0 2023-11-16T02:30:16.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.855+0000 7f35227fc640 1 --2- 172.21.15.28:0/1982471114 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3510065a60 0x7f3510067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:16.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.855+0000 7f35227fc640 1 -- 172.21.15.28:0/1982471114 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f351c082fd0 con 0x7f352c1415b0 2023-11-16T02:30:16.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.855+0000 7f3531f7c640 1 --2- 172.21.15.28:0/1982471114 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3510065a60 0x7f3510067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:16.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.855+0000 7f3531f7c640 1 --2- 172.21.15.28:0/1982471114 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3510065a60 0x7f3510067f20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f35280ae000 tx=0x7f35280b3040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:16.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:16.859+0000 7f35227fc640 1 -- 172.21.15.28:0/1982471114 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f352c1e34c0 con 0x7f352c1415b0 2023-11-16T02:30:17.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.007+0000 7f35341e0640 1 -- 172.21.15.28:0/1982471114 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f352c1e34c0 con 0x7f352c1415b0 2023-11-16T02:30:17.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.007+0000 7f35227fc640 1 -- 172.21.15.28:0/1982471114 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f352c1e34c0 con 0x7f352c1415b0 2023-11-16T02:30:17.012 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-11-16T02:30:17.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.011+0000 7f35341e0640 1 -- 172.21.15.28:0/1982471114 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3510065a60 msgr2=0x7f3510067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:17.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.011+0000 7f35341e0640 1 --2- 172.21.15.28:0/1982471114 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3510065a60 0x7f3510067f20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f35280ae000 tx=0x7f35280b3040 comp rx=0 tx=0).stop 2023-11-16T02:30:17.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.011+0000 7f35341e0640 1 -- 172.21.15.28:0/1982471114 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f352c1415b0 msgr2=0x7f352c1e37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:17.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.011+0000 7f35341e0640 1 --2- 172.21.15.28:0/1982471114 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f352c1415b0 0x7f352c1e37a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f351c00b410 tx=0x7f351c00b8d0 comp rx=0 tx=0).stop 2023-11-16T02:30:17.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.011+0000 7f35341e0640 1 -- 172.21.15.28:0/1982471114 shutdown_connections 2023-11-16T02:30:17.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.011+0000 7f35341e0640 1 --2- 172.21.15.28:0/1982471114 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3510065a60 0x7f3510067f20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:17.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.011+0000 7f35341e0640 1 --2- 172.21.15.28:0/1982471114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f352c14e0f0 0x7f352c13de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:17.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.011+0000 7f35341e0640 1 --2- 172.21.15.28:0/1982471114 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f352c1415b0 0x7f352c1e37a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:17.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.011+0000 7f35341e0640 1 --2- 172.21.15.28:0/1982471114 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f352c0b8340 0x7f352c136200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:17.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.011+0000 7f35341e0640 1 -- 172.21.15.28:0/1982471114 >> 172.21.15.28:0/1982471114 conn(0x7f352c06b7e0 msgr2=0x7f352c14e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:17.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.011+0000 7f35341e0640 1 -- 172.21.15.28:0/1982471114 shutdown_connections 2023-11-16T02:30:17.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.011+0000 7f35341e0640 1 -- 172.21.15.28:0/1982471114 wait complete. 2023-11-16T02:30:17.029 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-16T02:30:17.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.151+0000 7fb68e028640 1 Processor -- start 2023-11-16T02:30:17.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.151+0000 7fb68e028640 1 -- start start 2023-11-16T02:30:17.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.151+0000 7fb68e028640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb688148960 0x7fb6880b3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:17.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.151+0000 7fb68e028640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb688148df0 0x7fb6880b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:17.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.151+0000 7fb68e028640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6880b52b0 con 0x7fb6880b8240 2023-11-16T02:30:17.154 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.151+0000 7fb68e028640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6880bcdb0 con 0x7fb688148df0 2023-11-16T02:30:17.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.151+0000 7fb68e028640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6880b6220 con 0x7fb688148960 2023-11-16T02:30:17.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.151+0000 7fb687fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb688148df0 0x7fb6880b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:17.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.151+0000 7fb687fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb688148df0 0x7fb6880b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50770/0 (socket says 172.21.15.28:50770) 2023-11-16T02:30:17.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.151+0000 7fb687fff640 1 -- 172.21.15.28:0/2328709568 learned_addr learned my addr 172.21.15.28:0/2328709568 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:17.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.151+0000 7fb686ffd640 1 --2- 172.21.15.28:0/2328709568 >> v2:172.21.15.70:3300/0 conn(0x7fb688148960 0x7fb6880b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:17.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.151+0000 7fb687fff640 1 -- 172.21.15.28:0/2328709568 >> v2:172.21.15.70:3300/0 conn(0x7fb688148960 msgr2=0x7fb6880b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:17.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.151+0000 7fb687fff640 1 --2- 172.21.15.28:0/2328709568 >> v2:172.21.15.70:3300/0 conn(0x7fb688148960 0x7fb6880b3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:17.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.151+0000 7fb687fff640 1 -- 172.21.15.28:0/2328709568 >> v1:172.21.15.70:6789/0 conn(0x7fb6880b8240 legacy=0x7fb6880bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:17.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.151+0000 7fb687fff640 1 -- 172.21.15.28:0/2328709568 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6880b4040 con 0x7fb688148df0 2023-11-16T02:30:17.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.151+0000 7fb686ffd640 1 --2- 172.21.15.28:0/2328709568 >> v2:172.21.15.70:3300/0 conn(0x7fb688148960 0x7fb6880b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:17.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb687fff640 1 --2- 172.21.15.28:0/2328709568 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb688148df0 0x7fb6880b3990 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb6880bd040 tx=0x7fb68001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277d161a6c789ef7 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:17.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb6867fc640 1 -- 172.21.15.28:0/2328709568 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6800a5820 con 0x7fb688148df0 2023-11-16T02:30:17.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb6867fc640 1 -- 172.21.15.28:0/2328709568 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6800a5980 con 0x7fb688148df0 2023-11-16T02:30:17.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb6867fc640 1 -- 172.21.15.28:0/2328709568 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6800a5d10 con 0x7fb688148df0 2023-11-16T02:30:17.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb68e028640 1 -- 172.21.15.28:0/2328709568 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb688148df0 msgr2=0x7fb6880b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:17.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb68e028640 1 --2- 172.21.15.28:0/2328709568 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb688148df0 0x7fb6880b3990 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb6880bd040 tx=0x7fb68001c960 comp rx=0 tx=0).stop 2023-11-16T02:30:17.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb68e028640 1 -- 172.21.15.28:0/2328709568 shutdown_connections 2023-11-16T02:30:17.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb68e028640 1 --2- 172.21.15.28:0/2328709568 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb688148df0 0x7fb6880b3990 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:17.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb68e028640 1 --2- 172.21.15.28:0/2328709568 >> v2:172.21.15.70:3300/0 conn(0x7fb688148960 0x7fb6880b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:17.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb68e028640 1 -- 172.21.15.28:0/2328709568 >> 172.21.15.28:0/2328709568 conn(0x7fb6880b9050 msgr2=0x7fb6880bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:17.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb68e028640 1 -- 172.21.15.28:0/2328709568 shutdown_connections 2023-11-16T02:30:17.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb68e028640 1 -- 172.21.15.28:0/2328709568 wait complete. 2023-11-16T02:30:17.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb68e028640 1 Processor -- start 2023-11-16T02:30:17.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb68e028640 1 -- start start 2023-11-16T02:30:17.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb68e028640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6880b8240 0x7fb688143380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:17.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb68e028640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb688148960 0x7fb6880708e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:17.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb68e028640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb688148df0 0x7fb688140900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:17.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb68e028640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68813ffd0 con 0x7fb688148df0 2023-11-16T02:30:17.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb68e028640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb688139fa0 con 0x7fb6880b8240 2023-11-16T02:30:17.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb68e028640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb688140e40 con 0x7fb688148960 2023-11-16T02:30:17.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb687fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb688148df0 0x7fb688140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:17.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb687fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb688148df0 0x7fb688140900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50786/0 (socket says 172.21.15.28:50786) 2023-11-16T02:30:17.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb687fff640 1 -- 172.21.15.28:0/344629620 learned_addr learned my addr 172.21.15.28:0/344629620 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:17.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb6877fe640 1 --2- 172.21.15.28:0/344629620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6880b8240 0x7fb688143380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:17.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb687fff640 1 -- 172.21.15.28:0/344629620 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb688148960 msgr2=0x7fb6880708e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:17.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb687fff640 1 --2- 172.21.15.28:0/344629620 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb688148960 0x7fb6880708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:17.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb687fff640 1 -- 172.21.15.28:0/344629620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6880b8240 msgr2=0x7fb688143380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:17.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb687fff640 1 --2- 172.21.15.28:0/344629620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6880b8240 0x7fb688143380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:17.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb687fff640 1 -- 172.21.15.28:0/344629620 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb680009b30 con 0x7fb688148df0 2023-11-16T02:30:17.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb687fff640 1 --2- 172.21.15.28:0/344629620 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb688148df0 0x7fb688140900 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb68001a590 tx=0x7fb680019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:17.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb66ffff640 1 -- 172.21.15.28:0/344629620 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6800b8670 con 0x7fb688148df0 2023-11-16T02:30:17.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb66ffff640 1 -- 172.21.15.28:0/344629620 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6800b8810 con 0x7fb688148df0 2023-11-16T02:30:17.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb66ffff640 1 -- 172.21.15.28:0/344629620 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6800b8bc0 con 0x7fb688148df0 2023-11-16T02:30:17.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb68e028640 1 -- 172.21.15.28:0/344629620 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6881e6370 con 0x7fb688148df0 2023-11-16T02:30:17.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.155+0000 7fb68e028640 1 -- 172.21.15.28:0/344629620 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb68813fcf0 con 0x7fb688148df0 2023-11-16T02:30:17.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.159+0000 7fb68e028640 1 -- 172.21.15.28:0/344629620 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb68804e8a0 con 0x7fb688148df0 2023-11-16T02:30:17.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.159+0000 7fb66ffff640 1 -- 172.21.15.28:0/344629620 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb6800b8d20 con 0x7fb688148df0 2023-11-16T02:30:17.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.159+0000 7fb66ffff640 1 --2- 172.21.15.28:0/344629620 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb674065a60 0x7fb674067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:17.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.159+0000 7fb66ffff640 1 -- 172.21.15.28:0/344629620 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb68011e300 con 0x7fb688148df0 2023-11-16T02:30:17.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.159+0000 7fb6877fe640 1 --2- 172.21.15.28:0/344629620 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb674065a60 0x7fb674067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:17.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.159+0000 7fb6877fe640 1 --2- 172.21.15.28:0/344629620 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb674065a60 0x7fb674067f20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb678003d60 tx=0x7fb678009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:17.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.163+0000 7fb66ffff640 1 -- 172.21.15.28:0/344629620 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fb6800ec1c0 con 0x7fb688148df0 2023-11-16T02:30:17.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.319+0000 7fb68e028640 1 -- 172.21.15.28:0/344629620 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb6880b6420 con 0x7fb688148df0 2023-11-16T02:30:17.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.323+0000 7fb66ffff640 1 -- 172.21.15.28:0/344629620 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb6800ef7e0 con 0x7fb688148df0 2023-11-16T02:30:17.325 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:30:17.325 INFO:teuthology.orchestra.run.smithi028.stdout:[ 2023-11-16T02:30:17.325 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-16T02:30:17.325 INFO:teuthology.orchestra.run.smithi028.stdout: "poolnum": 1, 2023-11-16T02:30:17.325 INFO:teuthology.orchestra.run.smithi028.stdout: "poolname": ".mgr" 2023-11-16T02:30:17.325 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-16T02:30:17.325 INFO:teuthology.orchestra.run.smithi028.stdout:] 2023-11-16T02:30:17.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.323+0000 7fb68e028640 1 -- 172.21.15.28:0/344629620 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb674065a60 msgr2=0x7fb674067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:17.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.323+0000 7fb68e028640 1 --2- 172.21.15.28:0/344629620 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb674065a60 0x7fb674067f20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb678003d60 tx=0x7fb678009040 comp rx=0 tx=0).stop 2023-11-16T02:30:17.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.323+0000 7fb68e028640 1 -- 172.21.15.28:0/344629620 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb688148df0 msgr2=0x7fb688140900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:17.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.323+0000 7fb68e028640 1 --2- 172.21.15.28:0/344629620 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb688148df0 0x7fb688140900 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb68001a590 tx=0x7fb680019700 comp rx=0 tx=0).stop 2023-11-16T02:30:17.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.323+0000 7fb68e028640 1 -- 172.21.15.28:0/344629620 shutdown_connections 2023-11-16T02:30:17.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.323+0000 7fb68e028640 1 --2- 172.21.15.28:0/344629620 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb674065a60 0x7fb674067f20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:17.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.323+0000 7fb68e028640 1 --2- 172.21.15.28:0/344629620 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb688148df0 0x7fb688140900 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:17.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.323+0000 7fb68e028640 1 --2- 172.21.15.28:0/344629620 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb688148960 0x7fb6880708e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:17.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.323+0000 7fb68e028640 1 --2- 172.21.15.28:0/344629620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6880b8240 0x7fb688143380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:17.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.323+0000 7fb68e028640 1 -- 172.21.15.28:0/344629620 >> 172.21.15.28:0/344629620 conn(0x7fb6880b9050 msgr2=0x7fb6880715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:17.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.323+0000 7fb68e028640 1 -- 172.21.15.28:0/344629620 shutdown_connections 2023-11-16T02:30:17.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.323+0000 7fb68e028640 1 -- 172.21.15.28:0/344629620 wait complete. 2023-11-16T02:30:17.344 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-16T02:30:17.344 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-16T02:30:17.475 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.471+0000 7fe2cdcba640 1 Processor -- start 2023-11-16T02:30:17.475 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.471+0000 7fe2cdcba640 1 -- start start 2023-11-16T02:30:17.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.471+0000 7fe2cdcba640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe2c80ba110 0x7fe2c80710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:17.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.471+0000 7fe2cdcba640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe2c80b8350 0x7fe2c8142800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:17.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.471+0000 7fe2cdcba640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c80b5a90 con 0x7fe2c8071620 2023-11-16T02:30:17.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.471+0000 7fe2cdcba640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c80b5d70 con 0x7fe2c80b8350 2023-11-16T02:30:17.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.471+0000 7fe2cdcba640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c80b6050 con 0x7fe2c80ba110 2023-11-16T02:30:17.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.475+0000 7fe2c7fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe2c80b8350 0x7fe2c8142800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:17.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.475+0000 7fe2c7fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe2c80b8350 0x7fe2c8142800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50796/0 (socket says 172.21.15.28:50796) 2023-11-16T02:30:17.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.475+0000 7fe2c7fff640 1 -- 172.21.15.28:0/3261949672 learned_addr learned my addr 172.21.15.28:0/3261949672 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:17.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.475+0000 7fe2c77fe640 1 --2- 172.21.15.28:0/3261949672 >> v2:172.21.15.70:3300/0 conn(0x7fe2c80ba110 0x7fe2c80710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:17.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.475+0000 7fe2c7fff640 1 -- 172.21.15.28:0/3261949672 >> v2:172.21.15.70:3300/0 conn(0x7fe2c80ba110 msgr2=0x7fe2c80710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:17.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.475+0000 7fe2c7fff640 1 --2- 172.21.15.28:0/3261949672 >> v2:172.21.15.70:3300/0 conn(0x7fe2c80ba110 0x7fe2c80710e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:17.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.475+0000 7fe2c7fff640 1 -- 172.21.15.28:0/3261949672 >> v1:172.21.15.70:6789/0 conn(0x7fe2c8071620 legacy=0x7fe2c80b7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:17.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.475+0000 7fe2c7fff640 1 -- 172.21.15.28:0/3261949672 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c80ba4f0 con 0x7fe2c80b8350 2023-11-16T02:30:17.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.475+0000 7fe2c7fff640 1 --2- 172.21.15.28:0/3261949672 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2c80b8350 0x7fe2c8142800 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80bee20 tx=0x7fe2c001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88956a80f0b323ef server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:17.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.475+0000 7fe2c67fc640 1 -- 172.21.15.28:0/3261949672 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c00ab680 con 0x7fe2c80b8350 2023-11-16T02:30:17.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.475+0000 7fe2c67fc640 1 -- 172.21.15.28:0/3261949672 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c00ab7e0 con 0x7fe2c80b8350 2023-11-16T02:30:17.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.475+0000 7fe2c67fc640 1 -- 172.21.15.28:0/3261949672 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c00abb70 con 0x7fe2c80b8350 2023-11-16T02:30:17.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.475+0000 7fe2cdcba640 1 -- 172.21.15.28:0/3261949672 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2c80b8350 msgr2=0x7fe2c8142800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:17.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.475+0000 7fe2cdcba640 1 --2- 172.21.15.28:0/3261949672 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2c80b8350 0x7fe2c8142800 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80bee20 tx=0x7fe2c001c4c0 comp rx=0 tx=0).stop 2023-11-16T02:30:17.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2cdcba640 1 -- 172.21.15.28:0/3261949672 shutdown_connections 2023-11-16T02:30:17.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2cdcba640 1 --2- 172.21.15.28:0/3261949672 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2c80b8350 0x7fe2c8142800 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:17.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2cdcba640 1 --2- 172.21.15.28:0/3261949672 >> v2:172.21.15.70:3300/0 conn(0x7fe2c80ba110 0x7fe2c80710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:17.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2cdcba640 1 -- 172.21.15.28:0/3261949672 >> 172.21.15.28:0/3261949672 conn(0x7fe2c80be280 msgr2=0x7fe2c80be660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:17.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2cdcba640 1 -- 172.21.15.28:0/3261949672 shutdown_connections 2023-11-16T02:30:17.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2cdcba640 1 -- 172.21.15.28:0/3261949672 wait complete. 2023-11-16T02:30:17.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2cdcba640 1 Processor -- start 2023-11-16T02:30:17.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2cdcba640 1 -- start start 2023-11-16T02:30:17.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2cdcba640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2c8071620 0x7fe2c8138c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:17.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2cdcba640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe2c80b8350 0x7fe2c813f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:17.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2cdcba640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2c80ba110 0x7fe2c81e6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:17.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2cdcba640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c813fb20 con 0x7fe2c8071620 2023-11-16T02:30:17.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2cdcba640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c8138460 con 0x7fe2c80ba110 2023-11-16T02:30:17.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2cdcba640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c8143580 con 0x7fe2c80b8350 2023-11-16T02:30:17.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2c77fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2c8071620 0x7fe2c8138c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:17.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2c77fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2c8071620 0x7fe2c8138c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50812/0 (socket says 172.21.15.28:50812) 2023-11-16T02:30:17.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2c77fe640 1 -- 172.21.15.28:0/3878050099 learned_addr learned my addr 172.21.15.28:0/3878050099 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:17.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2c7fff640 1 --2- 172.21.15.28:0/3878050099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2c80ba110 0x7fe2c81e6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:17.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2c6ffd640 1 --2- 172.21.15.28:0/3878050099 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe2c80b8350 0x7fe2c813f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:17.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2c77fe640 1 -- 172.21.15.28:0/3878050099 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe2c80b8350 msgr2=0x7fe2c813f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:17.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2c77fe640 1 --2- 172.21.15.28:0/3878050099 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe2c80b8350 0x7fe2c813f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:17.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2c77fe640 1 -- 172.21.15.28:0/3878050099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2c80ba110 msgr2=0x7fe2c81e6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:17.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2c77fe640 1 --2- 172.21.15.28:0/3878050099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2c80ba110 0x7fe2c81e6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:17.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2c77fe640 1 -- 172.21.15.28:0/3878050099 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c00094d0 con 0x7fe2c8071620 2023-11-16T02:30:17.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2c7fff640 1 --2- 172.21.15.28:0/3878050099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2c80ba110 0x7fe2c81e6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:17.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2c77fe640 1 --2- 172.21.15.28:0/3878050099 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2c8071620 0x7fe2c8138c20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8007e40 tx=0x7fe2b800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:17.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2affff640 1 -- 172.21.15.28:0/3878050099 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8014620 con 0x7fe2c8071620 2023-11-16T02:30:17.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2affff640 1 -- 172.21.15.28:0/3878050099 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b800ee90 con 0x7fe2c8071620 2023-11-16T02:30:17.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2cdcba640 1 -- 172.21.15.28:0/3878050099 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c81376a0 con 0x7fe2c8071620 2023-11-16T02:30:17.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2cdcba640 1 -- 172.21.15.28:0/3878050099 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c8137c60 con 0x7fe2c8071620 2023-11-16T02:30:17.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2affff640 1 -- 172.21.15.28:0/3878050099 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b80149c0 con 0x7fe2c8071620 2023-11-16T02:30:17.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.479+0000 7fe2cdcba640 1 -- 172.21.15.28:0/3878050099 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2a8005260 con 0x7fe2c8071620 2023-11-16T02:30:17.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.483+0000 7fe2affff640 1 -- 172.21.15.28:0/3878050099 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe2b8014b20 con 0x7fe2c8071620 2023-11-16T02:30:17.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.483+0000 7fe2affff640 1 --2- 172.21.15.28:0/3878050099 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe2b4065a90 0x7fe2b4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:17.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.483+0000 7fe2c6ffd640 1 --2- 172.21.15.28:0/3878050099 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe2b4065a90 0x7fe2b4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:17.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.483+0000 7fe2affff640 1 -- 172.21.15.28:0/3878050099 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe2b80836a0 con 0x7fe2c8071620 2023-11-16T02:30:17.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.483+0000 7fe2c6ffd640 1 --2- 172.21.15.28:0/3878050099 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe2b4065a90 0x7fe2b4067f50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8135fa0 tx=0x7fe2bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:17.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.487+0000 7fe2affff640 1 -- 172.21.15.28:0/3878050099 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fe2b8051440 con 0x7fe2c8071620 2023-11-16T02:30:17.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:17.643+0000 7fe2cdcba640 1 -- 172.21.15.28:0/3878050099 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe2a80055b0 con 0x7fe2c8071620 2023-11-16T02:30:18.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.427+0000 7fe2affff640 1 -- 172.21.15.28:0/3878050099 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe2b8054a60 con 0x7fe2c8071620 2023-11-16T02:30:18.429 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_metadata' created 2023-11-16T02:30:18.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.431+0000 7fe2cdcba640 1 -- 172.21.15.28:0/3878050099 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe2b4065a90 msgr2=0x7fe2b4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:18.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.431+0000 7fe2cdcba640 1 --2- 172.21.15.28:0/3878050099 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe2b4065a90 0x7fe2b4067f50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8135fa0 tx=0x7fe2bc009040 comp rx=0 tx=0).stop 2023-11-16T02:30:18.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.431+0000 7fe2cdcba640 1 -- 172.21.15.28:0/3878050099 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2c8071620 msgr2=0x7fe2c8138c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:18.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.431+0000 7fe2cdcba640 1 --2- 172.21.15.28:0/3878050099 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2c8071620 0x7fe2c8138c20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8007e40 tx=0x7fe2b800e4b0 comp rx=0 tx=0).stop 2023-11-16T02:30:18.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.431+0000 7fe2cdcba640 1 -- 172.21.15.28:0/3878050099 shutdown_connections 2023-11-16T02:30:18.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.431+0000 7fe2cdcba640 1 --2- 172.21.15.28:0/3878050099 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe2b4065a90 0x7fe2b4067f50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:18.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.431+0000 7fe2cdcba640 1 --2- 172.21.15.28:0/3878050099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe2c80ba110 0x7fe2c81e6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:18.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.431+0000 7fe2cdcba640 1 --2- 172.21.15.28:0/3878050099 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe2c80b8350 0x7fe2c813f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:18.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.431+0000 7fe2cdcba640 1 --2- 172.21.15.28:0/3878050099 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2c8071620 0x7fe2c8138c20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:18.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.431+0000 7fe2cdcba640 1 -- 172.21.15.28:0/3878050099 >> 172.21.15.28:0/3878050099 conn(0x7fe2c80be280 msgr2=0x7fe2c81418d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:18.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.431+0000 7fe2cdcba640 1 -- 172.21.15.28:0/3878050099 shutdown_connections 2023-11-16T02:30:18.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.431+0000 7fe2cdcba640 1 -- 172.21.15.28:0/3878050099 wait complete. 2023-11-16T02:30:18.456 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-16T02:30:18.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.583+0000 7f4c42467640 1 Processor -- start 2023-11-16T02:30:18.585 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.583+0000 7f4c42467640 1 -- start start 2023-11-16T02:30:18.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.583+0000 7f4c42467640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4c3c0702d0 0x7f4c3c071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:18.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.583+0000 7f4c42467640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4c3c1417e0 0x7f4c3c141c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:18.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.583+0000 7f4c42467640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c3c14b1f0 con 0x7f4c3c06a3d0 2023-11-16T02:30:18.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.583+0000 7f4c42467640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c3c14bd90 con 0x7f4c3c1417e0 2023-11-16T02:30:18.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.583+0000 7f4c42467640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c14aec0 con 0x7f4c3c0702d0 2023-11-16T02:30:18.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.583+0000 7f4c3bfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f4c3c06a3d0 0x7f4c3c14b680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:36974/0 (socket says 172.21.15.28:36974) 2023-11-16T02:30:18.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.583+0000 7f4c40a04640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4c3c1417e0 0x7f4c3c141c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:18.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.583+0000 7f4c3bfff640 1 -- 172.21.15.28:0/2434123104 learned_addr learned my addr 172.21.15.28:0/2434123104 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:18.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.583+0000 7f4c3b7fe640 1 --2- 172.21.15.28:0/2434123104 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4c3c0702d0 0x7f4c3c071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:18.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.583+0000 7f4c40a04640 1 -- 172.21.15.28:0/2434123104 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4c3c0702d0 msgr2=0x7f4c3c071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:18.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.583+0000 7f4c40a04640 1 --2- 172.21.15.28:0/2434123104 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4c3c0702d0 0x7f4c3c071090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:18.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.583+0000 7f4c40a04640 1 -- 172.21.15.28:0/2434123104 >> v1:172.21.15.28:6789/0 conn(0x7f4c3c06a3d0 legacy=0x7f4c3c14b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:18.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.583+0000 7f4c40a04640 1 -- 172.21.15.28:0/2434123104 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3c0716b0 con 0x7f4c3c1417e0 2023-11-16T02:30:18.587 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.583+0000 7f4c3b7fe640 1 --2- 172.21.15.28:0/2434123104 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4c3c0702d0 0x7f4c3c071090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:18.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.587+0000 7f4c40a04640 1 --2- 172.21.15.28:0/2434123104 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c3c1417e0 0x7f4c3c141c90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c0097c0 tx=0x7f4c2c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab739e75398469e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:18.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.587+0000 7f4c3affd640 1 -- 172.21.15.28:0/2434123104 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c0a6040 con 0x7f4c3c1417e0 2023-11-16T02:30:18.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.587+0000 7f4c3affd640 1 -- 172.21.15.28:0/2434123104 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2c0aa600 con 0x7f4c3c1417e0 2023-11-16T02:30:18.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.587+0000 7f4c3affd640 1 -- 172.21.15.28:0/2434123104 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c0aa990 con 0x7f4c3c1417e0 2023-11-16T02:30:18.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.587+0000 7f4c42467640 1 -- 172.21.15.28:0/2434123104 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c3c1417e0 msgr2=0x7f4c3c141c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:18.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.587+0000 7f4c42467640 1 --2- 172.21.15.28:0/2434123104 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c3c1417e0 0x7f4c3c141c90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c0097c0 tx=0x7f4c2c01c480 comp rx=0 tx=0).stop 2023-11-16T02:30:18.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.587+0000 7f4c42467640 1 -- 172.21.15.28:0/2434123104 shutdown_connections 2023-11-16T02:30:18.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.587+0000 7f4c42467640 1 --2- 172.21.15.28:0/2434123104 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c3c1417e0 0x7f4c3c141c90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:18.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.587+0000 7f4c42467640 1 --2- 172.21.15.28:0/2434123104 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4c3c0702d0 0x7f4c3c071090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:18.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.587+0000 7f4c42467640 1 -- 172.21.15.28:0/2434123104 >> 172.21.15.28:0/2434123104 conn(0x7f4c3c0bc5a0 msgr2=0x7f4c3c0bc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:18.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.587+0000 7f4c42467640 1 -- 172.21.15.28:0/2434123104 shutdown_connections 2023-11-16T02:30:18.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.587+0000 7f4c42467640 1 -- 172.21.15.28:0/2434123104 wait complete. 2023-11-16T02:30:18.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.587+0000 7f4c42467640 1 Processor -- start 2023-11-16T02:30:18.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.587+0000 7f4c42467640 1 -- start start 2023-11-16T02:30:18.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c42467640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4c3c06a3d0 0x7f4c3c13fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:18.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c42467640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c3c0702d0 0x7f4c3c142450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:18.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c42467640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c3c1417e0 0x7f4c3c138f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:18.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c42467640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c13ff80 con 0x7f4c3c0702d0 2023-11-16T02:30:18.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c42467640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c0ba340 con 0x7f4c3c1417e0 2023-11-16T02:30:18.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c42467640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c0ba590 con 0x7f4c3c06a3d0 2023-11-16T02:30:18.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c3b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c3c0702d0 0x7f4c3c142450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:18.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c3b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c3c0702d0 0x7f4c3c142450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50822/0 (socket says 172.21.15.28:50822) 2023-11-16T02:30:18.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c3b7fe640 1 -- 172.21.15.28:0/1672405851 learned_addr learned my addr 172.21.15.28:0/1672405851 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:18.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c40a04640 1 --2- 172.21.15.28:0/1672405851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c3c1417e0 0x7f4c3c138f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:18.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c3bfff640 1 --2- 172.21.15.28:0/1672405851 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4c3c06a3d0 0x7f4c3c13fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:18.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c3b7fe640 1 -- 172.21.15.28:0/1672405851 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4c3c06a3d0 msgr2=0x7f4c3c13fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:18.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c3b7fe640 1 --2- 172.21.15.28:0/1672405851 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4c3c06a3d0 0x7f4c3c13fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:18.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c3b7fe640 1 -- 172.21.15.28:0/1672405851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c3c1417e0 msgr2=0x7f4c3c138f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:18.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c3b7fe640 1 --2- 172.21.15.28:0/1672405851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c3c1417e0 0x7f4c3c138f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:18.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c3b7fe640 1 -- 172.21.15.28:0/1672405851 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2c009420 con 0x7f4c3c0702d0 2023-11-16T02:30:18.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c3b7fe640 1 --2- 172.21.15.28:0/1672405851 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c3c0702d0 0x7f4c3c142450 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000c820 tx=0x7f4c3000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:18.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c38ff9640 1 -- 172.21.15.28:0/1672405851 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c30007a30 con 0x7f4c3c0702d0 2023-11-16T02:30:18.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c38ff9640 1 -- 172.21.15.28:0/1672405851 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c30007b90 con 0x7f4c3c0702d0 2023-11-16T02:30:18.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c38ff9640 1 -- 172.21.15.28:0/1672405851 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c300113f0 con 0x7f4c3c0702d0 2023-11-16T02:30:18.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c42467640 1 -- 172.21.15.28:0/1672405851 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c3c0ba870 con 0x7f4c3c0702d0 2023-11-16T02:30:18.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c42467640 1 -- 172.21.15.28:0/1672405851 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c3c0bbb20 con 0x7f4c3c0702d0 2023-11-16T02:30:18.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c42467640 1 -- 172.21.15.28:0/1672405851 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c3c04e8a0 con 0x7f4c3c0702d0 2023-11-16T02:30:18.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c38ff9640 1 -- 172.21.15.28:0/1672405851 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4c30011550 con 0x7f4c3c0702d0 2023-11-16T02:30:18.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c38ff9640 1 --2- 172.21.15.28:0/1672405851 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4c28065a60 0x7f4c28067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:18.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c38ff9640 1 -- 172.21.15.28:0/1672405851 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f4c300835a0 con 0x7f4c3c0702d0 2023-11-16T02:30:18.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.591+0000 7f4c3bfff640 1 --2- 172.21.15.28:0/1672405851 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4c28065a60 0x7f4c28067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:18.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.595+0000 7f4c3bfff640 1 --2- 172.21.15.28:0/1672405851 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4c28065a60 0x7f4c28067f20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4c340012f0 tx=0x7f4c34009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:18.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.595+0000 7f4c38ff9640 1 -- 172.21.15.28:0/1672405851 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f4c300511b0 con 0x7f4c3c0702d0 2023-11-16T02:30:18.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:18.755+0000 7f4c42467640 1 -- 172.21.15.28:0/1672405851 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4c3c1483d0 con 0x7f4c3c0702d0 2023-11-16T02:30:19.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.443+0000 7f4c38ff9640 1 -- 172.21.15.28:0/1672405851 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4c300547d0 con 0x7f4c3c0702d0 2023-11-16T02:30:19.445 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data' created 2023-11-16T02:30:19.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.447+0000 7f4c42467640 1 -- 172.21.15.28:0/1672405851 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4c28065a60 msgr2=0x7f4c28067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:19.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.447+0000 7f4c42467640 1 --2- 172.21.15.28:0/1672405851 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4c28065a60 0x7f4c28067f20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4c340012f0 tx=0x7f4c34009040 comp rx=0 tx=0).stop 2023-11-16T02:30:19.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.447+0000 7f4c42467640 1 -- 172.21.15.28:0/1672405851 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c3c0702d0 msgr2=0x7f4c3c142450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:19.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.447+0000 7f4c42467640 1 --2- 172.21.15.28:0/1672405851 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c3c0702d0 0x7f4c3c142450 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000c820 tx=0x7f4c3000cce0 comp rx=0 tx=0).stop 2023-11-16T02:30:19.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.451+0000 7f4c42467640 1 -- 172.21.15.28:0/1672405851 shutdown_connections 2023-11-16T02:30:19.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.451+0000 7f4c42467640 1 --2- 172.21.15.28:0/1672405851 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4c28065a60 0x7f4c28067f20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:19.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.451+0000 7f4c42467640 1 --2- 172.21.15.28:0/1672405851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c3c1417e0 0x7f4c3c138f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:19.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.451+0000 7f4c42467640 1 --2- 172.21.15.28:0/1672405851 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4c3c0702d0 0x7f4c3c142450 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:19.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.451+0000 7f4c42467640 1 --2- 172.21.15.28:0/1672405851 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4c3c06a3d0 0x7f4c3c13fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:19.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.451+0000 7f4c42467640 1 -- 172.21.15.28:0/1672405851 >> 172.21.15.28:0/1672405851 conn(0x7f4c3c0bc5a0 msgr2=0x7f4c3c0b6920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:19.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.451+0000 7f4c42467640 1 -- 172.21.15.28:0/1672405851 shutdown_connections 2023-11-16T02:30:19.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.451+0000 7f4c42467640 1 -- 172.21.15.28:0/1672405851 wait complete. 2023-11-16T02:30:19.488 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-16T02:30:19.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.611+0000 7f039162e640 1 Processor -- start 2023-11-16T02:30:19.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.615+0000 7f039162e640 1 -- start start 2023-11-16T02:30:19.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.615+0000 7f039162e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f038c06d8c0 0x7f038c0ba470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:19.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.615+0000 7f039162e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f038c06dca0 0x7f038c0a3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:19.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.615+0000 7f039162e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f038c148900 0x7f038c14bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:19.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.615+0000 7f039162e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f038c0ba0e0 con 0x7f038c06d8c0 2023-11-16T02:30:19.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.615+0000 7f039162e640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f038c06eef0 con 0x7f038c148900 2023-11-16T02:30:19.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.615+0000 7f039162e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038c06e6e0 con 0x7f038c06dca0 2023-11-16T02:30:19.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.615+0000 7f038affd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f038c06d8c0 0x7f038c0ba470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:19.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.615+0000 7f038affd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f038c06d8c0 0x7f038c0ba470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50834/0 (socket says 172.21.15.28:50834) 2023-11-16T02:30:19.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.615+0000 7f038affd640 1 -- 172.21.15.28:0/1299498552 learned_addr learned my addr 172.21.15.28:0/1299498552 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:19.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.615+0000 7f038b7fe640 1 --2- 172.21.15.28:0/1299498552 >> v2:172.21.15.70:3300/0 conn(0x7f038c148900 0x7f038c14bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:19.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.615+0000 7f038a7fc640 1 --2- 172.21.15.28:0/1299498552 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f038c06dca0 0x7f038c0a3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:19.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.615+0000 7f038affd640 1 -- 172.21.15.28:0/1299498552 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f038c06dca0 msgr2=0x7f038c0a3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:19.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.615+0000 7f038affd640 1 --2- 172.21.15.28:0/1299498552 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f038c06dca0 0x7f038c0a3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:19.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.615+0000 7f038affd640 1 -- 172.21.15.28:0/1299498552 >> v2:172.21.15.70:3300/0 conn(0x7f038c148900 msgr2=0x7f038c14bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:19.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.615+0000 7f038affd640 1 --2- 172.21.15.28:0/1299498552 >> v2:172.21.15.70:3300/0 conn(0x7f038c148900 0x7f038c14bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:19.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.615+0000 7f038affd640 1 -- 172.21.15.28:0/1299498552 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c0a4230 con 0x7f038c06d8c0 2023-11-16T02:30:19.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.615+0000 7f038b7fe640 1 --2- 172.21.15.28:0/1299498552 >> v2:172.21.15.70:3300/0 conn(0x7f038c148900 0x7f038c14bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:19.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.615+0000 7f038a7fc640 1 --2- 172.21.15.28:0/1299498552 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f038c06dca0 0x7f038c0a3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:19.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.615+0000 7f038affd640 1 --2- 172.21.15.28:0/1299498552 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f038c06d8c0 0x7f038c0ba470 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f038c0bc070 tx=0x7f037c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea76ddee9a13d55 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:19.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.615+0000 7f0389ffb640 1 -- 172.21.15.28:0/1299498552 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c0a89b0 con 0x7f038c06d8c0 2023-11-16T02:30:19.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.615+0000 7f0389ffb640 1 -- 172.21.15.28:0/1299498552 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037c0a8b10 con 0x7f038c06d8c0 2023-11-16T02:30:19.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f0389ffb640 1 -- 172.21.15.28:0/1299498552 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c0a8ea0 con 0x7f038c06d8c0 2023-11-16T02:30:19.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f039162e640 1 -- 172.21.15.28:0/1299498552 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f038c06d8c0 msgr2=0x7f038c0ba470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:19.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f039162e640 1 --2- 172.21.15.28:0/1299498552 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f038c06d8c0 0x7f038c0ba470 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f038c0bc070 tx=0x7f037c01ecf0 comp rx=0 tx=0).stop 2023-11-16T02:30:19.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f039162e640 1 -- 172.21.15.28:0/1299498552 shutdown_connections 2023-11-16T02:30:19.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f039162e640 1 --2- 172.21.15.28:0/1299498552 >> v2:172.21.15.70:3300/0 conn(0x7f038c148900 0x7f038c14bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:19.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f039162e640 1 --2- 172.21.15.28:0/1299498552 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f038c06dca0 0x7f038c0a3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:19.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f039162e640 1 --2- 172.21.15.28:0/1299498552 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f038c06d8c0 0x7f038c0ba470 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:19.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f039162e640 1 -- 172.21.15.28:0/1299498552 >> 172.21.15.28:0/1299498552 conn(0x7f038c0bac40 msgr2=0x7f038c0bb050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:19.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f039162e640 1 -- 172.21.15.28:0/1299498552 shutdown_connections 2023-11-16T02:30:19.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f039162e640 1 -- 172.21.15.28:0/1299498552 wait complete. 2023-11-16T02:30:19.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f039162e640 1 Processor -- start 2023-11-16T02:30:19.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f039162e640 1 -- start start 2023-11-16T02:30:19.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f039162e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f038c06d8c0 0x7f038c0bcae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:19.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f039162e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f038c06dca0 0x7f038c1e0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:19.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f039162e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f038c148900 0x7f038c142310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:19.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f039162e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c14a780 con 0x7f038c148900 2023-11-16T02:30:19.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f039162e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c0bd020 con 0x7f038c06d8c0 2023-11-16T02:30:19.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f039162e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038c06b1d0 con 0x7f038c06dca0 2023-11-16T02:30:19.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f038b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f038c148900 0x7f038c142310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:19.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f038b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f038c148900 0x7f038c142310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50848/0 (socket says 172.21.15.28:50848) 2023-11-16T02:30:19.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f038b7fe640 1 -- 172.21.15.28:0/591612935 learned_addr learned my addr 172.21.15.28:0/591612935 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:19.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f038affd640 1 --2- 172.21.15.28:0/591612935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f038c06d8c0 0x7f038c0bcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:19.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f038a7fc640 1 --2- 172.21.15.28:0/591612935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f038c06dca0 0x7f038c1e0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:19.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f038b7fe640 1 -- 172.21.15.28:0/591612935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f038c06dca0 msgr2=0x7f038c1e0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:19.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f038b7fe640 1 --2- 172.21.15.28:0/591612935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f038c06dca0 0x7f038c1e0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:19.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f038b7fe640 1 -- 172.21.15.28:0/591612935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f038c06d8c0 msgr2=0x7f038c0bcae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:19.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f038b7fe640 1 --2- 172.21.15.28:0/591612935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f038c06d8c0 0x7f038c0bcae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:19.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f038b7fe640 1 -- 172.21.15.28:0/591612935 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c0094d0 con 0x7f038c148900 2023-11-16T02:30:19.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f038b7fe640 1 --2- 172.21.15.28:0/591612935 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f038c148900 0x7f038c142310 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f038400cd50 tx=0x7f038400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:19.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f03737fe640 1 -- 172.21.15.28:0/591612935 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038400f680 con 0x7f038c148900 2023-11-16T02:30:19.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f03737fe640 1 -- 172.21.15.28:0/591612935 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038400f800 con 0x7f038c148900 2023-11-16T02:30:19.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f039162e640 1 -- 172.21.15.28:0/591612935 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f038c06b4b0 con 0x7f038c148900 2023-11-16T02:30:19.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f03737fe640 1 -- 172.21.15.28:0/591612935 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038400fbb0 con 0x7f038c148900 2023-11-16T02:30:19.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.619+0000 7f039162e640 1 -- 172.21.15.28:0/591612935 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038c06ae80 con 0x7f038c148900 2023-11-16T02:30:19.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.623+0000 7f039162e640 1 -- 172.21.15.28:0/591612935 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f038c1dfeb0 con 0x7f038c148900 2023-11-16T02:30:19.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.623+0000 7f03737fe640 1 -- 172.21.15.28:0/591612935 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f038400b040 con 0x7f038c148900 2023-11-16T02:30:19.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.623+0000 7f03737fe640 1 --2- 172.21.15.28:0/591612935 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0378065a60 0x7f0378067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:19.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.623+0000 7f03737fe640 1 -- 172.21.15.28:0/591612935 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f0384083b90 con 0x7f038c148900 2023-11-16T02:30:19.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.623+0000 7f038affd640 1 --2- 172.21.15.28:0/591612935 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0378065a60 0x7f0378067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:19.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.623+0000 7f038affd640 1 --2- 172.21.15.28:0/591612935 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0378065a60 0x7f0378067f20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f037c0b2000 tx=0x7f037c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:19.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.627+0000 7f03737fe640 1 -- 172.21.15.28:0/591612935 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f0384051510 con 0x7f038c148900 2023-11-16T02:30:19.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.819+0000 7f039162e640 1 -- 172.21.15.28:0/591612935 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f038c04e8a0 con 0x7f038c148900 2023-11-16T02:30:19.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.827+0000 7f03737fe640 1 -- 172.21.15.28:0/591612935 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0384054b30 con 0x7f038c148900 2023-11-16T02:30:19.829 INFO:teuthology.orchestra.run.smithi028.stderr:new fs with metadata pool 4 and data pool 5 2023-11-16T02:30:19.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.835+0000 7f039162e640 1 -- 172.21.15.28:0/591612935 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0378065a60 msgr2=0x7f0378067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:19.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.835+0000 7f039162e640 1 --2- 172.21.15.28:0/591612935 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0378065a60 0x7f0378067f20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f037c0b2000 tx=0x7f037c008040 comp rx=0 tx=0).stop 2023-11-16T02:30:19.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.835+0000 7f039162e640 1 -- 172.21.15.28:0/591612935 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f038c148900 msgr2=0x7f038c142310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:19.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.835+0000 7f039162e640 1 --2- 172.21.15.28:0/591612935 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f038c148900 0x7f038c142310 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f038400cd50 tx=0x7f038400a650 comp rx=0 tx=0).stop 2023-11-16T02:30:19.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.835+0000 7f039162e640 1 -- 172.21.15.28:0/591612935 shutdown_connections 2023-11-16T02:30:19.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.839+0000 7f039162e640 1 --2- 172.21.15.28:0/591612935 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f0378065a60 0x7f0378067f20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:19.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.839+0000 7f039162e640 1 --2- 172.21.15.28:0/591612935 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f038c148900 0x7f038c142310 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:19.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.839+0000 7f039162e640 1 --2- 172.21.15.28:0/591612935 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f038c06dca0 0x7f038c1e0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:19.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.839+0000 7f039162e640 1 --2- 172.21.15.28:0/591612935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f038c06d8c0 0x7f038c0bcae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:19.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.839+0000 7f039162e640 1 -- 172.21.15.28:0/591612935 >> 172.21.15.28:0/591612935 conn(0x7f038c0bac40 msgr2=0x7f038c0b8830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:19.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.839+0000 7f039162e640 1 -- 172.21.15.28:0/591612935 shutdown_connections 2023-11-16T02:30:19.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.843+0000 7f039162e640 1 -- 172.21.15.28:0/591612935 wait complete. 2023-11-16T02:30:19.873 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-16T02:30:19.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.987+0000 7f1fac3ab640 1 Processor -- start 2023-11-16T02:30:19.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.987+0000 7f1fac3ab640 1 -- start start 2023-11-16T02:30:19.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.987+0000 7f1fac3ab640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1fa414a8e0 0x7f1fa4070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:19.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.987+0000 7f1fac3ab640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1fa40b2eb0 0x7f1fa40708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:19.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.987+0000 7f1fac3ab640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa406f1d0 con 0x7f1fa40b6170 2023-11-16T02:30:19.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.987+0000 7f1fac3ab640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa4071470 con 0x7f1fa40b2eb0 2023-11-16T02:30:19.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.987+0000 7f1fac3ab640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa40b8490 con 0x7f1fa414a8e0 2023-11-16T02:30:19.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.987+0000 7f1fa9946640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f1fa40b6170 0x7f1fa40b27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54252/0 (socket says 172.21.15.28:54252) 2023-11-16T02:30:19.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.987+0000 7f1fa9946640 1 -- 172.21.15.28:0/971797982 learned_addr learned my addr 172.21.15.28:0/971797982 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:19.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1faa948640 1 --2- 172.21.15.28:0/971797982 >> v2:172.21.15.70:3300/0 conn(0x7f1fa40b2eb0 0x7f1fa40708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:19.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fa9145640 1 -- 172.21.15.28:0/971797982 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1133951503 0 0) 0x7f1fa406f1d0 con 0x7f1fa40b6170 2023-11-16T02:30:19.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1faa147640 1 --2- 172.21.15.28:0/971797982 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1fa414a8e0 0x7f1fa4070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:19.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fa9145640 1 -- 172.21.15.28:0/971797982 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f90003530 con 0x7f1fa40b6170 2023-11-16T02:30:19.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fa9145640 1 -- 172.21.15.28:0/971797982 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3795041406 0 0) 0x7f1f90003530 con 0x7f1fa40b6170 2023-11-16T02:30:19.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fa9145640 1 -- 172.21.15.28:0/971797982 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1fa414a8e0 msgr2=0x7f1fa4070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:19.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fa9145640 1 --2- 172.21.15.28:0/971797982 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1fa414a8e0 0x7f1fa4070360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:19.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fa9145640 1 -- 172.21.15.28:0/971797982 >> v2:172.21.15.70:3300/0 conn(0x7f1fa40b2eb0 msgr2=0x7f1fa40708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:19.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fa9145640 1 --2- 172.21.15.28:0/971797982 >> v2:172.21.15.70:3300/0 conn(0x7f1fa40b2eb0 0x7f1fa40708a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:19.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fa9145640 1 -- 172.21.15.28:0/971797982 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa414b250 con 0x7f1fa40b6170 2023-11-16T02:30:19.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fa9145640 1 -- 172.21.15.28:0/971797982 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7f1fa0001680 con 0x7f1fa40b6170 2023-11-16T02:30:19.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fa9145640 1 -- 172.21.15.28:0/971797982 >> v1:172.21.15.28:6789/0 conn(0x7f1fa40b6170 legacy=0x7f1fa40b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:19.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fa9145640 1 --2- 172.21.15.28:0/971797982 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1fa414a8e0 0x7f1f900039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:19.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fa9145640 1 --2- 172.21.15.28:0/971797982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f90003f30 0x7f1f900047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:19.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fa9145640 1 --2- 172.21.15.28:0/971797982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f90004d10 0x7f1f90005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:19.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fa9145640 1 -- 172.21.15.28:0/971797982 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa4071470 con 0x7f1f90003f30 2023-11-16T02:30:19.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fa9145640 1 -- 172.21.15.28:0/971797982 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa40b8490 con 0x7f1f90004d10 2023-11-16T02:30:19.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fa9145640 1 -- 172.21.15.28:0/971797982 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9000b990 con 0x7f1fa414a8e0 2023-11-16T02:30:19.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fa9946640 1 --2- 172.21.15.28:0/971797982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f90003f30 0x7f1f900047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:19.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1faa147640 1 --2- 172.21.15.28:0/971797982 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1fa414a8e0 0x7f1f900039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:19.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1faa948640 1 --2- 172.21.15.28:0/971797982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f90004d10 0x7f1f90005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:19.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fa9946640 1 -- 172.21.15.28:0/971797982 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1fa414a8e0 msgr2=0x7f1f900039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:19.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fa9946640 1 --2- 172.21.15.28:0/971797982 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1fa414a8e0 0x7f1f900039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:19.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fa9946640 1 -- 172.21.15.28:0/971797982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f90004d10 msgr2=0x7f1f90005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:19.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fa9946640 1 --2- 172.21.15.28:0/971797982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f90004d10 0x7f1f90005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:19.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fa9946640 1 -- 172.21.15.28:0/971797982 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f90003530 con 0x7f1f90003f30 2023-11-16T02:30:19.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1faa147640 1 --2- 172.21.15.28:0/971797982 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1fa414a8e0 0x7f1f900039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:19.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fa9946640 1 --2- 172.21.15.28:0/971797982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f90003f30 0x7f1f900047d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1fa000c240 tx=0x7f1fa001f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ce905a959463bb server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:19.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fa9145640 1 -- 172.21.15.28:0/971797982 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0005ae0 con 0x7f1f90003f30 2023-11-16T02:30:19.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fa9145640 1 -- 172.21.15.28:0/971797982 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa00ab070 con 0x7f1f90003f30 2023-11-16T02:30:19.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fa9145640 1 -- 172.21.15.28:0/971797982 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0005ea0 con 0x7f1f90003f30 2023-11-16T02:30:19.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fac3ab640 1 -- 172.21.15.28:0/971797982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f90003f30 msgr2=0x7f1f900047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:19.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fac3ab640 1 --2- 172.21.15.28:0/971797982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1f90003f30 0x7f1f900047d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1fa000c240 tx=0x7f1fa001f3b0 comp rx=0 tx=0).stop 2023-11-16T02:30:19.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1faa948640 1 -- 172.21.15.28:0/971797982 reap_dead start 2023-11-16T02:30:19.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fac3ab640 1 -- 172.21.15.28:0/971797982 shutdown_connections 2023-11-16T02:30:19.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fac3ab640 1 -- 172.21.15.28:0/971797982 >> 172.21.15.28:0/971797982 conn(0x7f1fa40b9050 msgr2=0x7f1fa40bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:19.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fac3ab640 1 -- 172.21.15.28:0/971797982 shutdown_connections 2023-11-16T02:30:19.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.991+0000 7f1fac3ab640 1 -- 172.21.15.28:0/971797982 wait complete. 2023-11-16T02:30:19.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1fac3ab640 1 Processor -- start 2023-11-16T02:30:19.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1fac3ab640 1 -- start start 2023-11-16T02:30:19.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1fac3ab640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1f90003f30 0x7f1fa4142d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:20.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1fac3ab640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1fa40bb990 0x7f1fa40ba7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:20.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1fac3ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1fa40bace0 0x7f1fa41466b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:20.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1fac3ab640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa41432d0 con 0x7f1fa40bb990 2023-11-16T02:30:20.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1fac3ab640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa4143650 con 0x7f1fa40bace0 2023-11-16T02:30:20.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1fac3ab640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa40bce10 con 0x7f1f90003f30 2023-11-16T02:30:20.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1fa9946640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1fa40bb990 0x7f1fa40ba7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:20.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1fa9946640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1fa40bb990 0x7f1fa40ba7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54120/0 (socket says 172.21.15.28:54120) 2023-11-16T02:30:20.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1fa9946640 1 -- 172.21.15.28:0/1640594116 learned_addr learned my addr 172.21.15.28:0/1640594116 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:20.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1faa147640 1 --2- 172.21.15.28:0/1640594116 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1f90003f30 0x7f1fa4142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:20.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1faa948640 1 --2- 172.21.15.28:0/1640594116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1fa40bace0 0x7f1fa41466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:20.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1fa9946640 1 -- 172.21.15.28:0/1640594116 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1f90003f30 msgr2=0x7f1fa4142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:20.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1fa9946640 1 --2- 172.21.15.28:0/1640594116 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1f90003f30 0x7f1fa4142d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1fa9946640 1 -- 172.21.15.28:0/1640594116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1fa40bace0 msgr2=0x7f1fa41466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:20.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1fa9946640 1 --2- 172.21.15.28:0/1640594116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1fa40bace0 0x7f1fa41466b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1fa9946640 1 -- 172.21.15.28:0/1640594116 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa40bc570 con 0x7f1fa40bb990 2023-11-16T02:30:20.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1faa147640 1 --2- 172.21.15.28:0/1640594116 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1f90003f30 0x7f1fa4142d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:20.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1fa9946640 1 --2- 172.21.15.28:0/1640594116 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1fa40bb990 0x7f1fa40ba7a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0026020 tx=0x7f1f90005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:20.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1f9affd640 1 -- 172.21.15.28:0/1640594116 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0001640 con 0x7f1fa40bb990 2023-11-16T02:30:20.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1f9affd640 1 -- 172.21.15.28:0/1640594116 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa0007070 con 0x7f1fa40bb990 2023-11-16T02:30:20.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1fac3ab640 1 -- 172.21.15.28:0/1640594116 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa40bc850 con 0x7f1fa40bb990 2023-11-16T02:30:20.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1f9affd640 1 -- 172.21.15.28:0/1640594116 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0007420 con 0x7f1fa40bb990 2023-11-16T02:30:20.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1fac3ab640 1 -- 172.21.15.28:0/1640594116 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa40bc150 con 0x7f1fa40bb990 2023-11-16T02:30:20.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1fac3ab640 1 -- 172.21.15.28:0/1640594116 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa404e8a0 con 0x7f1fa40bb990 2023-11-16T02:30:20.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1f9affd640 1 -- 172.21.15.28:0/1640594116 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1fa0007580 con 0x7f1fa40bb990 2023-11-16T02:30:20.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1f9affd640 1 --2- 172.21.15.28:0/1640594116 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1f88065a60 0x7f1f88067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:20.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.995+0000 7f1f9affd640 1 -- 172.21.15.28:0/1640594116 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1fa00b7040 con 0x7f1fa40bb990 2023-11-16T02:30:20.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.999+0000 7f1faa147640 1 --2- 172.21.15.28:0/1640594116 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1f88065a60 0x7f1f88067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:20.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:19.999+0000 7f1faa147640 1 --2- 172.21.15.28:0/1640594116 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1f88065a60 0x7f1f88067f20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1f940099e0 tx=0x7f1f94008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:20.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.003+0000 7f1f9affd640 1 -- 172.21.15.28:0/1640594116 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f1fa00edfc0 con 0x7f1fa40bb990 2023-11-16T02:30:20.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.155+0000 7f1fac3ab640 1 -- 172.21.15.28:0/1640594116 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fa40b35f0 con 0x7f1fa40bb990 2023-11-16T02:30:20.161 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.159+0000 7f1f9affd640 1 -- 172.21.15.28:0/1640594116 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16066 (secure 0 0 0) 0x7f1fa00c0020 con 0x7f1fa40bb990 2023-11-16T02:30:20.162 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:30:20.162 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":32,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","created":"2023-11-16T02:29:13.710567+0000","modified":"2023-11-16T02:30:19.822750+0000","last_up_change":"2023-11-16T02:29:24.841087+0000","last_in_change":"2023-11-16T02:29:16.024490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-16T02:29:26.490910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-16T02:30:17.685602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-16T02:30:18.798113+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dfa8b58d-3481-4e68-86e8-21873d31d0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":38722},{"type":"v1","addr":"172.21.15.28:6809","nonce":38722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":38722},{"type":"v1","addr":"172.21.15.28:6811","nonce":38722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":38722},{"type":"v1","addr":"172.21.15.28:6815","nonce":38722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":38722},{"type":"v1","addr":"172.21.15.28:6813","nonce":38722}]},"public_addr":"172.21.15.28:6809/38722","cluster_addr":"172.21.15.28:6811/38722","heartbeat_back_addr":"172.21.15.28:6815/38722","heartbeat_front_addr":"172.21.15.28:6813/38722","state":["exists","up"]},{"osd":1,"uuid":"1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":38724},{"type":"v1","addr":"172.21.15.28:6824","nonce":38724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":38724},{"type":"v1","addr":"172.21.15.28:6827","nonce":38724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":38724},{"type":"v1","addr":"172.21.15.28:6831","nonce":38724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":38724},{"type":"v1","addr":"172.21.15.28:6829","nonce":38724}]},"public_addr":"172.21.15.28:6824/38724","cluster_addr":"172.21.15.28:6827/38724","heartbeat_back_addr":"172.21.15.28:6831/38724","heartbeat_front_addr":"172.21.15.28:6829/38724","state":["exists","up"]},{"osd":2,"uuid":"e18f39cd-6a35-4d36-9eed-3877794bf2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":38723},{"type":"v1","addr":"172.21.15.28:6801","nonce":38723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":38723},{"type":"v1","addr":"172.21.15.28:6803","nonce":38723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":38723},{"type":"v1","addr":"172.21.15.28:6807","nonce":38723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":38723},{"type":"v1","addr":"172.21.15.28:6805","nonce":38723}]},"public_addr":"172.21.15.28:6801/38723","cluster_addr":"172.21.15.28:6803/38723","heartbeat_back_addr":"172.21.15.28:6807/38723","heartbeat_front_addr":"172.21.15.28:6805/38723","state":["exists","up"]},{"osd":3,"uuid":"303d0728-409d-47d7-b7a6-6eb273f602fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":38725},{"type":"v1","addr":"172.21.15.28:6817","nonce":38725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":38725},{"type":"v1","addr":"172.21.15.28:6819","nonce":38725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":38725},{"type":"v1","addr":"172.21.15.28:6825","nonce":38725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":38725},{"type":"v1","addr":"172.21.15.28:6821","nonce":38725}]},"public_addr":"172.21.15.28:6817/38725","cluster_addr":"172.21.15.28:6819/38725","heartbeat_back_addr":"172.21.15.28:6825/38725","heartbeat_front_addr":"172.21.15.28:6821/38725","state":["exists","up"]},{"osd":4,"uuid":"df0bf0ac-6efe-4964-ad27-7c1771a70c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":38828},{"type":"v1","addr":"172.21.15.70:6801","nonce":38828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":38828},{"type":"v1","addr":"172.21.15.70:6803","nonce":38828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":38828},{"type":"v1","addr":"172.21.15.70:6807","nonce":38828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":38828},{"type":"v1","addr":"172.21.15.70:6805","nonce":38828}]},"public_addr":"172.21.15.70:6801/38828","cluster_addr":"172.21.15.70:6803/38828","heartbeat_back_addr":"172.21.15.70:6807/38828","heartbeat_front_addr":"172.21.15.70:6805/38828","state":["exists","up"]},{"osd":5,"uuid":"84921219-65cb-4c4e-b9ed-a773db639034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":38830},{"type":"v1","addr":"172.21.15.70:6810","nonce":38830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6813","nonce":38830},{"type":"v1","addr":"172.21.15.70:6814","nonce":38830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":38830},{"type":"v1","addr":"172.21.15.70:6824","nonce":38830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":38830},{"type":"v1","addr":"172.21.15.70:6819","nonce":38830}]},"public_addr":"172.21.15.70:6810/38830","cluster_addr":"172.21.15.70:6814/38830","heartbeat_back_addr":"172.21.15.70:6824/38830","heartbeat_front_addr":"172.21.15.70:6819/38830","state":["exists","up"]},{"osd":6,"uuid":"c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":38829},{"type":"v1","addr":"172.21.15.70:6812","nonce":38829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":38829},{"type":"v1","addr":"172.21.15.70:6820","nonce":38829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":38829},{"type":"v1","addr":"172.21.15.70:6828","nonce":38829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":38829},{"type":"v1","addr":"172.21.15.70:6825","nonce":38829}]},"public_addr":"172.21.15.70:6812/38829","cluster_addr":"172.21.15.70:6820/38829","heartbeat_back_addr":"172.21.15.70:6828/38829","heartbeat_front_addr":"172.21.15.70:6825/38829","state":["exists","up"]},{"osd":7,"uuid":"e2cdd418-12ce-4eea-9b22-efdad83eb76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":38839},{"type":"v1","addr":"172.21.15.70:6815","nonce":38839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":38839},{"type":"v1","addr":"172.21.15.70:6823","nonce":38839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":38839},{"type":"v1","addr":"172.21.15.70:6831","nonce":38839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6827","nonce":38839},{"type":"v1","addr":"172.21.15.70:6829","nonce":38839}]},"public_addr":"172.21.15.70:6815/38839","cluster_addr":"172.21.15.70:6823/38839","heartbeat_back_addr":"172.21.15.70:6831/38839","heartbeat_front_addr":"172.21.15.70:6829/38839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.544240+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.637637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.352115+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.652916+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.624477+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.570247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.706468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.696574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-16T02:30:20.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.159+0000 7f1fac3ab640 1 -- 172.21.15.28:0/1640594116 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1f88065a60 msgr2=0x7f1f88067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:20.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.159+0000 7f1fac3ab640 1 --2- 172.21.15.28:0/1640594116 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1f88065a60 0x7f1f88067f20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1f940099e0 tx=0x7f1f94008040 comp rx=0 tx=0).stop 2023-11-16T02:30:20.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.159+0000 7f1fac3ab640 1 -- 172.21.15.28:0/1640594116 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1fa40bb990 msgr2=0x7f1fa40ba7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:20.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.159+0000 7f1fac3ab640 1 --2- 172.21.15.28:0/1640594116 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1fa40bb990 0x7f1fa40ba7a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0026020 tx=0x7f1f90005800 comp rx=0 tx=0).stop 2023-11-16T02:30:20.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.159+0000 7f1fac3ab640 1 -- 172.21.15.28:0/1640594116 shutdown_connections 2023-11-16T02:30:20.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.159+0000 7f1fac3ab640 1 --2- 172.21.15.28:0/1640594116 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1f88065a60 0x7f1f88067f20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.159+0000 7f1fac3ab640 1 --2- 172.21.15.28:0/1640594116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1fa40bace0 0x7f1fa41466b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.159+0000 7f1fac3ab640 1 --2- 172.21.15.28:0/1640594116 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1fa40bb990 0x7f1fa40ba7a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.159+0000 7f1fac3ab640 1 --2- 172.21.15.28:0/1640594116 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1f90003f30 0x7f1fa4142d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.163+0000 7f1fac3ab640 1 -- 172.21.15.28:0/1640594116 >> 172.21.15.28:0/1640594116 conn(0x7f1fa40b9050 msgr2=0x7f1fa4149d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:20.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.163+0000 7f1fac3ab640 1 -- 172.21.15.28:0/1640594116 shutdown_connections 2023-11-16T02:30:20.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.163+0000 7f1fac3ab640 1 -- 172.21.15.28:0/1640594116 wait complete. 2023-11-16T02:30:20.181 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-16T02:30:20.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.303+0000 7fc15510e640 1 Processor -- start 2023-11-16T02:30:20.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.303+0000 7fc15510e640 1 -- start start 2023-11-16T02:30:20.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.307+0000 7fc15510e640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fc1500bc900 0x7fc15006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:20.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.307+0000 7fc15510e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1500700f0 con 0x7fc15006f3c0 2023-11-16T02:30:20.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.307+0000 7fc15510e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1500703d0 con 0x7fc150145020 2023-11-16T02:30:20.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.307+0000 7fc15510e640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1500706b0 con 0x7fc1500bc900 2023-11-16T02:30:20.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.307+0000 7fc14e59c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc15006f3c0 0x7fc150144910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54268/0 (socket says 172.21.15.28:54268) 2023-11-16T02:30:20.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.307+0000 7fc14e59c640 1 -- 172.21.15.28:0/321909995 learned_addr learned my addr 172.21.15.28:0/321909995 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:20.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.307+0000 7fc14ed9d640 1 --2- 172.21.15.28:0/321909995 >> v2:172.21.15.70:3300/0 conn(0x7fc1500bc900 0x7fc15006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:20.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.307+0000 7fc14dd9b640 1 -- 172.21.15.28:0/321909995 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534917368 0 0) 0x7fc1500700f0 con 0x7fc15006f3c0 2023-11-16T02:30:20.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.307+0000 7fc14dd9b640 1 -- 172.21.15.28:0/321909995 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc138003530 con 0x7fc15006f3c0 2023-11-16T02:30:20.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.307+0000 7fc14dd9b640 1 -- 172.21.15.28:0/321909995 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 401779447 0 0) 0x7fc138003530 con 0x7fc15006f3c0 2023-11-16T02:30:20.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.307+0000 7fc14ed9d640 1 -- 172.21.15.28:0/321909995 >> v1:172.21.15.70:6789/0 conn(0x7fc150145020 legacy=0x7fc15014ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:20.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.307+0000 7fc14ed9d640 1 -- 172.21.15.28:0/321909995 >> v1:172.21.15.28:6789/0 conn(0x7fc15006f3c0 legacy=0x7fc150144910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:20.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.307+0000 7fc14ed9d640 1 -- 172.21.15.28:0/321909995 --> v2:172.21.15.70:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1500bcce0 con 0x7fc1500bc900 2023-11-16T02:30:20.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.311+0000 7fc14ed9d640 1 --2- 172.21.15.28:0/321909995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1500bc900 0x7fc15006ee80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc1440097c0 tx=0x7fc14401c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d4d7543bb67ed6 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:20.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.311+0000 7fc14dd9b640 1 -- 172.21.15.28:0/321909995 <== mon.1 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc140001680 con 0x7fc1500bc900 2023-11-16T02:30:20.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.311+0000 7fc14dd9b640 1 -- 172.21.15.28:0/321909995 <== mon.1 v2:172.21.15.70:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1440a7050 con 0x7fc1500bc900 2023-11-16T02:30:20.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.311+0000 7fc14dd9b640 1 -- 172.21.15.28:0/321909995 <== mon.1 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1440ab600 con 0x7fc1500bc900 2023-11-16T02:30:20.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.311+0000 7fc15510e640 1 -- 172.21.15.28:0/321909995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1500bc900 msgr2=0x7fc15006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:20.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.311+0000 7fc15510e640 1 --2- 172.21.15.28:0/321909995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1500bc900 0x7fc15006ee80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc1440097c0 tx=0x7fc14401c310 comp rx=0 tx=0).stop 2023-11-16T02:30:20.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.311+0000 7fc15510e640 1 -- 172.21.15.28:0/321909995 shutdown_connections 2023-11-16T02:30:20.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.311+0000 7fc15510e640 1 --2- 172.21.15.28:0/321909995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1500bc900 0x7fc15006ee80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.311+0000 7fc15510e640 1 -- 172.21.15.28:0/321909995 >> 172.21.15.28:0/321909995 conn(0x7fc1500b9050 msgr2=0x7fc1500bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:20.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.311+0000 7fc15510e640 1 -- 172.21.15.28:0/321909995 shutdown_connections 2023-11-16T02:30:20.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.311+0000 7fc15510e640 1 -- 172.21.15.28:0/321909995 wait complete. 2023-11-16T02:30:20.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.311+0000 7fc15510e640 1 Processor -- start 2023-11-16T02:30:20.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.311+0000 7fc15510e640 1 -- start start 2023-11-16T02:30:20.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.311+0000 7fc15510e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc15006f3c0 0x7fc1501e61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:20.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.311+0000 7fc15510e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc1500bc900 0x7fc150145710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:20.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.311+0000 7fc15510e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc150145020 0x7fc150146360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:20.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.311+0000 7fc15510e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc150148450 con 0x7fc1500bc900 2023-11-16T02:30:20.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.311+0000 7fc15510e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1501e66f0 con 0x7fc150145020 2023-11-16T02:30:20.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.311+0000 7fc15510e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc150141440 con 0x7fc15006f3c0 2023-11-16T02:30:20.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.311+0000 7fc14e59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc1500bc900 0x7fc150145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:20.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.311+0000 7fc14e59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc1500bc900 0x7fc150145710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54130/0 (socket says 172.21.15.28:54130) 2023-11-16T02:30:20.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.311+0000 7fc14e59c640 1 -- 172.21.15.28:0/3627805635 learned_addr learned my addr 172.21.15.28:0/3627805635 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:20.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.315+0000 7fc14f59e640 1 --2- 172.21.15.28:0/3627805635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc150145020 0x7fc150146360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:20.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.315+0000 7fc14e59c640 1 -- 172.21.15.28:0/3627805635 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc15006f3c0 msgr2=0x7fc1501e61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:20.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.315+0000 7fc14ed9d640 1 --2- 172.21.15.28:0/3627805635 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc15006f3c0 0x7fc1501e61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:20.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.315+0000 7fc14e59c640 1 --2- 172.21.15.28:0/3627805635 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc15006f3c0 0x7fc1501e61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.315+0000 7fc14e59c640 1 -- 172.21.15.28:0/3627805635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc150145020 msgr2=0x7fc150146360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:20.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.315+0000 7fc14e59c640 1 --2- 172.21.15.28:0/3627805635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc150145020 0x7fc150146360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.315+0000 7fc14e59c640 1 -- 172.21.15.28:0/3627805635 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc144009420 con 0x7fc1500bc900 2023-11-16T02:30:20.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.315+0000 7fc14f59e640 1 --2- 172.21.15.28:0/3627805635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc150145020 0x7fc150146360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:20.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.315+0000 7fc14ed9d640 1 --2- 172.21.15.28:0/3627805635 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc15006f3c0 0x7fc1501e61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:20.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.315+0000 7fc14e59c640 1 --2- 172.21.15.28:0/3627805635 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc1500bc900 0x7fc150145710 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc1400011f0 tx=0x7fc14000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:20.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.315+0000 7fc1377fe640 1 -- 172.21.15.28:0/3627805635 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc140005ae0 con 0x7fc1500bc900 2023-11-16T02:30:20.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.315+0000 7fc1377fe640 1 -- 172.21.15.28:0/3627805635 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc140005c40 con 0x7fc1500bc900 2023-11-16T02:30:20.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.315+0000 7fc1377fe640 1 -- 172.21.15.28:0/3627805635 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc140007070 con 0x7fc1500bc900 2023-11-16T02:30:20.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.315+0000 7fc15510e640 1 -- 172.21.15.28:0/3627805635 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc150142170 con 0x7fc1500bc900 2023-11-16T02:30:20.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.315+0000 7fc15510e640 1 -- 172.21.15.28:0/3627805635 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc150145c50 con 0x7fc1500bc900 2023-11-16T02:30:20.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.315+0000 7fc15510e640 1 -- 172.21.15.28:0/3627805635 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1501415b0 con 0x7fc1500bc900 2023-11-16T02:30:20.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.315+0000 7fc1377fe640 1 -- 172.21.15.28:0/3627805635 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc1400071d0 con 0x7fc1500bc900 2023-11-16T02:30:20.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.315+0000 7fc1377fe640 1 --2- 172.21.15.28:0/3627805635 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc13c065a60 0x7fc13c067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:20.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.315+0000 7fc1377fe640 1 -- 172.21.15.28:0/3627805635 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc140082bd0 con 0x7fc1500bc900 2023-11-16T02:30:20.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.315+0000 7fc14ed9d640 1 --2- 172.21.15.28:0/3627805635 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc13c065a60 0x7fc13c067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:20.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.319+0000 7fc14ed9d640 1 --2- 172.21.15.28:0/3627805635 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc13c065a60 0x7fc13c067f20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc1440ad000 tx=0x7fc1440a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:20.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.319+0000 7fc1377fe640 1 -- 172.21.15.28:0/3627805635 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fc140050580 con 0x7fc1500bc900 2023-11-16T02:30:20.475 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.471+0000 7fc15510e640 1 -- 172.21.15.28:0/3627805635 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1501415b0 con 0x7fc1500bc900 2023-11-16T02:30:20.477 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.475+0000 7fc1377fe640 1 -- 172.21.15.28:0/3627805635 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16066 (secure 0 0 0) 0x7fc1501415b0 con 0x7fc1500bc900 2023-11-16T02:30:20.480 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:30:20.481 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":32,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","created":"2023-11-16T02:29:13.710567+0000","modified":"2023-11-16T02:30:19.822750+0000","last_up_change":"2023-11-16T02:29:24.841087+0000","last_in_change":"2023-11-16T02:29:16.024490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-16T02:29:26.490910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-16T02:30:17.685602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-16T02:30:18.798113+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dfa8b58d-3481-4e68-86e8-21873d31d0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":38722},{"type":"v1","addr":"172.21.15.28:6809","nonce":38722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":38722},{"type":"v1","addr":"172.21.15.28:6811","nonce":38722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":38722},{"type":"v1","addr":"172.21.15.28:6815","nonce":38722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":38722},{"type":"v1","addr":"172.21.15.28:6813","nonce":38722}]},"public_addr":"172.21.15.28:6809/38722","cluster_addr":"172.21.15.28:6811/38722","heartbeat_back_addr":"172.21.15.28:6815/38722","heartbeat_front_addr":"172.21.15.28:6813/38722","state":["exists","up"]},{"osd":1,"uuid":"1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":38724},{"type":"v1","addr":"172.21.15.28:6824","nonce":38724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":38724},{"type":"v1","addr":"172.21.15.28:6827","nonce":38724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":38724},{"type":"v1","addr":"172.21.15.28:6831","nonce":38724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":38724},{"type":"v1","addr":"172.21.15.28:6829","nonce":38724}]},"public_addr":"172.21.15.28:6824/38724","cluster_addr":"172.21.15.28:6827/38724","heartbeat_back_addr":"172.21.15.28:6831/38724","heartbeat_front_addr":"172.21.15.28:6829/38724","state":["exists","up"]},{"osd":2,"uuid":"e18f39cd-6a35-4d36-9eed-3877794bf2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":38723},{"type":"v1","addr":"172.21.15.28:6801","nonce":38723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":38723},{"type":"v1","addr":"172.21.15.28:6803","nonce":38723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":38723},{"type":"v1","addr":"172.21.15.28:6807","nonce":38723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":38723},{"type":"v1","addr":"172.21.15.28:6805","nonce":38723}]},"public_addr":"172.21.15.28:6801/38723","cluster_addr":"172.21.15.28:6803/38723","heartbeat_back_addr":"172.21.15.28:6807/38723","heartbeat_front_addr":"172.21.15.28:6805/38723","state":["exists","up"]},{"osd":3,"uuid":"303d0728-409d-47d7-b7a6-6eb273f602fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":38725},{"type":"v1","addr":"172.21.15.28:6817","nonce":38725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":38725},{"type":"v1","addr":"172.21.15.28:6819","nonce":38725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":38725},{"type":"v1","addr":"172.21.15.28:6825","nonce":38725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":38725},{"type":"v1","addr":"172.21.15.28:6821","nonce":38725}]},"public_addr":"172.21.15.28:6817/38725","cluster_addr":"172.21.15.28:6819/38725","heartbeat_back_addr":"172.21.15.28:6825/38725","heartbeat_front_addr":"172.21.15.28:6821/38725","state":["exists","up"]},{"osd":4,"uuid":"df0bf0ac-6efe-4964-ad27-7c1771a70c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":38828},{"type":"v1","addr":"172.21.15.70:6801","nonce":38828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":38828},{"type":"v1","addr":"172.21.15.70:6803","nonce":38828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":38828},{"type":"v1","addr":"172.21.15.70:6807","nonce":38828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":38828},{"type":"v1","addr":"172.21.15.70:6805","nonce":38828}]},"public_addr":"172.21.15.70:6801/38828","cluster_addr":"172.21.15.70:6803/38828","heartbeat_back_addr":"172.21.15.70:6807/38828","heartbeat_front_addr":"172.21.15.70:6805/38828","state":["exists","up"]},{"osd":5,"uuid":"84921219-65cb-4c4e-b9ed-a773db639034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":38830},{"type":"v1","addr":"172.21.15.70:6810","nonce":38830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6813","nonce":38830},{"type":"v1","addr":"172.21.15.70:6814","nonce":38830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":38830},{"type":"v1","addr":"172.21.15.70:6824","nonce":38830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":38830},{"type":"v1","addr":"172.21.15.70:6819","nonce":38830}]},"public_addr":"172.21.15.70:6810/38830","cluster_addr":"172.21.15.70:6814/38830","heartbeat_back_addr":"172.21.15.70:6824/38830","heartbeat_front_addr":"172.21.15.70:6819/38830","state":["exists","up"]},{"osd":6,"uuid":"c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":38829},{"type":"v1","addr":"172.21.15.70:6812","nonce":38829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":38829},{"type":"v1","addr":"172.21.15.70:6820","nonce":38829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":38829},{"type":"v1","addr":"172.21.15.70:6828","nonce":38829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":38829},{"type":"v1","addr":"172.21.15.70:6825","nonce":38829}]},"public_addr":"172.21.15.70:6812/38829","cluster_addr":"172.21.15.70:6820/38829","heartbeat_back_addr":"172.21.15.70:6828/38829","heartbeat_front_addr":"172.21.15.70:6825/38829","state":["exists","up"]},{"osd":7,"uuid":"e2cdd418-12ce-4eea-9b22-efdad83eb76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":38839},{"type":"v1","addr":"172.21.15.70:6815","nonce":38839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":38839},{"type":"v1","addr":"172.21.15.70:6823","nonce":38839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":38839},{"type":"v1","addr":"172.21.15.70:6831","nonce":38839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6827","nonce":38839},{"type":"v1","addr":"172.21.15.70:6829","nonce":38839}]},"public_addr":"172.21.15.70:6815/38839","cluster_addr":"172.21.15.70:6823/38839","heartbeat_back_addr":"172.21.15.70:6831/38839","heartbeat_front_addr":"172.21.15.70:6829/38839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.544240+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.637637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.352115+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.652916+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.624477+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.570247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.706468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.696574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-16T02:30:20.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.475+0000 7fc15510e640 1 -- 172.21.15.28:0/3627805635 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc13c065a60 msgr2=0x7fc13c067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:20.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.475+0000 7fc15510e640 1 --2- 172.21.15.28:0/3627805635 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc13c065a60 0x7fc13c067f20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc1440ad000 tx=0x7fc1440a6000 comp rx=0 tx=0).stop 2023-11-16T02:30:20.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.475+0000 7fc15510e640 1 -- 172.21.15.28:0/3627805635 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc1500bc900 msgr2=0x7fc150145710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:20.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.475+0000 7fc15510e640 1 --2- 172.21.15.28:0/3627805635 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc1500bc900 0x7fc150145710 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc1400011f0 tx=0x7fc14000cbe0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.475+0000 7fc15510e640 1 -- 172.21.15.28:0/3627805635 shutdown_connections 2023-11-16T02:30:20.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.475+0000 7fc15510e640 1 --2- 172.21.15.28:0/3627805635 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fc13c065a60 0x7fc13c067f20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.475+0000 7fc15510e640 1 --2- 172.21.15.28:0/3627805635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc150145020 0x7fc150146360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.475+0000 7fc15510e640 1 --2- 172.21.15.28:0/3627805635 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc1500bc900 0x7fc150145710 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.475+0000 7fc15510e640 1 --2- 172.21.15.28:0/3627805635 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fc15006f3c0 0x7fc1501e61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.475+0000 7fc15510e640 1 -- 172.21.15.28:0/3627805635 >> 172.21.15.28:0/3627805635 conn(0x7fc1500b9050 msgr2=0x7fc1500b75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:20.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.475+0000 7fc15510e640 1 -- 172.21.15.28:0/3627805635 shutdown_connections 2023-11-16T02:30:20.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.475+0000 7fc15510e640 1 -- 172.21.15.28:0/3627805635 wait complete. 2023-11-16T02:30:20.496 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-16T02:30:20.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.615+0000 7f8dfdbef640 1 Processor -- start 2023-11-16T02:30:20.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.615+0000 7f8dfdbef640 1 -- start start 2023-11-16T02:30:20.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.615+0000 7f8dfdbef640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8df806a170 0x7f8df80b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:20.617 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.615+0000 7f8dfdbef640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8df806a550 0x7f8df8148a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:20.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.615+0000 7f8dfdbef640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f8df8148fa0 0x7f8df80b7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:20.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.615+0000 7f8dfdbef640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df8071800 con 0x7f8df806a170 2023-11-16T02:30:20.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.615+0000 7f8dfdbef640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df80b5ec0 con 0x7f8df8148fa0 2023-11-16T02:30:20.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.615+0000 7f8dfdbef640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df80b6350 con 0x7f8df806a550 2023-11-16T02:30:20.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.615+0000 7f8df77fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8df806a170 0x7f8df80b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:20.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.615+0000 7f8df77fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8df806a170 0x7f8df80b3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54134/0 (socket says 172.21.15.28:54134) 2023-11-16T02:30:20.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.615+0000 7f8df77fe640 1 -- 172.21.15.28:0/1456778131 learned_addr learned my addr 172.21.15.28:0/1456778131 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:20.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.615+0000 7f8df7fff640 1 --2- 172.21.15.28:0/1456778131 >> v2:172.21.15.70:3300/0 conn(0x7f8df8148fa0 0x7f8df80b7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:20.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.615+0000 7f8df6ffd640 1 --2- 172.21.15.28:0/1456778131 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8df806a550 0x7f8df8148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:20.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.615+0000 7f8df77fe640 1 -- 172.21.15.28:0/1456778131 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8df806a550 msgr2=0x7f8df8148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:20.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.615+0000 7f8df77fe640 1 --2- 172.21.15.28:0/1456778131 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8df806a550 0x7f8df8148a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.615+0000 7f8df77fe640 1 -- 172.21.15.28:0/1456778131 >> v2:172.21.15.70:3300/0 conn(0x7f8df8148fa0 msgr2=0x7f8df80b7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:20.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.615+0000 7f8df77fe640 1 --2- 172.21.15.28:0/1456778131 >> v2:172.21.15.70:3300/0 conn(0x7f8df8148fa0 0x7f8df80b7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.615+0000 7f8df77fe640 1 -- 172.21.15.28:0/1456778131 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df80b5870 con 0x7f8df806a170 2023-11-16T02:30:20.619 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.615+0000 7f8df77fe640 1 --2- 172.21.15.28:0/1456778131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8df806a170 0x7f8df80b3bc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8df8143360 tx=0x7f8de801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656eeb75948ee0c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:20.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8df67fc640 1 -- 172.21.15.28:0/1456778131 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de80ab600 con 0x7f8df806a170 2023-11-16T02:30:20.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8df67fc640 1 -- 172.21.15.28:0/1456778131 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de80a7050 con 0x7f8df806a170 2023-11-16T02:30:20.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8df67fc640 1 -- 172.21.15.28:0/1456778131 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de80ab980 con 0x7f8df806a170 2023-11-16T02:30:20.620 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8dfdbef640 1 -- 172.21.15.28:0/1456778131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8df806a170 msgr2=0x7f8df80b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:20.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8dfdbef640 1 --2- 172.21.15.28:0/1456778131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8df806a170 0x7f8df80b3bc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8df8143360 tx=0x7f8de801c470 comp rx=0 tx=0).stop 2023-11-16T02:30:20.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8dfdbef640 1 -- 172.21.15.28:0/1456778131 shutdown_connections 2023-11-16T02:30:20.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8dfdbef640 1 --2- 172.21.15.28:0/1456778131 >> v2:172.21.15.70:3300/0 conn(0x7f8df8148fa0 0x7f8df80b7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8dfdbef640 1 --2- 172.21.15.28:0/1456778131 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8df806a550 0x7f8df8148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8dfdbef640 1 --2- 172.21.15.28:0/1456778131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8df806a170 0x7f8df80b3bc0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8dfdbef640 1 -- 172.21.15.28:0/1456778131 >> 172.21.15.28:0/1456778131 conn(0x7f8df80bc5a0 msgr2=0x7f8df80bc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:20.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8dfdbef640 1 -- 172.21.15.28:0/1456778131 shutdown_connections 2023-11-16T02:30:20.621 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8dfdbef640 1 -- 172.21.15.28:0/1456778131 wait complete. 2023-11-16T02:30:20.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8dfdbef640 1 Processor -- start 2023-11-16T02:30:20.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8dfdbef640 1 -- start start 2023-11-16T02:30:20.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8dfdbef640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8df806a170 0x7f8df81455e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:20.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8dfdbef640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8df806a550 0x7f8df814ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:20.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8dfdbef640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8df8148fa0 0x7f8df81e45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:20.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8dfdbef640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df81531e0 con 0x7f8df8148fa0 2023-11-16T02:30:20.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8dfdbef640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df81407b0 con 0x7f8df806a550 2023-11-16T02:30:20.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8dfdbef640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df8152f90 con 0x7f8df806a170 2023-11-16T02:30:20.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8df7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8df8148fa0 0x7f8df81e45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:20.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8df7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8df8148fa0 0x7f8df81e45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54142/0 (socket says 172.21.15.28:54142) 2023-11-16T02:30:20.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8df7fff640 1 -- 172.21.15.28:0/3236905087 learned_addr learned my addr 172.21.15.28:0/3236905087 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:20.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8df6ffd640 1 --2- 172.21.15.28:0/3236905087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8df806a550 0x7f8df814ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:20.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8df7fff640 1 -- 172.21.15.28:0/3236905087 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8df806a170 msgr2=0x7f8df81455e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:20.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8df7fff640 1 --2- 172.21.15.28:0/3236905087 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8df806a170 0x7f8df81455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8df7fff640 1 -- 172.21.15.28:0/3236905087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8df806a550 msgr2=0x7f8df814ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:20.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8df7fff640 1 --2- 172.21.15.28:0/3236905087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8df806a550 0x7f8df814ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8df7fff640 1 -- 172.21.15.28:0/3236905087 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de80094d0 con 0x7f8df8148fa0 2023-11-16T02:30:20.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8df7fff640 1 --2- 172.21.15.28:0/3236905087 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8df8148fa0 0x7f8df81e45a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8df0007e30 tx=0x7f8df000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:20.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8ddffff640 1 -- 172.21.15.28:0/3236905087 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df0014620 con 0x7f8df8148fa0 2023-11-16T02:30:20.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8ddffff640 1 -- 172.21.15.28:0/3236905087 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df000ee90 con 0x7f8df8148fa0 2023-11-16T02:30:20.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8dfdbef640 1 -- 172.21.15.28:0/3236905087 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df814bc90 con 0x7f8df8148fa0 2023-11-16T02:30:20.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8ddffff640 1 -- 172.21.15.28:0/3236905087 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df00149c0 con 0x7f8df8148fa0 2023-11-16T02:30:20.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.619+0000 7f8dfdbef640 1 -- 172.21.15.28:0/3236905087 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df8140c80 con 0x7f8df8148fa0 2023-11-16T02:30:20.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.623+0000 7f8dfdbef640 1 -- 172.21.15.28:0/3236905087 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df8145cc0 con 0x7f8df8148fa0 2023-11-16T02:30:20.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.623+0000 7f8ddffff640 1 -- 172.21.15.28:0/3236905087 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8df0014b20 con 0x7f8df8148fa0 2023-11-16T02:30:20.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.623+0000 7f8ddffff640 1 --2- 172.21.15.28:0/3236905087 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8de4065a60 0x7f8de4067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:20.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.623+0000 7f8ddffff640 1 -- 172.21.15.28:0/3236905087 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8df0083a50 con 0x7f8df8148fa0 2023-11-16T02:30:20.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.623+0000 7f8df77fe640 1 --2- 172.21.15.28:0/3236905087 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8de4065a60 0x7f8de4067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:20.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.623+0000 7f8df77fe640 1 --2- 172.21.15.28:0/3236905087 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8de4065a60 0x7f8de4067f20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8df806aa80 tx=0x7f8de8004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:20.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.627+0000 7f8ddffff640 1 -- 172.21.15.28:0/3236905087 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f8df00514a0 con 0x7f8df8148fa0 2023-11-16T02:30:20.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.819+0000 7f8dfdbef640 1 -- 172.21.15.28:0/3236905087 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8df804e8a0 con 0x7f8df8148fa0 2023-11-16T02:30:20.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.827+0000 7f8ddffff640 1 -- 172.21.15.28:0/3236905087 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8df0054ac0 con 0x7f8df8148fa0 2023-11-16T02:30:20.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.831+0000 7f8dfdbef640 1 -- 172.21.15.28:0/3236905087 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8de4065a60 msgr2=0x7f8de4067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:20.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.831+0000 7f8dfdbef640 1 --2- 172.21.15.28:0/3236905087 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8de4065a60 0x7f8de4067f20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8df806aa80 tx=0x7f8de8004740 comp rx=0 tx=0).stop 2023-11-16T02:30:20.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.831+0000 7f8dfdbef640 1 -- 172.21.15.28:0/3236905087 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8df8148fa0 msgr2=0x7f8df81e45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.831+0000 7f8dfdbef640 1 --2- 172.21.15.28:0/3236905087 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8df8148fa0 0x7f8df81e45a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8df0007e30 tx=0x7f8df000e4b0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.831+0000 7f8dfdbef640 1 -- 172.21.15.28:0/3236905087 shutdown_connections 2023-11-16T02:30:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.831+0000 7f8dfdbef640 1 --2- 172.21.15.28:0/3236905087 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f8de4065a60 0x7f8de4067f20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.831+0000 7f8dfdbef640 1 --2- 172.21.15.28:0/3236905087 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8df8148fa0 0x7f8df81e45a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.831+0000 7f8dfdbef640 1 --2- 172.21.15.28:0/3236905087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8df806a550 0x7f8df814ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.831+0000 7f8dfdbef640 1 --2- 172.21.15.28:0/3236905087 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f8df806a170 0x7f8df81455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.831+0000 7f8dfdbef640 1 -- 172.21.15.28:0/3236905087 >> 172.21.15.28:0/3236905087 conn(0x7f8df80bc5a0 msgr2=0x7f8df80b7950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.831+0000 7f8dfdbef640 1 -- 172.21.15.28:0/3236905087 shutdown_connections 2023-11-16T02:30:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.831+0000 7f8dfdbef640 1 -- 172.21.15.28:0/3236905087 wait complete. 2023-11-16T02:30:20.860 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-16T02:30:20.860 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-16T02:30:20.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.979+0000 7fe17e44a640 1 Processor -- start 2023-11-16T02:30:20.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.979+0000 7fe17e44a640 1 -- start start 2023-11-16T02:30:20.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.979+0000 7fe17e44a640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe17806a3d0 0x7fe178071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:20.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.979+0000 7fe17e44a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe1780702d0 0x7fe17814b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:20.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.979+0000 7fe17e44a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17814b1f0 con 0x7fe1781417e0 2023-11-16T02:30:20.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.979+0000 7fe17e44a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17814aec0 con 0x7fe1780702d0 2023-11-16T02:30:20.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.979+0000 7fe17e44a640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1780716b0 con 0x7fe17806a3d0 2023-11-16T02:30:20.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.979+0000 7fe177fff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe17806a3d0 0x7fe178071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:20.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.979+0000 7fe1777fe640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fe1780702d0 0x7fe17814b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:20.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.979+0000 7fe17c9e7640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fe1781417e0 0x7fe1781478d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.28:45704/0 (socket says 172.21.15.28:45704) 2023-11-16T02:30:20.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.979+0000 7fe17c9e7640 1 -- 172.21.15.28:0/550586510 learned_addr learned my addr 172.21.15.28:0/550586510 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:20.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.979+0000 7fe177fff640 1 -- 172.21.15.28:0/550586510 >> v2:172.21.15.70:3300/0 conn(0x7fe1780702d0 msgr2=0x7fe17814b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:20.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.979+0000 7fe177fff640 1 --2- 172.21.15.28:0/550586510 >> v2:172.21.15.70:3300/0 conn(0x7fe1780702d0 0x7fe17814b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.979+0000 7fe177fff640 1 -- 172.21.15.28:0/550586510 >> v1:172.21.15.70:6789/0 conn(0x7fe1781417e0 legacy=0x7fe1781478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:20.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.979+0000 7fe177fff640 1 -- 172.21.15.28:0/550586510 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17806a7b0 con 0x7fe17806a3d0 2023-11-16T02:30:20.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.979+0000 7fe1777fe640 1 --2- 172.21.15.28:0/550586510 >> v2:172.21.15.70:3300/0 conn(0x7fe1780702d0 0x7fe17814b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-16T02:30:20.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.983+0000 7fe177fff640 1 --2- 172.21.15.28:0/550586510 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe17806a3d0 0x7fe178071090 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe1680097c0 tx=0x7fe16801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db2166efef5802a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:20.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.983+0000 7fe176ffd640 1 -- 172.21.15.28:0/550586510 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1680ad640 con 0x7fe17806a3d0 2023-11-16T02:30:20.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.983+0000 7fe176ffd640 1 -- 172.21.15.28:0/550586510 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1680ad7a0 con 0x7fe17806a3d0 2023-11-16T02:30:20.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.983+0000 7fe176ffd640 1 -- 172.21.15.28:0/550586510 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1680adb30 con 0x7fe17806a3d0 2023-11-16T02:30:20.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.983+0000 7fe17e44a640 1 -- 172.21.15.28:0/550586510 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe17806a3d0 msgr2=0x7fe178071090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:20.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.983+0000 7fe17e44a640 1 --2- 172.21.15.28:0/550586510 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe17806a3d0 0x7fe178071090 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe1680097c0 tx=0x7fe16801c480 comp rx=0 tx=0).stop 2023-11-16T02:30:20.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.983+0000 7fe17e44a640 1 -- 172.21.15.28:0/550586510 shutdown_connections 2023-11-16T02:30:20.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.983+0000 7fe17e44a640 1 --2- 172.21.15.28:0/550586510 >> v2:172.21.15.70:3300/0 conn(0x7fe1780702d0 0x7fe17814b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.983+0000 7fe17e44a640 1 --2- 172.21.15.28:0/550586510 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe17806a3d0 0x7fe178071090 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.983+0000 7fe17e44a640 1 -- 172.21.15.28:0/550586510 >> 172.21.15.28:0/550586510 conn(0x7fe1780bc5a0 msgr2=0x7fe1780bc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:20.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.983+0000 7fe17e44a640 1 -- 172.21.15.28:0/550586510 shutdown_connections 2023-11-16T02:30:20.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.983+0000 7fe17e44a640 1 -- 172.21.15.28:0/550586510 wait complete. 2023-11-16T02:30:20.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.983+0000 7fe17e44a640 1 Processor -- start 2023-11-16T02:30:20.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.983+0000 7fe17e44a640 1 -- start start 2023-11-16T02:30:20.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.983+0000 7fe17e44a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe17806a3d0 0x7fe178138020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:20.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.983+0000 7fe17e44a640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe1780702d0 0x7fe178131230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:20.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.983+0000 7fe17e44a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1781417e0 0x7fe178131770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:20.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.983+0000 7fe17e44a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe178138560 con 0x7fe1781417e0 2023-11-16T02:30:20.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.983+0000 7fe17e44a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1780b8430 con 0x7fe17806a3d0 2023-11-16T02:30:20.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.983+0000 7fe17e44a640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1780bb460 con 0x7fe1780702d0 2023-11-16T02:30:20.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.987+0000 7fe17c9e7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1781417e0 0x7fe178131770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:20.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.987+0000 7fe17c9e7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1781417e0 0x7fe178131770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54150/0 (socket says 172.21.15.28:54150) 2023-11-16T02:30:20.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.987+0000 7fe17c9e7640 1 -- 172.21.15.28:0/1040114356 learned_addr learned my addr 172.21.15.28:0/1040114356 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:20.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.987+0000 7fe177fff640 1 --2- 172.21.15.28:0/1040114356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe17806a3d0 0x7fe178138020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:20.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.987+0000 7fe1777fe640 1 --2- 172.21.15.28:0/1040114356 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe1780702d0 0x7fe178131230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:20.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.987+0000 7fe17c9e7640 1 -- 172.21.15.28:0/1040114356 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe1780702d0 msgr2=0x7fe178131230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:20.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.987+0000 7fe17c9e7640 1 --2- 172.21.15.28:0/1040114356 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe1780702d0 0x7fe178131230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.987+0000 7fe17c9e7640 1 -- 172.21.15.28:0/1040114356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe17806a3d0 msgr2=0x7fe178138020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:20.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.987+0000 7fe17c9e7640 1 --2- 172.21.15.28:0/1040114356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe17806a3d0 0x7fe178138020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:20.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.987+0000 7fe17c9e7640 1 -- 172.21.15.28:0/1040114356 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c009420 con 0x7fe1781417e0 2023-11-16T02:30:20.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.987+0000 7fe17c9e7640 1 --2- 172.21.15.28:0/1040114356 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1781417e0 0x7fe178131770 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe17000cbc0 tx=0x7fe17000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:20.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.987+0000 7fe174ff9640 1 -- 172.21.15.28:0/1040114356 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17000ad40 con 0x7fe1781417e0 2023-11-16T02:30:20.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.987+0000 7fe174ff9640 1 -- 172.21.15.28:0/1040114356 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe170012400 con 0x7fe1781417e0 2023-11-16T02:30:20.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.987+0000 7fe17e44a640 1 -- 172.21.15.28:0/1040114356 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe168009420 con 0x7fe1781417e0 2023-11-16T02:30:20.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.987+0000 7fe174ff9640 1 -- 172.21.15.28:0/1040114356 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17000aea0 con 0x7fe1781417e0 2023-11-16T02:30:20.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.987+0000 7fe17e44a640 1 -- 172.21.15.28:0/1040114356 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1780b5820 con 0x7fe1781417e0 2023-11-16T02:30:20.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.987+0000 7fe17e44a640 1 -- 172.21.15.28:0/1040114356 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1780bb680 con 0x7fe1781417e0 2023-11-16T02:30:20.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.987+0000 7fe174ff9640 1 -- 172.21.15.28:0/1040114356 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe170007070 con 0x7fe1781417e0 2023-11-16T02:30:20.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.987+0000 7fe174ff9640 1 --2- 172.21.15.28:0/1040114356 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe164065a90 0x7fe164067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:20.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.987+0000 7fe177fff640 1 --2- 172.21.15.28:0/1040114356 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe164065a90 0x7fe164067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:20.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.987+0000 7fe174ff9640 1 -- 172.21.15.28:0/1040114356 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe170082fc0 con 0x7fe1781417e0 2023-11-16T02:30:20.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.987+0000 7fe177fff640 1 --2- 172.21.15.28:0/1040114356 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe164065a90 0x7fe164067f50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe1680af000 tx=0x7fe1680a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:20.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:20.991+0000 7fe174ff9640 1 -- 172.21.15.28:0/1040114356 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fe1700b4070 con 0x7fe1781417e0 2023-11-16T02:30:21.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.179+0000 7fe17e44a640 1 -- 172.21.15.28:0/1040114356 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe1780b5a10 con 0x7fe1781417e0 2023-11-16T02:30:21.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.839+0000 7fe174ff9640 1 -- 172.21.15.28:0/1040114356 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe170017020 con 0x7fe1781417e0 2023-11-16T02:30:21.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.843+0000 7fe17e44a640 1 -- 172.21.15.28:0/1040114356 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe164065a90 msgr2=0x7fe164067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:21.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.843+0000 7fe17e44a640 1 --2- 172.21.15.28:0/1040114356 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe164065a90 0x7fe164067f50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe1680af000 tx=0x7fe1680a7070 comp rx=0 tx=0).stop 2023-11-16T02:30:21.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.843+0000 7fe17e44a640 1 -- 172.21.15.28:0/1040114356 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1781417e0 msgr2=0x7fe178131770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:21.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.843+0000 7fe17e44a640 1 --2- 172.21.15.28:0/1040114356 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1781417e0 0x7fe178131770 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe17000cbc0 tx=0x7fe17000a430 comp rx=0 tx=0).stop 2023-11-16T02:30:21.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.843+0000 7fe17e44a640 1 -- 172.21.15.28:0/1040114356 shutdown_connections 2023-11-16T02:30:21.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.843+0000 7fe17e44a640 1 --2- 172.21.15.28:0/1040114356 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fe164065a90 0x7fe164067f50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:21.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.843+0000 7fe17e44a640 1 --2- 172.21.15.28:0/1040114356 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1781417e0 0x7fe178131770 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:21.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.843+0000 7fe17e44a640 1 --2- 172.21.15.28:0/1040114356 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fe1780702d0 0x7fe178131230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:21.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.843+0000 7fe17e44a640 1 --2- 172.21.15.28:0/1040114356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe17806a3d0 0x7fe178138020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:21.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.843+0000 7fe17e44a640 1 -- 172.21.15.28:0/1040114356 >> 172.21.15.28:0/1040114356 conn(0x7fe1780bc5a0 msgr2=0x7fe17813e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:21.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.843+0000 7fe17e44a640 1 -- 172.21.15.28:0/1040114356 shutdown_connections 2023-11-16T02:30:21.846 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.843+0000 7fe17e44a640 1 -- 172.21.15.28:0/1040114356 wait complete. 2023-11-16T02:30:21.867 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-16T02:30:21.867 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-16T02:30:22.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.991+0000 7f1ca8fed640 1 Processor -- start 2023-11-16T02:30:22.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.991+0000 7f1ca8fed640 1 -- start start 2023-11-16T02:30:22.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.991+0000 7f1ca8fed640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ca40b8240 0x7f1ca40bc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.991+0000 7f1ca8fed640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1ca4148960 0x7f1ca4148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.991+0000 7f1ca8fed640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1ca40b3450 0x7f1ca40b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.991+0000 7f1ca8fed640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca40b3e20 con 0x7f1ca4148960 2023-11-16T02:30:22.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.991+0000 7f1ca8fed640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca40b52b0 con 0x7f1ca40b3450 2023-11-16T02:30:22.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.991+0000 7f1ca8fed640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca40b6220 con 0x7f1ca40b8240 2023-11-16T02:30:22.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.991+0000 7f1ca1d9b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1ca4148960 0x7f1ca4148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.991+0000 7f1ca1d9b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1ca4148960 0x7f1ca4148dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54156/0 (socket says 172.21.15.28:54156) 2023-11-16T02:30:22.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.991+0000 7f1ca1d9b640 1 -- 172.21.15.28:0/1403872954 learned_addr learned my addr 172.21.15.28:0/1403872954 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:22.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.991+0000 7f1ca2d9d640 1 --2- 172.21.15.28:0/1403872954 >> v2:172.21.15.70:3300/0 conn(0x7f1ca40b3450 0x7f1ca40b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.991+0000 7f1ca259c640 1 --2- 172.21.15.28:0/1403872954 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ca40b8240 0x7f1ca40bc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.991+0000 7f1ca1d9b640 1 -- 172.21.15.28:0/1403872954 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ca40b8240 msgr2=0x7f1ca40bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:22.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.991+0000 7f1ca1d9b640 1 --2- 172.21.15.28:0/1403872954 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ca40b8240 0x7f1ca40bc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.991+0000 7f1ca1d9b640 1 -- 172.21.15.28:0/1403872954 >> v2:172.21.15.70:3300/0 conn(0x7f1ca40b3450 msgr2=0x7f1ca40b38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:22.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.991+0000 7f1ca1d9b640 1 --2- 172.21.15.28:0/1403872954 >> v2:172.21.15.70:3300/0 conn(0x7f1ca40b3450 0x7f1ca40b38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.991+0000 7f1ca1d9b640 1 -- 172.21.15.28:0/1403872954 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca40b4040 con 0x7f1ca4148960 2023-11-16T02:30:22.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca1d9b640 1 --2- 172.21.15.28:0/1403872954 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ca4148960 0x7f1ca4148dc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4071d00 tx=0x7f1c9801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454a11fcee9ef7ce server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:22.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca159a640 1 -- 172.21.15.28:0/1403872954 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c980aa5f0 con 0x7f1ca4148960 2023-11-16T02:30:22.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca159a640 1 -- 172.21.15.28:0/1403872954 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c980aa750 con 0x7f1ca4148960 2023-11-16T02:30:22.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca159a640 1 -- 172.21.15.28:0/1403872954 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c980aaae0 con 0x7f1ca4148960 2023-11-16T02:30:22.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca8fed640 1 -- 172.21.15.28:0/1403872954 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ca4148960 msgr2=0x7f1ca4148dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:22.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca8fed640 1 --2- 172.21.15.28:0/1403872954 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ca4148960 0x7f1ca4148dc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4071d00 tx=0x7f1c9801c4d0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca8fed640 1 -- 172.21.15.28:0/1403872954 shutdown_connections 2023-11-16T02:30:22.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca8fed640 1 --2- 172.21.15.28:0/1403872954 >> v2:172.21.15.70:3300/0 conn(0x7f1ca40b3450 0x7f1ca40b38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca8fed640 1 --2- 172.21.15.28:0/1403872954 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ca4148960 0x7f1ca4148dc0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca8fed640 1 --2- 172.21.15.28:0/1403872954 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ca40b8240 0x7f1ca40bc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca8fed640 1 -- 172.21.15.28:0/1403872954 >> 172.21.15.28:0/1403872954 conn(0x7f1ca40b9050 msgr2=0x7f1ca40bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:22.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca8fed640 1 -- 172.21.15.28:0/1403872954 shutdown_connections 2023-11-16T02:30:22.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca8fed640 1 -- 172.21.15.28:0/1403872954 wait complete. 2023-11-16T02:30:22.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca8fed640 1 Processor -- start 2023-11-16T02:30:22.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca8fed640 1 -- start start 2023-11-16T02:30:22.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca8fed640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ca40b3450 0x7f1ca4140260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca8fed640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ca40b8240 0x7f1ca414b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca8fed640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ca4148960 0x7f1ca4144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca8fed640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca4152660 con 0x7f1ca4148960 2023-11-16T02:30:22.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca8fed640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca41407a0 con 0x7f1ca40b8240 2023-11-16T02:30:22.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca8fed640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca41522b0 con 0x7f1ca40b3450 2023-11-16T02:30:22.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca2d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ca4148960 0x7f1ca4144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca2d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ca4148960 0x7f1ca4144ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54168/0 (socket says 172.21.15.28:54168) 2023-11-16T02:30:22.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca2d9d640 1 -- 172.21.15.28:0/369388326 learned_addr learned my addr 172.21.15.28:0/369388326 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:22.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca259c640 1 --2- 172.21.15.28:0/369388326 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ca40b3450 0x7f1ca4140260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca1d9b640 1 --2- 172.21.15.28:0/369388326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ca40b8240 0x7f1ca414b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca2d9d640 1 -- 172.21.15.28:0/369388326 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ca40b3450 msgr2=0x7f1ca4140260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:22.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca2d9d640 1 --2- 172.21.15.28:0/369388326 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ca40b3450 0x7f1ca4140260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca2d9d640 1 -- 172.21.15.28:0/369388326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ca40b8240 msgr2=0x7f1ca414b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:22.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca2d9d640 1 --2- 172.21.15.28:0/369388326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ca40b8240 0x7f1ca414b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca2d9d640 1 -- 172.21.15.28:0/369388326 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c980094d0 con 0x7f1ca4148960 2023-11-16T02:30:22.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.995+0000 7f1ca2d9d640 1 --2- 172.21.15.28:0/369388326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ca4148960 0x7f1ca4144ef0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c007e60 tx=0x7f1c9c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:22.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.999+0000 7f1c92ffd640 1 -- 172.21.15.28:0/369388326 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c014620 con 0x7f1ca4148960 2023-11-16T02:30:22.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.999+0000 7f1c92ffd640 1 -- 172.21.15.28:0/369388326 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9c00ee90 con 0x7f1ca4148960 2023-11-16T02:30:22.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.999+0000 7f1ca8fed640 1 -- 172.21.15.28:0/369388326 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca4151980 con 0x7f1ca4148960 2023-11-16T02:30:22.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.999+0000 7f1c92ffd640 1 -- 172.21.15.28:0/369388326 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c0149e0 con 0x7f1ca4148960 2023-11-16T02:30:22.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.999+0000 7f1ca8fed640 1 -- 172.21.15.28:0/369388326 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca4151f40 con 0x7f1ca4148960 2023-11-16T02:30:22.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.999+0000 7f1ca8fed640 1 -- 172.21.15.28:0/369388326 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca404e8a0 con 0x7f1ca4148960 2023-11-16T02:30:22.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.999+0000 7f1c92ffd640 1 -- 172.21.15.28:0/369388326 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1c9c014b40 con 0x7f1ca4148960 2023-11-16T02:30:22.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.999+0000 7f1c92ffd640 1 --2- 172.21.15.28:0/369388326 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1c84065a60 0x7f1c84067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.999+0000 7f1c92ffd640 1 -- 172.21.15.28:0/369388326 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c9c083af0 con 0x7f1ca4148960 2023-11-16T02:30:22.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.999+0000 7f1ca259c640 1 --2- 172.21.15.28:0/369388326 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1c84065a60 0x7f1c84067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:21.999+0000 7f1ca259c640 1 --2- 172.21.15.28:0/369388326 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1c84065a60 0x7f1c84067f20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400b9d0 tx=0x7f1c94008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:22.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.003+0000 7f1c92ffd640 1 -- 172.21.15.28:0/369388326 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f1c9c0514b0 con 0x7f1ca4148960 2023-11-16T02:30:22.194 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.191+0000 7f1ca8fed640 1 -- 172.21.15.28:0/369388326 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ca40b75a0 con 0x7f1ca4148960 2023-11-16T02:30:22.195 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.191+0000 7f1c92ffd640 1 -- 172.21.15.28:0/369388326 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3888 (secure 0 0 0) 0x7f1c9c054ad0 con 0x7f1ca4148960 2023-11-16T02:30:22.196 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:30:22.196 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/1703038976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1703038976},{"type":"v1","addr":"172.21.15.70:6833","nonce":1703038976}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4729,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/4215257772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":4215257772},{"type":"v1","addr":"172.21.15.28:6836","nonce":4215257772}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-16T02:30:19.823171+0000","modified":"2023-11-16T02:30:21.835244+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4950},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4950":{"gid":4950,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6837/885495356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":885495356},{"type":"v1","addr":"172.21.15.28:6837","nonce":885495356}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-16T02:30:22.196 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 13 2023-11-16T02:30:22.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.195+0000 7f1ca8fed640 1 -- 172.21.15.28:0/369388326 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1c84065a60 msgr2=0x7f1c84067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:22.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.195+0000 7f1ca8fed640 1 --2- 172.21.15.28:0/369388326 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1c84065a60 0x7f1c84067f20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400b9d0 tx=0x7f1c94008040 comp rx=0 tx=0).stop 2023-11-16T02:30:22.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.195+0000 7f1ca8fed640 1 -- 172.21.15.28:0/369388326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ca4148960 msgr2=0x7f1ca4144ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:22.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.195+0000 7f1ca8fed640 1 --2- 172.21.15.28:0/369388326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ca4148960 0x7f1ca4144ef0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c007e60 tx=0x7f1c9c00e4b0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.195+0000 7f1ca8fed640 1 -- 172.21.15.28:0/369388326 shutdown_connections 2023-11-16T02:30:22.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.195+0000 7f1ca8fed640 1 --2- 172.21.15.28:0/369388326 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1c84065a60 0x7f1c84067f20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.195+0000 7f1ca8fed640 1 --2- 172.21.15.28:0/369388326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1ca4148960 0x7f1ca4144ef0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.195+0000 7f1ca8fed640 1 --2- 172.21.15.28:0/369388326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ca40b8240 0x7f1ca414b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.195+0000 7f1ca8fed640 1 --2- 172.21.15.28:0/369388326 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1ca40b3450 0x7f1ca4140260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.195+0000 7f1ca8fed640 1 -- 172.21.15.28:0/369388326 >> 172.21.15.28:0/369388326 conn(0x7f1ca40b9050 msgr2=0x7f1ca40bc100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:22.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.195+0000 7f1ca8fed640 1 -- 172.21.15.28:0/369388326 shutdown_connections 2023-11-16T02:30:22.200 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.195+0000 7f1ca8fed640 1 -- 172.21.15.28:0/369388326 wait complete. 2023-11-16T02:30:22.214 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-16T02:30:22.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.319+0000 7f53732c1640 1 Processor -- start 2023-11-16T02:30:22.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.319+0000 7f53732c1640 1 -- start start 2023-11-16T02:30:22.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.323+0000 7f53732c1640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f536c0b8240 0x7f536c0bc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.323+0000 7f53732c1640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f536c148960 0x7f536c148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.323+0000 7f53732c1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f536c0b3450 0x7f536c0b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.323+0000 7f53732c1640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f536c0b3e20 con 0x7f536c0b8240 2023-11-16T02:30:22.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.323+0000 7f53732c1640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f536c0b52b0 con 0x7f536c0b3450 2023-11-16T02:30:22.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.323+0000 7f53732c1640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536c0b6220 con 0x7f536c148960 2023-11-16T02:30:22.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.323+0000 7f537105d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f536c0b8240 0x7f536c0bc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.323+0000 7f537105d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f536c0b8240 0x7f536c0bc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54172/0 (socket says 172.21.15.28:54172) 2023-11-16T02:30:22.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.323+0000 7f537105d640 1 -- 172.21.15.28:0/2983263381 learned_addr learned my addr 172.21.15.28:0/2983263381 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:22.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.323+0000 7f537085c640 1 --2- 172.21.15.28:0/2983263381 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f536c148960 0x7f536c148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.323+0000 7f537185e640 1 --2- 172.21.15.28:0/2983263381 >> v2:172.21.15.70:3300/0 conn(0x7f536c0b3450 0x7f536c0b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.323+0000 7f537105d640 1 -- 172.21.15.28:0/2983263381 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f536c148960 msgr2=0x7f536c148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:22.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.323+0000 7f537105d640 1 --2- 172.21.15.28:0/2983263381 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f536c148960 0x7f536c148dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.323+0000 7f537105d640 1 -- 172.21.15.28:0/2983263381 >> v2:172.21.15.70:3300/0 conn(0x7f536c0b3450 msgr2=0x7f536c0b38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:22.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.323+0000 7f537105d640 1 --2- 172.21.15.28:0/2983263381 >> v2:172.21.15.70:3300/0 conn(0x7f536c0b3450 0x7f536c0b38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.323+0000 7f537105d640 1 -- 172.21.15.28:0/2983263381 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536c0b4040 con 0x7f536c0b8240 2023-11-16T02:30:22.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.323+0000 7f537105d640 1 --2- 172.21.15.28:0/2983263381 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f536c0b8240 0x7f536c0bc6a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f536c071d00 tx=0x7f536401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa668f873d1a4e00 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:22.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.323+0000 7f536bfff640 1 -- 172.21.15.28:0/2983263381 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53640a5820 con 0x7f536c0b8240 2023-11-16T02:30:22.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.323+0000 7f536bfff640 1 -- 172.21.15.28:0/2983263381 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53640a5980 con 0x7f536c0b8240 2023-11-16T02:30:22.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.323+0000 7f536bfff640 1 -- 172.21.15.28:0/2983263381 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53640a5d10 con 0x7f536c0b8240 2023-11-16T02:30:22.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f53732c1640 1 -- 172.21.15.28:0/2983263381 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f536c0b8240 msgr2=0x7f536c0bc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:22.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f53732c1640 1 --2- 172.21.15.28:0/2983263381 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f536c0b8240 0x7f536c0bc6a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f536c071d00 tx=0x7f536401c9a0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f53732c1640 1 -- 172.21.15.28:0/2983263381 shutdown_connections 2023-11-16T02:30:22.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f53732c1640 1 --2- 172.21.15.28:0/2983263381 >> v2:172.21.15.70:3300/0 conn(0x7f536c0b3450 0x7f536c0b38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f53732c1640 1 --2- 172.21.15.28:0/2983263381 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f536c148960 0x7f536c148dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f53732c1640 1 --2- 172.21.15.28:0/2983263381 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f536c0b8240 0x7f536c0bc6a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f53732c1640 1 -- 172.21.15.28:0/2983263381 >> 172.21.15.28:0/2983263381 conn(0x7f536c0b9050 msgr2=0x7f536c0bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:22.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f53732c1640 1 -- 172.21.15.28:0/2983263381 shutdown_connections 2023-11-16T02:30:22.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f53732c1640 1 -- 172.21.15.28:0/2983263381 wait complete. 2023-11-16T02:30:22.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f53732c1640 1 Processor -- start 2023-11-16T02:30:22.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f53732c1640 1 -- start start 2023-11-16T02:30:22.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f53732c1640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f536c0b3450 0x7f536c14b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f53732c1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f536c0b8240 0x7f536c145840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f53732c1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f536c148960 0x7f536c143430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f53732c1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536c142480 con 0x7f536c148960 2023-11-16T02:30:22.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f53732c1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536c14b940 con 0x7f536c0b8240 2023-11-16T02:30:22.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f53732c1640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536c142230 con 0x7f536c0b3450 2023-11-16T02:30:22.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f537185e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f536c148960 0x7f536c143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f537185e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f536c148960 0x7f536c143430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54188/0 (socket says 172.21.15.28:54188) 2023-11-16T02:30:22.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f537185e640 1 -- 172.21.15.28:0/3515636778 learned_addr learned my addr 172.21.15.28:0/3515636778 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:22.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f537105d640 1 --2- 172.21.15.28:0/3515636778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f536c0b3450 0x7f536c14b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f537085c640 1 --2- 172.21.15.28:0/3515636778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f536c0b8240 0x7f536c145840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f537185e640 1 -- 172.21.15.28:0/3515636778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f536c0b3450 msgr2=0x7f536c14b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:22.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f537185e640 1 --2- 172.21.15.28:0/3515636778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f536c0b3450 0x7f536c14b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f537185e640 1 -- 172.21.15.28:0/3515636778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f536c0b8240 msgr2=0x7f536c145840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:22.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f537185e640 1 --2- 172.21.15.28:0/3515636778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f536c0b8240 0x7f536c145840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f537185e640 1 -- 172.21.15.28:0/3515636778 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5364009b30 con 0x7f536c148960 2023-11-16T02:30:22.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f537185e640 1 --2- 172.21.15.28:0/3515636778 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f536c148960 0x7f536c143430 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f535c00d830 tx=0x7f535c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:22.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f5369ffb640 1 -- 172.21.15.28:0/3515636778 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c0096c0 con 0x7f536c148960 2023-11-16T02:30:22.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f5369ffb640 1 -- 172.21.15.28:0/3515636778 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535c009820 con 0x7f536c148960 2023-11-16T02:30:22.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f53732c1640 1 -- 172.21.15.28:0/3515636778 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f536c1450c0 con 0x7f536c148960 2023-11-16T02:30:22.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f5369ffb640 1 -- 172.21.15.28:0/3515636778 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c009bd0 con 0x7f536c148960 2023-11-16T02:30:22.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f53732c1640 1 -- 172.21.15.28:0/3515636778 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f536c144b20 con 0x7f536c148960 2023-11-16T02:30:22.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.327+0000 7f53732c1640 1 -- 172.21.15.28:0/3515636778 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f536c144930 con 0x7f536c148960 2023-11-16T02:30:22.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.331+0000 7f5369ffb640 1 -- 172.21.15.28:0/3515636778 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f535c014410 con 0x7f536c148960 2023-11-16T02:30:22.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.331+0000 7f5369ffb640 1 --2- 172.21.15.28:0/3515636778 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5358065a60 0x7f5358067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.331+0000 7f5369ffb640 1 -- 172.21.15.28:0/3515636778 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f535c0839c0 con 0x7f536c148960 2023-11-16T02:30:22.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.331+0000 7f537105d640 1 --2- 172.21.15.28:0/3515636778 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5358065a60 0x7f5358067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.331+0000 7f537105d640 1 --2- 172.21.15.28:0/3515636778 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5358065a60 0x7f5358067f20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f53640ae000 tx=0x7f53640a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:22.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.335+0000 7f5369ffb640 1 -- 172.21.15.28:0/3515636778 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f536c144930 con 0x7f536c148960 2023-11-16T02:30:22.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.487+0000 7f53732c1640 1 -- 172.21.15.28:0/3515636778 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f536c144900 con 0x7f536c148960 2023-11-16T02:30:22.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.487+0000 7f5369ffb640 1 -- 172.21.15.28:0/3515636778 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16053 (secure 0 0 0) 0x7f535c051410 con 0x7f536c148960 2023-11-16T02:30:22.492 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:30:22.492 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":33,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","created":"2023-11-16T02:29:13.710567+0000","modified":"2023-11-16T02:30:20.826668+0000","last_up_change":"2023-11-16T02:29:24.841087+0000","last_in_change":"2023-11-16T02:29:16.024490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-16T02:29:26.490910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-16T02:30:17.685602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-16T02:30:18.798113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dfa8b58d-3481-4e68-86e8-21873d31d0c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":38722},{"type":"v1","addr":"172.21.15.28:6809","nonce":38722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6810","nonce":38722},{"type":"v1","addr":"172.21.15.28:6811","nonce":38722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6814","nonce":38722},{"type":"v1","addr":"172.21.15.28:6815","nonce":38722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":38722},{"type":"v1","addr":"172.21.15.28:6813","nonce":38722}]},"public_addr":"172.21.15.28:6809/38722","cluster_addr":"172.21.15.28:6811/38722","heartbeat_back_addr":"172.21.15.28:6815/38722","heartbeat_front_addr":"172.21.15.28:6813/38722","state":["exists","up"]},{"osd":1,"uuid":"1e9cb25e-a656-4fd8-90e6-1ecfa63c1e7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":38724},{"type":"v1","addr":"172.21.15.28:6824","nonce":38724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":38724},{"type":"v1","addr":"172.21.15.28:6827","nonce":38724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":38724},{"type":"v1","addr":"172.21.15.28:6831","nonce":38724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6828","nonce":38724},{"type":"v1","addr":"172.21.15.28:6829","nonce":38724}]},"public_addr":"172.21.15.28:6824/38724","cluster_addr":"172.21.15.28:6827/38724","heartbeat_back_addr":"172.21.15.28:6831/38724","heartbeat_front_addr":"172.21.15.28:6829/38724","state":["exists","up"]},{"osd":2,"uuid":"e18f39cd-6a35-4d36-9eed-3877794bf2d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":38723},{"type":"v1","addr":"172.21.15.28:6801","nonce":38723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":38723},{"type":"v1","addr":"172.21.15.28:6803","nonce":38723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":38723},{"type":"v1","addr":"172.21.15.28:6807","nonce":38723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":38723},{"type":"v1","addr":"172.21.15.28:6805","nonce":38723}]},"public_addr":"172.21.15.28:6801/38723","cluster_addr":"172.21.15.28:6803/38723","heartbeat_back_addr":"172.21.15.28:6807/38723","heartbeat_front_addr":"172.21.15.28:6805/38723","state":["exists","up"]},{"osd":3,"uuid":"303d0728-409d-47d7-b7a6-6eb273f602fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":38725},{"type":"v1","addr":"172.21.15.28:6817","nonce":38725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":38725},{"type":"v1","addr":"172.21.15.28:6819","nonce":38725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":38725},{"type":"v1","addr":"172.21.15.28:6825","nonce":38725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":38725},{"type":"v1","addr":"172.21.15.28:6821","nonce":38725}]},"public_addr":"172.21.15.28:6817/38725","cluster_addr":"172.21.15.28:6819/38725","heartbeat_back_addr":"172.21.15.28:6825/38725","heartbeat_front_addr":"172.21.15.28:6821/38725","state":["exists","up"]},{"osd":4,"uuid":"df0bf0ac-6efe-4964-ad27-7c1771a70c56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":38828},{"type":"v1","addr":"172.21.15.70:6801","nonce":38828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":38828},{"type":"v1","addr":"172.21.15.70:6803","nonce":38828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":38828},{"type":"v1","addr":"172.21.15.70:6807","nonce":38828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":38828},{"type":"v1","addr":"172.21.15.70:6805","nonce":38828}]},"public_addr":"172.21.15.70:6801/38828","cluster_addr":"172.21.15.70:6803/38828","heartbeat_back_addr":"172.21.15.70:6807/38828","heartbeat_front_addr":"172.21.15.70:6805/38828","state":["exists","up"]},{"osd":5,"uuid":"84921219-65cb-4c4e-b9ed-a773db639034","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":38830},{"type":"v1","addr":"172.21.15.70:6810","nonce":38830}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6813","nonce":38830},{"type":"v1","addr":"172.21.15.70:6814","nonce":38830}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6821","nonce":38830},{"type":"v1","addr":"172.21.15.70:6824","nonce":38830}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6817","nonce":38830},{"type":"v1","addr":"172.21.15.70:6819","nonce":38830}]},"public_addr":"172.21.15.70:6810/38830","cluster_addr":"172.21.15.70:6814/38830","heartbeat_back_addr":"172.21.15.70:6824/38830","heartbeat_front_addr":"172.21.15.70:6819/38830","state":["exists","up"]},{"osd":6,"uuid":"c1d8b0c4-ccc7-47bc-abc3-c6a988c701bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6809","nonce":38829},{"type":"v1","addr":"172.21.15.70:6812","nonce":38829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":38829},{"type":"v1","addr":"172.21.15.70:6820","nonce":38829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":38829},{"type":"v1","addr":"172.21.15.70:6828","nonce":38829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":38829},{"type":"v1","addr":"172.21.15.70:6825","nonce":38829}]},"public_addr":"172.21.15.70:6812/38829","cluster_addr":"172.21.15.70:6820/38829","heartbeat_back_addr":"172.21.15.70:6828/38829","heartbeat_front_addr":"172.21.15.70:6825/38829","state":["exists","up"]},{"osd":7,"uuid":"e2cdd418-12ce-4eea-9b22-efdad83eb76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6811","nonce":38839},{"type":"v1","addr":"172.21.15.70:6815","nonce":38839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":38839},{"type":"v1","addr":"172.21.15.70:6823","nonce":38839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":38839},{"type":"v1","addr":"172.21.15.70:6831","nonce":38839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6827","nonce":38839},{"type":"v1","addr":"172.21.15.70:6829","nonce":38839}]},"public_addr":"172.21.15.70:6815/38839","cluster_addr":"172.21.15.70:6823/38839","heartbeat_back_addr":"172.21.15.70:6831/38839","heartbeat_front_addr":"172.21.15.70:6829/38839","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.544240+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.637637+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.352115+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.652916+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.624477+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.570247+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.706468+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-16T02:29:21.696574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-16T02:30:22.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.491+0000 7f53732c1640 1 -- 172.21.15.28:0/3515636778 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5358065a60 msgr2=0x7f5358067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:22.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.491+0000 7f53732c1640 1 --2- 172.21.15.28:0/3515636778 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5358065a60 0x7f5358067f20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f53640ae000 tx=0x7f53640a7070 comp rx=0 tx=0).stop 2023-11-16T02:30:22.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.491+0000 7f53732c1640 1 -- 172.21.15.28:0/3515636778 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f536c148960 msgr2=0x7f536c143430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:22.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.491+0000 7f53732c1640 1 --2- 172.21.15.28:0/3515636778 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f536c148960 0x7f536c143430 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f535c00d830 tx=0x7f535c00dcf0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.491+0000 7f53732c1640 1 -- 172.21.15.28:0/3515636778 shutdown_connections 2023-11-16T02:30:22.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.491+0000 7f53732c1640 1 --2- 172.21.15.28:0/3515636778 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5358065a60 0x7f5358067f20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.491+0000 7f53732c1640 1 --2- 172.21.15.28:0/3515636778 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f536c148960 0x7f536c143430 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.491+0000 7f53732c1640 1 --2- 172.21.15.28:0/3515636778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f536c0b8240 0x7f536c145840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.491+0000 7f53732c1640 1 --2- 172.21.15.28:0/3515636778 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f536c0b3450 0x7f536c14b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.491+0000 7f53732c1640 1 -- 172.21.15.28:0/3515636778 >> 172.21.15.28:0/3515636778 conn(0x7f536c0b9050 msgr2=0x7f536c0b7600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:22.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.491+0000 7f53732c1640 1 -- 172.21.15.28:0/3515636778 shutdown_connections 2023-11-16T02:30:22.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.491+0000 7f53732c1640 1 -- 172.21.15.28:0/3515636778 wait complete. 2023-11-16T02:30:22.509 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-16T02:30:22.509 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-16T02:30:22.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.619+0000 7f62f2d39640 1 Processor -- start 2023-11-16T02:30:22.623 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.619+0000 7f62f2d39640 1 -- start start 2023-11-16T02:30:22.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62f2d39640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f62ec0bad20 0x7f62ec144b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62f2d39640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f62ec145070 0x7f62ec0b97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62f2d39640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f62ec0bfd70 0x7f62ec0be980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62f2d39640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62ec06bd60 con 0x7f62ec0bad20 2023-11-16T02:30:22.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62f2d39640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62ec14ed00 con 0x7f62ec145070 2023-11-16T02:30:22.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62f2d39640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec14e3d0 con 0x7f62ec0bfd70 2023-11-16T02:30:22.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62f0ad5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f62ec0bad20 0x7f62ec144b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62f0ad5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f62ec0bad20 0x7f62ec144b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54202/0 (socket says 172.21.15.28:54202) 2023-11-16T02:30:22.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62f0ad5640 1 -- 172.21.15.28:0/4073255564 learned_addr learned my addr 172.21.15.28:0/4073255564 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:22.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62f12d6640 1 --2- 172.21.15.28:0/4073255564 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f62ec0bfd70 0x7f62ec0be980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62ebfff640 1 --2- 172.21.15.28:0/4073255564 >> v2:172.21.15.70:3300/0 conn(0x7f62ec145070 0x7f62ec0b97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62f0ad5640 1 -- 172.21.15.28:0/4073255564 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f62ec0bfd70 msgr2=0x7f62ec0be980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:22.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62f0ad5640 1 --2- 172.21.15.28:0/4073255564 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f62ec0bfd70 0x7f62ec0be980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62f0ad5640 1 -- 172.21.15.28:0/4073255564 >> v2:172.21.15.70:3300/0 conn(0x7f62ec145070 msgr2=0x7f62ec0b97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:22.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62f0ad5640 1 --2- 172.21.15.28:0/4073255564 >> v2:172.21.15.70:3300/0 conn(0x7f62ec145070 0x7f62ec0b97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62f0ad5640 1 -- 172.21.15.28:0/4073255564 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ec14e6b0 con 0x7f62ec0bad20 2023-11-16T02:30:22.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62f0ad5640 1 --2- 172.21.15.28:0/4073255564 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62ec0bad20 0x7f62ec144b30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f62ec14bc00 tx=0x7f62dc01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29bb0adcc6a0a757 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:22.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62eb7fe640 1 -- 172.21.15.28:0/4073255564 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc0a89b0 con 0x7f62ec0bad20 2023-11-16T02:30:22.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62eb7fe640 1 -- 172.21.15.28:0/4073255564 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc0a8b10 con 0x7f62ec0bad20 2023-11-16T02:30:22.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62eb7fe640 1 -- 172.21.15.28:0/4073255564 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc0a8ea0 con 0x7f62ec0bad20 2023-11-16T02:30:22.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62f2d39640 1 -- 172.21.15.28:0/4073255564 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62ec0bad20 msgr2=0x7f62ec144b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:22.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62f2d39640 1 --2- 172.21.15.28:0/4073255564 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62ec0bad20 0x7f62ec144b30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f62ec14bc00 tx=0x7f62dc01ecf0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62f2d39640 1 -- 172.21.15.28:0/4073255564 shutdown_connections 2023-11-16T02:30:22.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62f2d39640 1 --2- 172.21.15.28:0/4073255564 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f62ec0bfd70 0x7f62ec0be980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62f2d39640 1 --2- 172.21.15.28:0/4073255564 >> v2:172.21.15.70:3300/0 conn(0x7f62ec145070 0x7f62ec0b97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62f2d39640 1 --2- 172.21.15.28:0/4073255564 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62ec0bad20 0x7f62ec144b30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62f2d39640 1 -- 172.21.15.28:0/4073255564 >> 172.21.15.28:0/4073255564 conn(0x7f62ec0c03a0 msgr2=0x7f62ec0c07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:22.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62f2d39640 1 -- 172.21.15.28:0/4073255564 shutdown_connections 2023-11-16T02:30:22.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.623+0000 7f62f2d39640 1 -- 172.21.15.28:0/4073255564 wait complete. 2023-11-16T02:30:22.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.627+0000 7f62f2d39640 1 Processor -- start 2023-11-16T02:30:22.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.627+0000 7f62f2d39640 1 -- start start 2023-11-16T02:30:22.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.627+0000 7f62f2d39640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62ec0bad20 0x7f62ec1e3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.627+0000 7f62f2d39640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62ec0bfd70 0x7f62ec0a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.627+0000 7f62f2d39640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f62ec0a5290 0x7f62ec143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.627+0000 7f62f2d39640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec0b9120 con 0x7f62ec0bad20 2023-11-16T02:30:22.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.627+0000 7f62f2d39640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec0ba4f0 con 0x7f62ec0bfd70 2023-11-16T02:30:22.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.627+0000 7f62f2d39640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec0b52c0 con 0x7f62ec0a5290 2023-11-16T02:30:22.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.627+0000 7f62f0ad5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62ec0bad20 0x7f62ec1e3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.627+0000 7f62f0ad5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62ec0bad20 0x7f62ec1e3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54210/0 (socket says 172.21.15.28:54210) 2023-11-16T02:30:22.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.627+0000 7f62f0ad5640 1 -- 172.21.15.28:0/3284993995 learned_addr learned my addr 172.21.15.28:0/3284993995 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:22.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.627+0000 7f62f0ad5640 1 -- 172.21.15.28:0/3284993995 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f62ec0a5290 msgr2=0x7f62ec143e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:22.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.627+0000 7f62f0ad5640 1 --2- 172.21.15.28:0/3284993995 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f62ec0a5290 0x7f62ec143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.627+0000 7f62f0ad5640 1 -- 172.21.15.28:0/3284993995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62ec0bfd70 msgr2=0x7f62ec0a4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:22.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.627+0000 7f62f0ad5640 1 --2- 172.21.15.28:0/3284993995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62ec0bfd70 0x7f62ec0a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.627+0000 7f62f0ad5640 1 -- 172.21.15.28:0/3284993995 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62dc0094d0 con 0x7f62ec0bad20 2023-11-16T02:30:22.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.627+0000 7f62f0ad5640 1 --2- 172.21.15.28:0/3284993995 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62ec0bad20 0x7f62ec1e3c20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f62dc01d3a0 tx=0x7f62dc01ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:22.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.627+0000 7f62e97fa640 1 -- 172.21.15.28:0/3284993995 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc0ba600 con 0x7f62ec0bad20 2023-11-16T02:30:22.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.627+0000 7f62e97fa640 1 -- 172.21.15.28:0/3284993995 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc0ba760 con 0x7f62ec0bad20 2023-11-16T02:30:22.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.627+0000 7f62f2d39640 1 -- 172.21.15.28:0/3284993995 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62ec0ba210 con 0x7f62ec0bad20 2023-11-16T02:30:22.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.627+0000 7f62e97fa640 1 -- 172.21.15.28:0/3284993995 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc0bab10 con 0x7f62ec0bad20 2023-11-16T02:30:22.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.627+0000 7f62f2d39640 1 -- 172.21.15.28:0/3284993995 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62ec0b8ad0 con 0x7f62ec0bad20 2023-11-16T02:30:22.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.627+0000 7f62f2d39640 1 -- 172.21.15.28:0/3284993995 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62ec0b87f0 con 0x7f62ec0bad20 2023-11-16T02:30:22.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.627+0000 7f62e97fa640 1 -- 172.21.15.28:0/3284993995 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f62dc0bac70 con 0x7f62ec0bad20 2023-11-16T02:30:22.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.631+0000 7f62e97fa640 1 --2- 172.21.15.28:0/3284993995 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f62d8065a30 0x7f62d8067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.631+0000 7f62e97fa640 1 -- 172.21.15.28:0/3284993995 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62dc121fc0 con 0x7f62ec0bad20 2023-11-16T02:30:22.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.631+0000 7f62ebfff640 1 --2- 172.21.15.28:0/3284993995 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f62d8065a30 0x7f62d8067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.631+0000 7f62ebfff640 1 --2- 172.21.15.28:0/3284993995 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f62d8065a30 0x7f62d8067ef0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f62ec0a13e0 tx=0x7f62e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:22.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.631+0000 7f62e97fa640 1 -- 172.21.15.28:0/3284993995 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f62dc0efa60 con 0x7f62ec0bad20 2023-11-16T02:30:22.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.779+0000 7f62f2d39640 1 -- 172.21.15.28:0/3284993995 --> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62ec0bc5e0 con 0x7f62d8065a30 2023-11-16T02:30:22.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.787+0000 7f62e97fa640 1 -- 172.21.15.28:0/3284993995 <== mgr.4104 v2:172.21.15.28:6832/38651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+263353 (secure 0 0 0) 0x7f62e000be00 con 0x7f62d8065a30 2023-11-16T02:30:22.791 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:30:22.793 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-11-16T02:30:22.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.791+0000 7f62f2d39640 1 -- 172.21.15.28:0/3284993995 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f62d8065a30 msgr2=0x7f62d8067ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:22.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.791+0000 7f62f2d39640 1 --2- 172.21.15.28:0/3284993995 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f62d8065a30 0x7f62d8067ef0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f62ec0a13e0 tx=0x7f62e0008040 comp rx=0 tx=0).stop 2023-11-16T02:30:22.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.791+0000 7f62f2d39640 1 -- 172.21.15.28:0/3284993995 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62ec0bad20 msgr2=0x7f62ec1e3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:22.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.791+0000 7f62f2d39640 1 --2- 172.21.15.28:0/3284993995 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62ec0bad20 0x7f62ec1e3c20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f62dc01d3a0 tx=0x7f62dc01ba90 comp rx=0 tx=0).stop 2023-11-16T02:30:22.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.791+0000 7f62f2d39640 1 -- 172.21.15.28:0/3284993995 shutdown_connections 2023-11-16T02:30:22.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.791+0000 7f62f2d39640 1 --2- 172.21.15.28:0/3284993995 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f62d8065a30 0x7f62d8067ef0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.791+0000 7f62f2d39640 1 --2- 172.21.15.28:0/3284993995 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f62ec0a5290 0x7f62ec143e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.791+0000 7f62f2d39640 1 --2- 172.21.15.28:0/3284993995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f62ec0bfd70 0x7f62ec0a4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.791+0000 7f62f2d39640 1 --2- 172.21.15.28:0/3284993995 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f62ec0bad20 0x7f62ec1e3c20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.791+0000 7f62f2d39640 1 -- 172.21.15.28:0/3284993995 >> 172.21.15.28:0/3284993995 conn(0x7f62ec0c03a0 msgr2=0x7f62ec0a1630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:22.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.791+0000 7f62f2d39640 1 -- 172.21.15.28:0/3284993995 shutdown_connections 2023-11-16T02:30:22.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.791+0000 7f62f2d39640 1 -- 172.21.15.28:0/3284993995 wait complete. 2023-11-16T02:30:22.810 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-11-16T02:30:22.428531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":200,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":178,"acting":178,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252248,"kb_used_data":3864,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754722472,"statfs":{"total":773094113280,"available":772835811328,"internally_reserved":0,"allocated":3956736,"data_stored":2209228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":60,"apply_latency_ms":60,"commit_latency_ns":60000000,"apply_latency_ns":60000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.002315"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.884818+0000","last_change":"2023-11-16T02:30:19.870271+0000","last_active":"2023-11-16T02:30:19.884818+0000","last_peered":"2023-11-16T02:30:19.884818+0000","last_clean":"2023-11-16T02:30:19.884818+0000","last_became_active":"2023-11-16T02:30:19.869530+0000","last_became_peered":"2023-11-16T02:30:19.869530+0000","last_unstale":"2023-11-16T02:30:19.884818+0000","last_undegraded":"2023-11-16T02:30:19.884818+0000","last_fullsized":"2023-11-16T02:30:19.884818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:34:33.419560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.851719+0000","last_change":"2023-11-16T02:30:19.847500+0000","last_active":"2023-11-16T02:30:19.851719+0000","last_peered":"2023-11-16T02:30:19.851719+0000","last_clean":"2023-11-16T02:30:19.851719+0000","last_became_active":"2023-11-16T02:30:19.847125+0000","last_became_peered":"2023-11-16T02:30:19.847125+0000","last_unstale":"2023-11-16T02:30:19.851719+0000","last_undegraded":"2023-11-16T02:30:19.851719+0000","last_fullsized":"2023-11-16T02:30:19.851719+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:04:02.319109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878367+0000","last_change":"2023-11-16T02:30:19.866614+0000","last_active":"2023-11-16T02:30:19.878367+0000","last_peered":"2023-11-16T02:30:19.878367+0000","last_clean":"2023-11-16T02:30:19.878367+0000","last_became_active":"2023-11-16T02:30:19.865850+0000","last_became_peered":"2023-11-16T02:30:19.865850+0000","last_unstale":"2023-11-16T02:30:19.878367+0000","last_undegraded":"2023-11-16T02:30:19.878367+0000","last_fullsized":"2023-11-16T02:30:19.878367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:26:35.043805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.883440+0000","last_change":"2023-11-16T02:30:19.882299+0000","last_active":"2023-11-16T02:30:19.883440+0000","last_peered":"2023-11-16T02:30:19.883440+0000","last_clean":"2023-11-16T02:30:19.883440+0000","last_became_active":"2023-11-16T02:30:19.882012+0000","last_became_peered":"2023-11-16T02:30:19.882012+0000","last_unstale":"2023-11-16T02:30:19.883440+0000","last_undegraded":"2023-11-16T02:30:19.883440+0000","last_fullsized":"2023-11-16T02:30:19.883440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:05:48.808451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.873934+0000","last_change":"2023-11-16T02:30:19.873025+0000","last_active":"2023-11-16T02:30:19.873934+0000","last_peered":"2023-11-16T02:30:19.873934+0000","last_clean":"2023-11-16T02:30:19.873934+0000","last_became_active":"2023-11-16T02:30:19.872781+0000","last_became_peered":"2023-11-16T02:30:19.872781+0000","last_unstale":"2023-11-16T02:30:19.873934+0000","last_undegraded":"2023-11-16T02:30:19.873934+0000","last_fullsized":"2023-11-16T02:30:19.873934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:19:10.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893391+0000","last_change":"2023-11-16T02:30:19.886324+0000","last_active":"2023-11-16T02:30:19.893391+0000","last_peered":"2023-11-16T02:30:19.893391+0000","last_clean":"2023-11-16T02:30:19.893391+0000","last_became_active":"2023-11-16T02:30:19.885725+0000","last_became_peered":"2023-11-16T02:30:19.885725+0000","last_unstale":"2023-11-16T02:30:19.893391+0000","last_undegraded":"2023-11-16T02:30:19.893391+0000","last_fullsized":"2023-11-16T02:30:19.893391+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:29:41.914615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.890750+0000","last_change":"2023-11-16T02:30:19.874493+0000","last_active":"2023-11-16T02:30:19.890750+0000","last_peered":"2023-11-16T02:30:19.890750+0000","last_clean":"2023-11-16T02:30:19.890750+0000","last_became_active":"2023-11-16T02:30:19.872914+0000","last_became_peered":"2023-11-16T02:30:19.872914+0000","last_unstale":"2023-11-16T02:30:19.890750+0000","last_undegraded":"2023-11-16T02:30:19.890750+0000","last_fullsized":"2023-11-16T02:30:19.890750+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:58:23.597351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.876394+0000","last_change":"2023-11-16T02:30:19.846299+0000","last_active":"2023-11-16T02:30:19.876394+0000","last_peered":"2023-11-16T02:30:19.876394+0000","last_clean":"2023-11-16T02:30:19.876394+0000","last_became_active":"2023-11-16T02:30:19.845561+0000","last_became_peered":"2023-11-16T02:30:19.845561+0000","last_unstale":"2023-11-16T02:30:19.876394+0000","last_undegraded":"2023-11-16T02:30:19.876394+0000","last_fullsized":"2023-11-16T02:30:19.876394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:24:43.125348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.848786+0000","last_change":"2023-11-16T02:30:19.843307+0000","last_active":"2023-11-16T02:30:19.848786+0000","last_peered":"2023-11-16T02:30:19.848786+0000","last_clean":"2023-11-16T02:30:19.848786+0000","last_became_active":"2023-11-16T02:30:19.842948+0000","last_became_peered":"2023-11-16T02:30:19.842948+0000","last_unstale":"2023-11-16T02:30:19.848786+0000","last_undegraded":"2023-11-16T02:30:19.848786+0000","last_fullsized":"2023-11-16T02:30:19.848786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:51:01.130415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893290+0000","last_change":"2023-11-16T02:30:19.884857+0000","last_active":"2023-11-16T02:30:19.893290+0000","last_peered":"2023-11-16T02:30:19.893290+0000","last_clean":"2023-11-16T02:30:19.893290+0000","last_became_active":"2023-11-16T02:30:19.884211+0000","last_became_peered":"2023-11-16T02:30:19.884211+0000","last_unstale":"2023-11-16T02:30:19.893290+0000","last_undegraded":"2023-11-16T02:30:19.893290+0000","last_fullsized":"2023-11-16T02:30:19.893290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:26:35.043805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.883207+0000","last_change":"2023-11-16T02:30:19.873333+0000","last_active":"2023-11-16T02:30:19.883207+0000","last_peered":"2023-11-16T02:30:19.883207+0000","last_clean":"2023-11-16T02:30:19.883207+0000","last_became_active":"2023-11-16T02:30:19.872312+0000","last_became_peered":"2023-11-16T02:30:19.872312+0000","last_unstale":"2023-11-16T02:30:19.883207+0000","last_undegraded":"2023-11-16T02:30:19.883207+0000","last_fullsized":"2023-11-16T02:30:19.883207+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:01:25.904236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.851670+0000","last_change":"2023-11-16T02:30:19.847259+0000","last_active":"2023-11-16T02:30:19.851670+0000","last_peered":"2023-11-16T02:30:19.851670+0000","last_clean":"2023-11-16T02:30:19.851670+0000","last_became_active":"2023-11-16T02:30:19.846960+0000","last_became_peered":"2023-11-16T02:30:19.846960+0000","last_unstale":"2023-11-16T02:30:19.851670+0000","last_undegraded":"2023-11-16T02:30:19.851670+0000","last_fullsized":"2023-11-16T02:30:19.851670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T09:23:18.109208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878474+0000","last_change":"2023-11-16T02:30:19.866095+0000","last_active":"2023-11-16T02:30:19.878474+0000","last_peered":"2023-11-16T02:30:19.878474+0000","last_clean":"2023-11-16T02:30:19.878474+0000","last_became_active":"2023-11-16T02:30:19.865309+0000","last_became_peered":"2023-11-16T02:30:19.865309+0000","last_unstale":"2023-11-16T02:30:19.878474+0000","last_undegraded":"2023-11-16T02:30:19.878474+0000","last_fullsized":"2023-11-16T02:30:19.878474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:05:48.808451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.890791+0000","last_change":"2023-11-16T02:30:19.874960+0000","last_active":"2023-11-16T02:30:19.890791+0000","last_peered":"2023-11-16T02:30:19.890791+0000","last_clean":"2023-11-16T02:30:19.890791+0000","last_became_active":"2023-11-16T02:30:19.873799+0000","last_became_peered":"2023-11-16T02:30:19.873799+0000","last_unstale":"2023-11-16T02:30:19.890791+0000","last_undegraded":"2023-11-16T02:30:19.890791+0000","last_fullsized":"2023-11-16T02:30:19.890791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:25:44.847232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893326+0000","last_change":"2023-11-16T02:30:19.885005+0000","last_active":"2023-11-16T02:30:19.893326+0000","last_peered":"2023-11-16T02:30:19.893326+0000","last_clean":"2023-11-16T02:30:19.893326+0000","last_became_active":"2023-11-16T02:30:19.884513+0000","last_became_peered":"2023-11-16T02:30:19.884513+0000","last_unstale":"2023-11-16T02:30:19.893326+0000","last_undegraded":"2023-11-16T02:30:19.893326+0000","last_fullsized":"2023-11-16T02:30:19.893326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:23:28.656034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.850304+0000","last_change":"2023-11-16T02:30:19.840626+0000","last_active":"2023-11-16T02:30:19.850304+0000","last_peered":"2023-11-16T02:30:19.850304+0000","last_clean":"2023-11-16T02:30:19.850304+0000","last_became_active":"2023-11-16T02:30:19.840345+0000","last_became_peered":"2023-11-16T02:30:19.840345+0000","last_unstale":"2023-11-16T02:30:19.850304+0000","last_undegraded":"2023-11-16T02:30:19.850304+0000","last_fullsized":"2023-11-16T02:30:19.850304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:23:28.656034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.851576+0000","last_change":"2023-11-16T02:30:19.845327+0000","last_active":"2023-11-16T02:30:19.851576+0000","last_peered":"2023-11-16T02:30:19.851576+0000","last_clean":"2023-11-16T02:30:19.851576+0000","last_became_active":"2023-11-16T02:30:19.845068+0000","last_became_peered":"2023-11-16T02:30:19.845068+0000","last_unstale":"2023-11-16T02:30:19.851576+0000","last_undegraded":"2023-11-16T02:30:19.851576+0000","last_fullsized":"2023-11-16T02:30:19.851576+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:58:23.597351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.890272+0000","last_change":"2023-11-16T02:30:19.879907+0000","last_active":"2023-11-16T02:30:19.890272+0000","last_peered":"2023-11-16T02:30:19.890272+0000","last_clean":"2023-11-16T02:30:19.890272+0000","last_became_active":"2023-11-16T02:30:19.878794+0000","last_became_peered":"2023-11-16T02:30:19.878794+0000","last_unstale":"2023-11-16T02:30:19.890272+0000","last_undegraded":"2023-11-16T02:30:19.890272+0000","last_fullsized":"2023-11-16T02:30:19.890272+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:05:25.212455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.884390+0000","last_change":"2023-11-16T02:30:19.867043+0000","last_active":"2023-11-16T02:30:19.884390+0000","last_peered":"2023-11-16T02:30:19.884390+0000","last_clean":"2023-11-16T02:30:19.884390+0000","last_became_active":"2023-11-16T02:30:19.866232+0000","last_became_peered":"2023-11-16T02:30:19.866232+0000","last_unstale":"2023-11-16T02:30:19.884390+0000","last_undegraded":"2023-11-16T02:30:19.884390+0000","last_fullsized":"2023-11-16T02:30:19.884390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:51:01.130415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.877328+0000","last_change":"2023-11-16T02:30:19.875797+0000","last_active":"2023-11-16T02:30:19.877328+0000","last_peered":"2023-11-16T02:30:19.877328+0000","last_clean":"2023-11-16T02:30:19.877328+0000","last_became_active":"2023-11-16T02:30:19.875422+0000","last_became_peered":"2023-11-16T02:30:19.875422+0000","last_unstale":"2023-11-16T02:30:19.877328+0000","last_undegraded":"2023-11-16T02:30:19.877328+0000","last_fullsized":"2023-11-16T02:30:19.877328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:51:01.130415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878399+0000","last_change":"2023-11-16T02:30:19.867144+0000","last_active":"2023-11-16T02:30:19.878399+0000","last_peered":"2023-11-16T02:30:19.878399+0000","last_clean":"2023-11-16T02:30:19.878399+0000","last_became_active":"2023-11-16T02:30:19.865272+0000","last_became_peered":"2023-11-16T02:30:19.865272+0000","last_unstale":"2023-11-16T02:30:19.878399+0000","last_undegraded":"2023-11-16T02:30:19.878399+0000","last_fullsized":"2023-11-16T02:30:19.878399+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:53:26.356470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.873118+0000","last_change":"2023-11-16T02:30:19.872380+0000","last_active":"2023-11-16T02:30:19.873118+0000","last_peered":"2023-11-16T02:30:19.873118+0000","last_clean":"2023-11-16T02:30:19.873118+0000","last_became_active":"2023-11-16T02:30:19.872131+0000","last_became_peered":"2023-11-16T02:30:19.872131+0000","last_unstale":"2023-11-16T02:30:19.873118+0000","last_undegraded":"2023-11-16T02:30:19.873118+0000","last_fullsized":"2023-11-16T02:30:19.873118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:14:02.468285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.873930+0000","last_change":"2023-11-16T02:30:19.873009+0000","last_active":"2023-11-16T02:30:19.873930+0000","last_peered":"2023-11-16T02:30:19.873930+0000","last_clean":"2023-11-16T02:30:19.873930+0000","last_became_active":"2023-11-16T02:30:19.872718+0000","last_became_peered":"2023-11-16T02:30:19.872718+0000","last_unstale":"2023-11-16T02:30:19.873930+0000","last_undegraded":"2023-11-16T02:30:19.873930+0000","last_fullsized":"2023-11-16T02:30:19.873930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:57:16.626801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878500+0000","last_change":"2023-11-16T02:30:19.877492+0000","last_active":"2023-11-16T02:30:19.878500+0000","last_peered":"2023-11-16T02:30:19.878500+0000","last_clean":"2023-11-16T02:30:19.878500+0000","last_became_active":"2023-11-16T02:30:19.877055+0000","last_became_peered":"2023-11-16T02:30:19.877055+0000","last_unstale":"2023-11-16T02:30:19.878500+0000","last_undegraded":"2023-11-16T02:30:19.878500+0000","last_fullsized":"2023-11-16T02:30:19.878500+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:30:57.683829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.883250+0000","last_change":"2023-11-16T02:30:19.873823+0000","last_active":"2023-11-16T02:30:19.883250+0000","last_peered":"2023-11-16T02:30:19.883250+0000","last_clean":"2023-11-16T02:30:19.883250+0000","last_became_active":"2023-11-16T02:30:19.873097+0000","last_became_peered":"2023-11-16T02:30:19.873097+0000","last_unstale":"2023-11-16T02:30:19.883250+0000","last_undegraded":"2023-11-16T02:30:19.883250+0000","last_fullsized":"2023-11-16T02:30:19.883250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:11:01.176911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.890230+0000","last_change":"2023-11-16T02:30:19.879438+0000","last_active":"2023-11-16T02:30:19.890230+0000","last_peered":"2023-11-16T02:30:19.890230+0000","last_clean":"2023-11-16T02:30:19.890230+0000","last_became_active":"2023-11-16T02:30:19.878067+0000","last_became_peered":"2023-11-16T02:30:19.878067+0000","last_unstale":"2023-11-16T02:30:19.890230+0000","last_undegraded":"2023-11-16T02:30:19.890230+0000","last_fullsized":"2023-11-16T02:30:19.890230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:53:26.356470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893346+0000","last_change":"2023-11-16T02:30:19.885674+0000","last_active":"2023-11-16T02:30:19.893346+0000","last_peered":"2023-11-16T02:30:19.893346+0000","last_clean":"2023-11-16T02:30:19.893346+0000","last_became_active":"2023-11-16T02:30:19.884062+0000","last_became_peered":"2023-11-16T02:30:19.884062+0000","last_unstale":"2023-11-16T02:30:19.893346+0000","last_undegraded":"2023-11-16T02:30:19.893346+0000","last_fullsized":"2023-11-16T02:30:19.893346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:59:15.040356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.872486+0000","last_change":"2023-11-16T02:30:19.859781+0000","last_active":"2023-11-16T02:30:19.872486+0000","last_peered":"2023-11-16T02:30:19.872486+0000","last_clean":"2023-11-16T02:30:19.872486+0000","last_became_active":"2023-11-16T02:30:19.857455+0000","last_became_peered":"2023-11-16T02:30:19.857455+0000","last_unstale":"2023-11-16T02:30:19.872486+0000","last_undegraded":"2023-11-16T02:30:19.872486+0000","last_fullsized":"2023-11-16T02:30:19.872486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:17:17.336842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893099+0000","last_change":"2023-11-16T02:30:19.880769+0000","last_active":"2023-11-16T02:30:19.893099+0000","last_peered":"2023-11-16T02:30:19.893099+0000","last_clean":"2023-11-16T02:30:19.893099+0000","last_became_active":"2023-11-16T02:30:19.878925+0000","last_became_peered":"2023-11-16T02:30:19.878925+0000","last_unstale":"2023-11-16T02:30:19.893099+0000","last_undegraded":"2023-11-16T02:30:19.893099+0000","last_fullsized":"2023-11-16T02:30:19.893099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:57:16.626801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.877326+0000","last_change":"2023-11-16T02:30:19.875765+0000","last_active":"2023-11-16T02:30:19.877326+0000","last_peered":"2023-11-16T02:30:19.877326+0000","last_clean":"2023-11-16T02:30:19.877326+0000","last_became_active":"2023-11-16T02:30:19.875438+0000","last_became_peered":"2023-11-16T02:30:19.875438+0000","last_unstale":"2023-11-16T02:30:19.877326+0000","last_undegraded":"2023-11-16T02:30:19.877326+0000","last_fullsized":"2023-11-16T02:30:19.877326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:53:26.356470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.884630+0000","last_change":"2023-11-16T02:30:19.484973+0000","last_active":"2023-11-16T02:30:19.884630+0000","last_peered":"2023-11-16T02:30:19.884630+0000","last_clean":"2023-11-16T02:30:19.884630+0000","last_became_active":"2023-11-16T02:30:19.484403+0000","last_became_peered":"2023-11-16T02:30:19.484403+0000","last_unstale":"2023-11-16T02:30:19.884630+0000","last_undegraded":"2023-11-16T02:30:19.884630+0000","last_fullsized":"2023-11-16T02:30:19.884630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:30:11.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.891352+0000","last_change":"2023-11-16T02:30:19.886424+0000","last_active":"2023-11-16T02:30:19.891352+0000","last_peered":"2023-11-16T02:30:19.891352+0000","last_clean":"2023-11-16T02:30:19.891352+0000","last_became_active":"2023-11-16T02:30:19.885778+0000","last_became_peered":"2023-11-16T02:30:19.885778+0000","last_unstale":"2023-11-16T02:30:19.891352+0000","last_undegraded":"2023-11-16T02:30:19.891352+0000","last_fullsized":"2023-11-16T02:30:19.891352+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:26:16.324058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.875204+0000","last_change":"2023-11-16T02:30:19.467799+0000","last_active":"2023-11-16T02:30:19.875204+0000","last_peered":"2023-11-16T02:30:19.875204+0000","last_clean":"2023-11-16T02:30:19.875204+0000","last_became_active":"2023-11-16T02:30:19.467517+0000","last_became_peered":"2023-11-16T02:30:19.467517+0000","last_unstale":"2023-11-16T02:30:19.875204+0000","last_undegraded":"2023-11-16T02:30:19.875204+0000","last_fullsized":"2023-11-16T02:30:19.875204+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:53:29.543335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.884546+0000","last_change":"2023-11-16T02:30:19.865354+0000","last_active":"2023-11-16T02:30:19.884546+0000","last_peered":"2023-11-16T02:30:19.884546+0000","last_clean":"2023-11-16T02:30:19.884546+0000","last_became_active":"2023-11-16T02:30:19.864635+0000","last_became_peered":"2023-11-16T02:30:19.864635+0000","last_unstale":"2023-11-16T02:30:19.884546+0000","last_undegraded":"2023-11-16T02:30:19.884546+0000","last_fullsized":"2023-11-16T02:30:19.884546+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T09:30:55.572569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.857320+0000","last_change":"2023-11-16T02:30:19.463569+0000","last_active":"2023-11-16T02:30:19.857320+0000","last_peered":"2023-11-16T02:30:19.857320+0000","last_clean":"2023-11-16T02:30:19.857320+0000","last_became_active":"2023-11-16T02:30:19.463298+0000","last_became_peered":"2023-11-16T02:30:19.463298+0000","last_unstale":"2023-11-16T02:30:19.857320+0000","last_undegraded":"2023-11-16T02:30:19.857320+0000","last_fullsized":"2023-11-16T02:30:19.857320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:26:15.319244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878131+0000","last_change":"2023-11-16T02:30:19.876755+0000","last_active":"2023-11-16T02:30:19.878131+0000","last_peered":"2023-11-16T02:30:19.878131+0000","last_clean":"2023-11-16T02:30:19.878131+0000","last_became_active":"2023-11-16T02:30:19.876454+0000","last_became_peered":"2023-11-16T02:30:19.876454+0000","last_unstale":"2023-11-16T02:30:19.878131+0000","last_undegraded":"2023-11-16T02:30:19.878131+0000","last_fullsized":"2023-11-16T02:30:19.878131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T09:30:55.572569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-16T02:30:18.431898+0000","last_change":"2023-11-16T02:30:18.431898+0000","last_active":"2023-11-16T02:30:18.421000+0000","last_peered":"2023-11-16T02:30:18.421000+0000","last_clean":"2023-11-16T02:30:18.421000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:18.431898+0000","last_undegraded":"2023-11-16T02:30:18.431898+0000","last_fullsized":"2023-11-16T02:30:18.431898+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:15:52.039420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893400+0000","last_change":"2023-11-16T02:30:19.887577+0000","last_active":"2023-11-16T02:30:19.893400+0000","last_peered":"2023-11-16T02:30:19.893400+0000","last_clean":"2023-11-16T02:30:19.893400+0000","last_became_active":"2023-11-16T02:30:19.886948+0000","last_became_peered":"2023-11-16T02:30:19.886948+0000","last_unstale":"2023-11-16T02:30:19.893400+0000","last_undegraded":"2023-11-16T02:30:19.893400+0000","last_fullsized":"2023-11-16T02:30:19.893400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:11:01.176911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.877547+0000","last_change":"2023-11-16T02:30:19.461227+0000","last_active":"2023-11-16T02:30:19.877547+0000","last_peered":"2023-11-16T02:30:19.877547+0000","last_clean":"2023-11-16T02:30:19.877547+0000","last_became_active":"2023-11-16T02:30:19.460450+0000","last_became_peered":"2023-11-16T02:30:19.460450+0000","last_unstale":"2023-11-16T02:30:19.877547+0000","last_undegraded":"2023-11-16T02:30:19.877547+0000","last_fullsized":"2023-11-16T02:30:19.877547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:07:18.071597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878430+0000","last_change":"2023-11-16T02:30:19.868426+0000","last_active":"2023-11-16T02:30:19.878430+0000","last_peered":"2023-11-16T02:30:19.878430+0000","last_clean":"2023-11-16T02:30:19.878430+0000","last_became_active":"2023-11-16T02:30:19.866177+0000","last_became_peered":"2023-11-16T02:30:19.866177+0000","last_unstale":"2023-11-16T02:30:19.878430+0000","last_undegraded":"2023-11-16T02:30:19.878430+0000","last_fullsized":"2023-11-16T02:30:19.878430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:14:02.468285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.876474+0000","last_change":"2023-11-16T02:30:19.461149+0000","last_active":"2023-11-16T02:30:19.876474+0000","last_peered":"2023-11-16T02:30:19.876474+0000","last_clean":"2023-11-16T02:30:19.876474+0000","last_became_active":"2023-11-16T02:30:19.460646+0000","last_became_peered":"2023-11-16T02:30:19.460646+0000","last_unstale":"2023-11-16T02:30:19.876474+0000","last_undegraded":"2023-11-16T02:30:19.876474+0000","last_fullsized":"2023-11-16T02:30:19.876474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:08:35.892877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.890191+0000","last_change":"2023-11-16T02:30:19.878750+0000","last_active":"2023-11-16T02:30:19.890191+0000","last_peered":"2023-11-16T02:30:19.890191+0000","last_clean":"2023-11-16T02:30:19.890191+0000","last_became_active":"2023-11-16T02:30:19.878234+0000","last_became_peered":"2023-11-16T02:30:19.878234+0000","last_unstale":"2023-11-16T02:30:19.890191+0000","last_undegraded":"2023-11-16T02:30:19.890191+0000","last_fullsized":"2023-11-16T02:30:19.890191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:11:46.387664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.835183+0000","last_change":"2023-11-16T02:30:19.469556+0000","last_active":"2023-11-16T02:30:19.835183+0000","last_peered":"2023-11-16T02:30:19.835183+0000","last_clean":"2023-11-16T02:30:19.835183+0000","last_became_active":"2023-11-16T02:30:19.468872+0000","last_became_peered":"2023-11-16T02:30:19.468872+0000","last_unstale":"2023-11-16T02:30:19.835183+0000","last_undegraded":"2023-11-16T02:30:19.835183+0000","last_fullsized":"2023-11-16T02:30:19.835183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:11:45.382850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.871173+0000","last_change":"2023-11-16T02:30:19.869582+0000","last_active":"2023-11-16T02:30:19.871173+0000","last_peered":"2023-11-16T02:30:19.871173+0000","last_clean":"2023-11-16T02:30:19.871173+0000","last_became_active":"2023-11-16T02:30:19.869254+0000","last_became_peered":"2023-11-16T02:30:19.869254+0000","last_unstale":"2023-11-16T02:30:19.871173+0000","last_undegraded":"2023-11-16T02:30:19.871173+0000","last_fullsized":"2023-11-16T02:30:19.871173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:26:35.043805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.834349+0000","last_change":"2023-11-16T02:30:19.466145+0000","last_active":"2023-11-16T02:30:19.834349+0000","last_peered":"2023-11-16T02:30:19.834349+0000","last_clean":"2023-11-16T02:30:19.834349+0000","last_became_active":"2023-11-16T02:30:19.465726+0000","last_became_peered":"2023-11-16T02:30:19.465726+0000","last_unstale":"2023-11-16T02:30:19.834349+0000","last_undegraded":"2023-11-16T02:30:19.834349+0000","last_fullsized":"2023-11-16T02:30:19.834349+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:23:32.728712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878486+0000","last_change":"2023-11-16T02:30:19.867919+0000","last_active":"2023-11-16T02:30:19.878486+0000","last_peered":"2023-11-16T02:30:19.878486+0000","last_clean":"2023-11-16T02:30:19.878486+0000","last_became_active":"2023-11-16T02:30:19.867061+0000","last_became_peered":"2023-11-16T02:30:19.867061+0000","last_unstale":"2023-11-16T02:30:19.878486+0000","last_undegraded":"2023-11-16T02:30:19.878486+0000","last_fullsized":"2023-11-16T02:30:19.878486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:30:57.683829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.836643+0000","last_change":"2023-11-16T02:30:19.472891+0000","last_active":"2023-11-16T02:30:19.836643+0000","last_peered":"2023-11-16T02:30:19.836643+0000","last_clean":"2023-11-16T02:30:19.836643+0000","last_became_active":"2023-11-16T02:30:19.472450+0000","last_became_peered":"2023-11-16T02:30:19.472450+0000","last_unstale":"2023-11-16T02:30:19.836643+0000","last_undegraded":"2023-11-16T02:30:19.836643+0000","last_fullsized":"2023-11-16T02:30:19.836643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:34:32.414746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.848452+0000","last_change":"2023-11-16T02:30:19.840186+0000","last_active":"2023-11-16T02:30:19.848452+0000","last_peered":"2023-11-16T02:30:19.848452+0000","last_clean":"2023-11-16T02:30:19.848452+0000","last_became_active":"2023-11-16T02:30:19.839901+0000","last_became_peered":"2023-11-16T02:30:19.839901+0000","last_unstale":"2023-11-16T02:30:19.848452+0000","last_undegraded":"2023-11-16T02:30:19.848452+0000","last_fullsized":"2023-11-16T02:30:19.848452+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:00:28.306611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.829875+0000","last_change":"2023-11-16T02:30:19.467692+0000","last_active":"2023-11-16T02:30:19.829875+0000","last_peered":"2023-11-16T02:30:19.829875+0000","last_clean":"2023-11-16T02:30:19.829875+0000","last_became_active":"2023-11-16T02:30:19.467180+0000","last_became_peered":"2023-11-16T02:30:19.467180+0000","last_unstale":"2023-11-16T02:30:19.829875+0000","last_undegraded":"2023-11-16T02:30:19.829875+0000","last_fullsized":"2023-11-16T02:30:19.829875+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:02:05.395662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878009+0000","last_change":"2023-11-16T02:30:19.877297+0000","last_active":"2023-11-16T02:30:19.878009+0000","last_peered":"2023-11-16T02:30:19.878009+0000","last_clean":"2023-11-16T02:30:19.878009+0000","last_became_active":"2023-11-16T02:30:19.876717+0000","last_became_peered":"2023-11-16T02:30:19.876717+0000","last_unstale":"2023-11-16T02:30:19.878009+0000","last_undegraded":"2023-11-16T02:30:19.878009+0000","last_fullsized":"2023-11-16T02:30:19.878009+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:00:21.607056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.888776+0000","last_change":"2023-11-16T02:30:19.482605+0000","last_active":"2023-11-16T02:30:19.888776+0000","last_peered":"2023-11-16T02:30:19.888776+0000","last_clean":"2023-11-16T02:30:19.888776+0000","last_became_active":"2023-11-16T02:30:19.481717+0000","last_became_peered":"2023-11-16T02:30:19.481717+0000","last_unstale":"2023-11-16T02:30:19.888776+0000","last_undegraded":"2023-11-16T02:30:19.888776+0000","last_fullsized":"2023-11-16T02:30:19.888776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:27:42.254533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878420+0000","last_change":"2023-11-16T02:30:19.868734+0000","last_active":"2023-11-16T02:30:19.878420+0000","last_peered":"2023-11-16T02:30:19.878420+0000","last_clean":"2023-11-16T02:30:19.878420+0000","last_became_active":"2023-11-16T02:30:19.868028+0000","last_became_peered":"2023-11-16T02:30:19.868028+0000","last_unstale":"2023-11-16T02:30:19.878420+0000","last_undegraded":"2023-11-16T02:30:19.878420+0000","last_fullsized":"2023-11-16T02:30:19.878420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:29:41.914615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.880000+0000","last_change":"2023-11-16T02:30:19.465379+0000","last_active":"2023-11-16T02:30:19.880000+0000","last_peered":"2023-11-16T02:30:19.880000+0000","last_clean":"2023-11-16T02:30:19.880000+0000","last_became_active":"2023-11-16T02:30:19.464674+0000","last_became_peered":"2023-11-16T02:30:19.464674+0000","last_unstale":"2023-11-16T02:30:19.880000+0000","last_undegraded":"2023-11-16T02:30:19.880000+0000","last_fullsized":"2023-11-16T02:30:19.880000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:33:12.505379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.883395+0000","last_change":"2023-11-16T02:30:19.882010+0000","last_active":"2023-11-16T02:30:19.883395+0000","last_peered":"2023-11-16T02:30:19.883395+0000","last_clean":"2023-11-16T02:30:19.883395+0000","last_became_active":"2023-11-16T02:30:19.881685+0000","last_became_peered":"2023-11-16T02:30:19.881685+0000","last_unstale":"2023-11-16T02:30:19.883395+0000","last_undegraded":"2023-11-16T02:30:19.883395+0000","last_fullsized":"2023-11-16T02:30:19.883395+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:11:01.176911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.885297+0000","last_change":"2023-11-16T02:30:19.467910+0000","last_active":"2023-11-16T02:30:19.885297+0000","last_peered":"2023-11-16T02:30:19.885297+0000","last_clean":"2023-11-16T02:30:19.885297+0000","last_became_active":"2023-11-16T02:30:19.467432+0000","last_became_peered":"2023-11-16T02:30:19.467432+0000","last_unstale":"2023-11-16T02:30:19.885297+0000","last_undegraded":"2023-11-16T02:30:19.885297+0000","last_fullsized":"2023-11-16T02:30:19.885297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:59:51.546762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.850327+0000","last_change":"2023-11-16T02:30:19.840706+0000","last_active":"2023-11-16T02:30:19.850327+0000","last_peered":"2023-11-16T02:30:19.850327+0000","last_clean":"2023-11-16T02:30:19.850327+0000","last_became_active":"2023-11-16T02:30:19.840310+0000","last_became_peered":"2023-11-16T02:30:19.840310+0000","last_unstale":"2023-11-16T02:30:19.850327+0000","last_undegraded":"2023-11-16T02:30:19.850327+0000","last_fullsized":"2023-11-16T02:30:19.850327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:01:25.904236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.835925+0000","last_change":"2023-11-16T02:30:19.467641+0000","last_active":"2023-11-16T02:30:19.835925+0000","last_peered":"2023-11-16T02:30:19.835925+0000","last_clean":"2023-11-16T02:30:19.835925+0000","last_became_active":"2023-11-16T02:30:19.467184+0000","last_became_peered":"2023-11-16T02:30:19.467184+0000","last_unstale":"2023-11-16T02:30:19.835925+0000","last_undegraded":"2023-11-16T02:30:19.835925+0000","last_fullsized":"2023-11-16T02:30:19.835925+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:40:26.674869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893121+0000","last_change":"2023-11-16T02:30:19.881218+0000","last_active":"2023-11-16T02:30:19.893121+0000","last_peered":"2023-11-16T02:30:19.893121+0000","last_clean":"2023-11-16T02:30:19.893121+0000","last_became_active":"2023-11-16T02:30:19.879762+0000","last_became_peered":"2023-11-16T02:30:19.879762+0000","last_unstale":"2023-11-16T02:30:19.893121+0000","last_undegraded":"2023-11-16T02:30:19.893121+0000","last_fullsized":"2023-11-16T02:30:19.893121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:01:25.904236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.835106+0000","last_change":"2023-11-16T02:30:19.472885+0000","last_active":"2023-11-16T02:30:19.835106+0000","last_peered":"2023-11-16T02:30:19.835106+0000","last_clean":"2023-11-16T02:30:19.835106+0000","last_became_active":"2023-11-16T02:30:19.472418+0000","last_became_peered":"2023-11-16T02:30:19.472418+0000","last_unstale":"2023-11-16T02:30:19.835106+0000","last_undegraded":"2023-11-16T02:30:19.835106+0000","last_fullsized":"2023-11-16T02:30:19.835106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:05:24.207641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.891248+0000","last_change":"2023-11-16T02:30:19.880084+0000","last_active":"2023-11-16T02:30:19.891248+0000","last_peered":"2023-11-16T02:30:19.891248+0000","last_clean":"2023-11-16T02:30:19.891248+0000","last_became_active":"2023-11-16T02:30:19.879577+0000","last_became_peered":"2023-11-16T02:30:19.879577+0000","last_unstale":"2023-11-16T02:30:19.891248+0000","last_undegraded":"2023-11-16T02:30:19.891248+0000","last_fullsized":"2023-11-16T02:30:19.891248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:05:25.212455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.858621+0000","last_change":"2023-11-16T02:30:19.459454+0000","last_active":"2023-11-16T02:30:19.858621+0000","last_peered":"2023-11-16T02:30:19.858621+0000","last_clean":"2023-11-16T02:30:19.858621+0000","last_became_active":"2023-11-16T02:30:19.458959+0000","last_became_peered":"2023-11-16T02:30:19.458959+0000","last_unstale":"2023-11-16T02:30:19.858621+0000","last_undegraded":"2023-11-16T02:30:19.858621+0000","last_fullsized":"2023-11-16T02:30:19.858621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:27:42.254533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.890110+0000","last_change":"2023-11-16T02:30:19.877024+0000","last_active":"2023-11-16T02:30:19.890110+0000","last_peered":"2023-11-16T02:30:19.890110+0000","last_clean":"2023-11-16T02:30:19.890110+0000","last_became_active":"2023-11-16T02:30:19.876487+0000","last_became_peered":"2023-11-16T02:30:19.876487+0000","last_unstale":"2023-11-16T02:30:19.890110+0000","last_undegraded":"2023-11-16T02:30:19.890110+0000","last_fullsized":"2023-11-16T02:30:19.890110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:30:57.683829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.852631+0000","last_change":"2023-11-16T02:30:19.461811+0000","last_active":"2023-11-16T02:30:19.852631+0000","last_peered":"2023-11-16T02:30:19.852631+0000","last_clean":"2023-11-16T02:30:19.852631+0000","last_became_active":"2023-11-16T02:30:19.460313+0000","last_became_peered":"2023-11-16T02:30:19.460313+0000","last_unstale":"2023-11-16T02:30:19.852631+0000","last_undegraded":"2023-11-16T02:30:19.852631+0000","last_fullsized":"2023-11-16T02:30:19.852631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:02:05.395662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.887669+0000","last_change":"2023-11-16T02:30:19.885693+0000","last_active":"2023-11-16T02:30:19.887669+0000","last_peered":"2023-11-16T02:30:19.887669+0000","last_clean":"2023-11-16T02:30:19.887669+0000","last_became_active":"2023-11-16T02:30:19.885102+0000","last_became_peered":"2023-11-16T02:30:19.885102+0000","last_unstale":"2023-11-16T02:30:19.887669+0000","last_undegraded":"2023-11-16T02:30:19.887669+0000","last_fullsized":"2023-11-16T02:30:19.887669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:59:15.040356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.877415+0000","last_change":"2023-11-16T02:30:19.477174+0000","last_active":"2023-11-16T02:30:19.877415+0000","last_peered":"2023-11-16T02:30:19.877415+0000","last_clean":"2023-11-16T02:30:19.877415+0000","last_became_active":"2023-11-16T02:30:19.475945+0000","last_became_peered":"2023-11-16T02:30:19.475945+0000","last_unstale":"2023-11-16T02:30:19.877415+0000","last_undegraded":"2023-11-16T02:30:19.877415+0000","last_fullsized":"2023-11-16T02:30:19.877415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:29:26.977995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.883430+0000","last_change":"2023-11-16T02:30:19.882218+0000","last_active":"2023-11-16T02:30:19.883430+0000","last_peered":"2023-11-16T02:30:19.883430+0000","last_clean":"2023-11-16T02:30:19.883430+0000","last_became_active":"2023-11-16T02:30:19.881908+0000","last_became_peered":"2023-11-16T02:30:19.881908+0000","last_unstale":"2023-11-16T02:30:19.883430+0000","last_undegraded":"2023-11-16T02:30:19.883430+0000","last_fullsized":"2023-11-16T02:30:19.883430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:24:43.125348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.876969+0000","last_change":"2023-11-16T02:30:19.470192+0000","last_active":"2023-11-16T02:30:19.876969+0000","last_peered":"2023-11-16T02:30:19.876969+0000","last_clean":"2023-11-16T02:30:19.876969+0000","last_became_active":"2023-11-16T02:30:19.469472+0000","last_became_peered":"2023-11-16T02:30:19.469472+0000","last_unstale":"2023-11-16T02:30:19.876969+0000","last_undegraded":"2023-11-16T02:30:19.876969+0000","last_fullsized":"2023-11-16T02:30:19.876969+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:17:41.856951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.836885+0000","last_change":"2023-11-16T02:30:19.468369+0000","last_active":"2023-11-16T02:30:19.836885+0000","last_peered":"2023-11-16T02:30:19.836885+0000","last_clean":"2023-11-16T02:30:19.836885+0000","last_became_active":"2023-11-16T02:30:19.467924+0000","last_became_peered":"2023-11-16T02:30:19.467924+0000","last_unstale":"2023-11-16T02:30:19.836885+0000","last_undegraded":"2023-11-16T02:30:19.836885+0000","last_fullsized":"2023-11-16T02:30:19.836885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:30:11.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.853040+0000","last_change":"2023-11-16T02:30:19.467061+0000","last_active":"2023-11-16T02:30:19.853040+0000","last_peered":"2023-11-16T02:30:19.853040+0000","last_clean":"2023-11-16T02:30:19.853040+0000","last_became_active":"2023-11-16T02:30:19.466792+0000","last_became_peered":"2023-11-16T02:30:19.466792+0000","last_unstale":"2023-11-16T02:30:19.853040+0000","last_undegraded":"2023-11-16T02:30:19.853040+0000","last_fullsized":"2023-11-16T02:30:19.853040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T02:52:12.747285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.836867+0000","last_change":"2023-11-16T02:30:19.465478+0000","last_active":"2023-11-16T02:30:19.836867+0000","last_peered":"2023-11-16T02:30:19.836867+0000","last_clean":"2023-11-16T02:30:19.836867+0000","last_became_active":"2023-11-16T02:30:19.464658+0000","last_became_peered":"2023-11-16T02:30:19.464658+0000","last_unstale":"2023-11-16T02:30:19.836867+0000","last_undegraded":"2023-11-16T02:30:19.836867+0000","last_fullsized":"2023-11-16T02:30:19.836867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:23:32.728712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.834793+0000","last_change":"2023-11-16T02:30:19.485044+0000","last_active":"2023-11-16T02:30:19.834793+0000","last_peered":"2023-11-16T02:30:19.834793+0000","last_clean":"2023-11-16T02:30:19.834793+0000","last_became_active":"2023-11-16T02:30:19.484575+0000","last_became_peered":"2023-11-16T02:30:19.484575+0000","last_unstale":"2023-11-16T02:30:19.834793+0000","last_undegraded":"2023-11-16T02:30:19.834793+0000","last_fullsized":"2023-11-16T02:30:19.834793+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:48:59.158704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893198+0000","last_change":"2023-11-16T02:30:19.881226+0000","last_active":"2023-11-16T02:30:19.893198+0000","last_peered":"2023-11-16T02:30:19.893198+0000","last_clean":"2023-11-16T02:30:19.893198+0000","last_became_active":"2023-11-16T02:30:19.880563+0000","last_became_peered":"2023-11-16T02:30:19.880563+0000","last_unstale":"2023-11-16T02:30:19.893198+0000","last_undegraded":"2023-11-16T02:30:19.893198+0000","last_fullsized":"2023-11-16T02:30:19.893198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:04:02.319109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.842049+0000","last_change":"2023-11-16T02:30:19.482268+0000","last_active":"2023-11-16T02:30:19.842049+0000","last_peered":"2023-11-16T02:30:19.842049+0000","last_clean":"2023-11-16T02:30:19.842049+0000","last_became_active":"2023-11-16T02:30:19.481547+0000","last_became_peered":"2023-11-16T02:30:19.481547+0000","last_unstale":"2023-11-16T02:30:19.842049+0000","last_undegraded":"2023-11-16T02:30:19.842049+0000","last_fullsized":"2023-11-16T02:30:19.842049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:53:29.543335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.881681+0000","last_change":"2023-11-16T02:30:19.486403+0000","last_active":"2023-11-16T02:30:19.881681+0000","last_peered":"2023-11-16T02:30:19.881681+0000","last_clean":"2023-11-16T02:30:19.881681+0000","last_became_active":"2023-11-16T02:30:19.485982+0000","last_became_peered":"2023-11-16T02:30:19.485982+0000","last_unstale":"2023-11-16T02:30:19.881681+0000","last_undegraded":"2023-11-16T02:30:19.881681+0000","last_fullsized":"2023-11-16T02:30:19.881681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T02:52:12.747285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878779+0000","last_change":"2023-11-16T02:30:19.868154+0000","last_active":"2023-11-16T02:30:19.878779+0000","last_peered":"2023-11-16T02:30:19.878779+0000","last_clean":"2023-11-16T02:30:19.878779+0000","last_became_active":"2023-11-16T02:30:19.867219+0000","last_became_peered":"2023-11-16T02:30:19.867219+0000","last_unstale":"2023-11-16T02:30:19.878779+0000","last_undegraded":"2023-11-16T02:30:19.878779+0000","last_fullsized":"2023-11-16T02:30:19.878779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:04:02.319109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.829792+0000","last_change":"2023-11-16T02:30:19.467493+0000","last_active":"2023-11-16T02:30:19.829792+0000","last_peered":"2023-11-16T02:30:19.829792+0000","last_clean":"2023-11-16T02:30:19.829792+0000","last_became_active":"2023-11-16T02:30:19.466854+0000","last_became_peered":"2023-11-16T02:30:19.466854+0000","last_unstale":"2023-11-16T02:30:19.829792+0000","last_undegraded":"2023-11-16T02:30:19.829792+0000","last_fullsized":"2023-11-16T02:30:19.829792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:40:26.674869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.843656+0000","last_change":"2023-11-16T02:30:19.839272+0000","last_active":"2023-11-16T02:30:19.843656+0000","last_peered":"2023-11-16T02:30:19.843656+0000","last_clean":"2023-11-16T02:30:19.843656+0000","last_became_active":"2023-11-16T02:30:19.838628+0000","last_became_peered":"2023-11-16T02:30:19.838628+0000","last_unstale":"2023-11-16T02:30:19.843656+0000","last_undegraded":"2023-11-16T02:30:19.843656+0000","last_fullsized":"2023-11-16T02:30:19.843656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:34:33.419560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.835792+0000","last_change":"2023-11-16T02:30:19.468928+0000","last_active":"2023-11-16T02:30:19.835792+0000","last_peered":"2023-11-16T02:30:19.835792+0000","last_clean":"2023-11-16T02:30:19.835792+0000","last_became_active":"2023-11-16T02:30:19.468602+0000","last_became_peered":"2023-11-16T02:30:19.468602+0000","last_unstale":"2023-11-16T02:30:19.835792+0000","last_undegraded":"2023-11-16T02:30:19.835792+0000","last_fullsized":"2023-11-16T02:30:19.835792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:30:11.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.871844+0000","last_change":"2023-11-16T02:30:19.859362+0000","last_active":"2023-11-16T02:30:19.871844+0000","last_peered":"2023-11-16T02:30:19.871844+0000","last_clean":"2023-11-16T02:30:19.871844+0000","last_became_active":"2023-11-16T02:30:19.858630+0000","last_became_peered":"2023-11-16T02:30:19.858630+0000","last_unstale":"2023-11-16T02:30:19.871844+0000","last_undegraded":"2023-11-16T02:30:19.871844+0000","last_fullsized":"2023-11-16T02:30:19.871844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:11:46.387664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.829236+0000","last_change":"2023-11-16T02:30:19.482379+0000","last_active":"2023-11-16T02:30:19.829236+0000","last_peered":"2023-11-16T02:30:19.829236+0000","last_clean":"2023-11-16T02:30:19.829236+0000","last_became_active":"2023-11-16T02:30:19.481905+0000","last_became_peered":"2023-11-16T02:30:19.481905+0000","last_unstale":"2023-11-16T02:30:19.829236+0000","last_undegraded":"2023-11-16T02:30:19.829236+0000","last_fullsized":"2023-11-16T02:30:19.829236+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:30:11.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.860430+0000","last_change":"2023-11-16T02:30:19.859522+0000","last_active":"2023-11-16T02:30:19.860430+0000","last_peered":"2023-11-16T02:30:19.860430+0000","last_clean":"2023-11-16T02:30:19.860430+0000","last_became_active":"2023-11-16T02:30:19.859274+0000","last_became_peered":"2023-11-16T02:30:19.859274+0000","last_unstale":"2023-11-16T02:30:19.860430+0000","last_undegraded":"2023-11-16T02:30:19.860430+0000","last_fullsized":"2023-11-16T02:30:19.860430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:17:17.336842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.836027+0000","last_change":"2023-11-16T02:30:19.481967+0000","last_active":"2023-11-16T02:30:19.836027+0000","last_peered":"2023-11-16T02:30:19.836027+0000","last_clean":"2023-11-16T02:30:19.836027+0000","last_became_active":"2023-11-16T02:30:19.481503+0000","last_became_peered":"2023-11-16T02:30:19.481503+0000","last_unstale":"2023-11-16T02:30:19.836027+0000","last_undegraded":"2023-11-16T02:30:19.836027+0000","last_fullsized":"2023-11-16T02:30:19.836027+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:55:12.932877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.852314+0000","last_change":"2023-11-16T02:30:19.840571+0000","last_active":"2023-11-16T02:30:19.852314+0000","last_peered":"2023-11-16T02:30:19.852314+0000","last_clean":"2023-11-16T02:30:19.852314+0000","last_became_active":"2023-11-16T02:30:19.840277+0000","last_became_peered":"2023-11-16T02:30:19.840277+0000","last_unstale":"2023-11-16T02:30:19.852314+0000","last_undegraded":"2023-11-16T02:30:19.852314+0000","last_fullsized":"2023-11-16T02:30:19.852314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:59:15.040356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.835041+0000","last_change":"2023-11-16T02:30:19.485297+0000","last_active":"2023-11-16T02:30:19.835041+0000","last_peered":"2023-11-16T02:30:19.835041+0000","last_clean":"2023-11-16T02:30:19.835041+0000","last_became_active":"2023-11-16T02:30:19.484515+0000","last_became_peered":"2023-11-16T02:30:19.484515+0000","last_unstale":"2023-11-16T02:30:19.835041+0000","last_undegraded":"2023-11-16T02:30:19.835041+0000","last_fullsized":"2023-11-16T02:30:19.835041+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:52:21.172818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.884462+0000","last_change":"2023-11-16T02:30:19.864997+0000","last_active":"2023-11-16T02:30:19.884462+0000","last_peered":"2023-11-16T02:30:19.884462+0000","last_clean":"2023-11-16T02:30:19.884462+0000","last_became_active":"2023-11-16T02:30:19.864281+0000","last_became_peered":"2023-11-16T02:30:19.864281+0000","last_unstale":"2023-11-16T02:30:19.884462+0000","last_undegraded":"2023-11-16T02:30:19.884462+0000","last_fullsized":"2023-11-16T02:30:19.884462+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:05:48.808451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.832593+0000","last_change":"2023-11-16T02:30:19.480325+0000","last_active":"2023-11-16T02:30:19.832593+0000","last_peered":"2023-11-16T02:30:19.832593+0000","last_clean":"2023-11-16T02:30:19.832593+0000","last_became_active":"2023-11-16T02:30:19.480062+0000","last_became_peered":"2023-11-16T02:30:19.480062+0000","last_unstale":"2023-11-16T02:30:19.832593+0000","last_undegraded":"2023-11-16T02:30:19.832593+0000","last_fullsized":"2023-11-16T02:30:19.832593+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:17:16.332028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893192+0000","last_change":"2023-11-16T02:30:19.884211+0000","last_active":"2023-11-16T02:30:19.893192+0000","last_peered":"2023-11-16T02:30:19.893192+0000","last_clean":"2023-11-16T02:30:19.893192+0000","last_became_active":"2023-11-16T02:30:19.880825+0000","last_became_peered":"2023-11-16T02:30:19.880825+0000","last_unstale":"2023-11-16T02:30:19.893192+0000","last_undegraded":"2023-11-16T02:30:19.893192+0000","last_fullsized":"2023-11-16T02:30:19.893192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:00:28.306611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.834224+0000","last_change":"2023-11-16T02:30:19.479112+0000","last_active":"2023-11-16T02:30:19.834224+0000","last_peered":"2023-11-16T02:30:19.834224+0000","last_clean":"2023-11-16T02:30:19.834224+0000","last_became_active":"2023-11-16T02:30:19.478459+0000","last_became_peered":"2023-11-16T02:30:19.478459+0000","last_unstale":"2023-11-16T02:30:19.834224+0000","last_undegraded":"2023-11-16T02:30:19.834224+0000","last_fullsized":"2023-11-16T02:30:19.834224+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:55:12.932877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.466612+0000","last_change":"2023-11-16T02:29:27.538359+0000","last_active":"2023-11-16T02:30:19.466612+0000","last_peered":"2023-11-16T02:30:19.466612+0000","last_clean":"2023-11-16T02:30:19.466612+0000","last_became_active":"2023-11-16T02:29:27.536606+0000","last_became_peered":"2023-11-16T02:29:27.536606+0000","last_unstale":"2023-11-16T02:30:19.466612+0000","last_undegraded":"2023-11-16T02:30:19.466612+0000","last_fullsized":"2023-11-16T02:30:19.466612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:26.491990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:26.491990+0000","last_clean_scrub_stamp":"2023-11-16T02:29:26.491990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:29:40.434297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":112,"acting":112,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":933888,"data_stored":716897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":360448,"data_stored":133920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":339968,"data_stored":126529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]}]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":339968,"data_stored":126529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":368640,"data_stored":134890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":339968,"data_stored":126529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":946176,"data_stored":723672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":327680,"data_stored":120262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-16T02:30:22.815 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-16T02:30:22.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.975+0000 7f7e2bcd3640 1 Processor -- start 2023-11-16T02:30:22.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.975+0000 7f7e2bcd3640 1 -- start start 2023-11-16T02:30:22.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.975+0000 7f7e2bcd3640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f7e240b8240 0x7f7e240bc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.975+0000 7f7e2bcd3640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7e240b3b60 0x7f7e241532a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.975+0000 7f7e2bcd3640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e240b52b0 con 0x7f7e24148960 2023-11-16T02:30:22.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.975+0000 7f7e2bcd3640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e240b6220 con 0x7f7e240b8240 2023-11-16T02:30:22.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.975+0000 7f7e2bcd3640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e240b4040 con 0x7f7e240b3b60 2023-11-16T02:30:22.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.975+0000 7f7e2926e640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f7e24148960 0x7f7e240b3450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54284/0 (socket says 172.21.15.28:54284) 2023-11-16T02:30:22.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.975+0000 7f7e2926e640 1 -- 172.21.15.28:0/2861185126 learned_addr learned my addr 172.21.15.28:0/2861185126 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:22.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e29a6f640 1 --2- 172.21.15.28:0/2861185126 >> v2:172.21.15.70:3300/0 conn(0x7f7e240b8240 0x7f7e240bc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e2a270640 1 --2- 172.21.15.28:0/2861185126 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7e240b3b60 0x7f7e241532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e28a6d640 1 -- 172.21.15.28:0/2861185126 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1069876184 0 0) 0x7f7e240b52b0 con 0x7f7e24148960 2023-11-16T02:30:22.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e28a6d640 1 -- 172.21.15.28:0/2861185126 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e10003530 con 0x7f7e24148960 2023-11-16T02:30:22.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e28a6d640 1 -- 172.21.15.28:0/2861185126 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3153842652 0 0) 0x7f7e10003530 con 0x7f7e24148960 2023-11-16T02:30:22.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e28a6d640 1 -- 172.21.15.28:0/2861185126 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7e240b3b60 msgr2=0x7f7e241532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:22.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e28a6d640 1 --2- 172.21.15.28:0/2861185126 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7e240b3b60 0x7f7e241532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e28a6d640 1 -- 172.21.15.28:0/2861185126 >> v2:172.21.15.70:3300/0 conn(0x7f7e240b8240 msgr2=0x7f7e240bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:22.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e28a6d640 1 --2- 172.21.15.28:0/2861185126 >> v2:172.21.15.70:3300/0 conn(0x7f7e240b8240 0x7f7e240bc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e28a6d640 1 -- 172.21.15.28:0/2861185126 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e240b5a20 con 0x7f7e24148960 2023-11-16T02:30:22.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e28a6d640 1 -- 172.21.15.28:0/2861185126 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7f7e14001680 con 0x7f7e24148960 2023-11-16T02:30:22.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e28a6d640 1 -- 172.21.15.28:0/2861185126 >> v1:172.21.15.28:6789/0 conn(0x7f7e24148960 legacy=0x7f7e240b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:22.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e28a6d640 1 --2- 172.21.15.28:0/2861185126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e10003980 0x7f7e10003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e28a6d640 1 --2- 172.21.15.28:0/2861185126 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7e240b3b60 0x7f7e100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e28a6d640 1 --2- 172.21.15.28:0/2861185126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7e10004d10 0x7f7e10005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e28a6d640 1 -- 172.21.15.28:0/2861185126 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e240b6220 con 0x7f7e10004d10 2023-11-16T02:30:22.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e28a6d640 1 -- 172.21.15.28:0/2861185126 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e240b4040 con 0x7f7e10003980 2023-11-16T02:30:22.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e28a6d640 1 -- 172.21.15.28:0/2861185126 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1000b990 con 0x7f7e240b3b60 2023-11-16T02:30:22.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e2a270640 1 --2- 172.21.15.28:0/2861185126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7e10004d10 0x7f7e10005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e2926e640 1 --2- 172.21.15.28:0/2861185126 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7e240b3b60 0x7f7e100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e29a6f640 1 --2- 172.21.15.28:0/2861185126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e10003980 0x7f7e10003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e2a270640 1 -- 172.21.15.28:0/2861185126 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7e240b3b60 msgr2=0x7f7e100047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:22.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e2a270640 1 --2- 172.21.15.28:0/2861185126 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7e240b3b60 0x7f7e100047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e2a270640 1 -- 172.21.15.28:0/2861185126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e10003980 msgr2=0x7f7e10003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:22.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e2a270640 1 --2- 172.21.15.28:0/2861185126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e10003980 0x7f7e10003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e2a270640 1 -- 172.21.15.28:0/2861185126 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e10003530 con 0x7f7e10004d10 2023-11-16T02:30:22.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e2a270640 1 --2- 172.21.15.28:0/2861185126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7e10004d10 0x7f7e10005190 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7e240b3f70 tx=0x7f7e1c01cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5f191c0758f2a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:22.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e28a6d640 1 -- 172.21.15.28:0/2861185126 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0a5bd0 con 0x7f7e10004d10 2023-11-16T02:30:22.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e28a6d640 1 -- 172.21.15.28:0/2861185126 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1c00f040 con 0x7f7e10004d10 2023-11-16T02:30:22.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e28a6d640 1 -- 172.21.15.28:0/2861185126 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0ad440 con 0x7f7e10004d10 2023-11-16T02:30:22.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e2bcd3640 1 -- 172.21.15.28:0/2861185126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7e10004d10 msgr2=0x7f7e10005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:22.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e2bcd3640 1 --2- 172.21.15.28:0/2861185126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7e10004d10 0x7f7e10005190 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7e240b3f70 tx=0x7f7e1c01cbc0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e2a270640 1 -- 172.21.15.28:0/2861185126 reap_dead start 2023-11-16T02:30:22.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e2bcd3640 1 -- 172.21.15.28:0/2861185126 shutdown_connections 2023-11-16T02:30:22.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.979+0000 7f7e2bcd3640 1 -- 172.21.15.28:0/2861185126 >> 172.21.15.28:0/2861185126 conn(0x7f7e240b9050 msgr2=0x7f7e240bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:22.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.983+0000 7f7e2bcd3640 1 -- 172.21.15.28:0/2861185126 shutdown_connections 2023-11-16T02:30:22.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.983+0000 7f7e2bcd3640 1 -- 172.21.15.28:0/2861185126 wait complete. 2023-11-16T02:30:22.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.983+0000 7f7e2bcd3640 1 Processor -- start 2023-11-16T02:30:22.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.983+0000 7f7e2bcd3640 1 -- start start 2023-11-16T02:30:22.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.983+0000 7f7e2bcd3640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7e10004d10 0x7f7e2414b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.983+0000 7f7e2bcd3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7e2414c130 0x7f7e2414c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.983+0000 7f7e2bcd3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e2413e150 0x7f7e2413e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.983+0000 7f7e2bcd3640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e24146100 con 0x7f7e2414c130 2023-11-16T02:30:22.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.983+0000 7f7e2bcd3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2414cad0 con 0x7f7e2413e150 2023-11-16T02:30:22.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.983+0000 7f7e2bcd3640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e24145e20 con 0x7f7e10004d10 2023-11-16T02:30:22.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.983+0000 7f7e2926e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7e2414c130 0x7f7e2414c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.983+0000 7f7e2926e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7e2414c130 0x7f7e2414c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54222/0 (socket says 172.21.15.28:54222) 2023-11-16T02:30:22.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.983+0000 7f7e2926e640 1 -- 172.21.15.28:0/3606072146 learned_addr learned my addr 172.21.15.28:0/3606072146 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:22.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.983+0000 7f7e29a6f640 1 --2- 172.21.15.28:0/3606072146 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7e10004d10 0x7f7e2414b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.983+0000 7f7e2926e640 1 -- 172.21.15.28:0/3606072146 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7e10004d10 msgr2=0x7f7e2414b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:22.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.983+0000 7f7e2926e640 1 --2- 172.21.15.28:0/3606072146 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7e10004d10 0x7f7e2414b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.983+0000 7f7e2926e640 1 -- 172.21.15.28:0/3606072146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e2413e150 msgr2=0x7f7e2413e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:22.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.983+0000 7f7e2926e640 1 --2- 172.21.15.28:0/3606072146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e2413e150 0x7f7e2413e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:22.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.983+0000 7f7e2926e640 1 -- 172.21.15.28:0/3606072146 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2414a7e0 con 0x7f7e2414c130 2023-11-16T02:30:22.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.983+0000 7f7e2926e640 1 --2- 172.21.15.28:0/3606072146 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7e2414c130 0x7f7e2414c590 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7e14001ec0 tx=0x7f7e1400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:22.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.983+0000 7f7e1a7fc640 1 -- 172.21.15.28:0/3606072146 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1400c850 con 0x7f7e2414c130 2023-11-16T02:30:22.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.983+0000 7f7e1a7fc640 1 -- 172.21.15.28:0/3606072146 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1400c9b0 con 0x7f7e2414c130 2023-11-16T02:30:22.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.983+0000 7f7e2bcd3640 1 -- 172.21.15.28:0/3606072146 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e2414aac0 con 0x7f7e2414c130 2023-11-16T02:30:22.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.983+0000 7f7e1a7fc640 1 -- 172.21.15.28:0/3606072146 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1400cd60 con 0x7f7e2414c130 2023-11-16T02:30:22.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.983+0000 7f7e2bcd3640 1 -- 172.21.15.28:0/3606072146 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2413eb10 con 0x7f7e2414c130 2023-11-16T02:30:22.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.983+0000 7f7e2bcd3640 1 -- 172.21.15.28:0/3606072146 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2414a640 con 0x7f7e2414c130 2023-11-16T02:30:22.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.987+0000 7f7e1a7fc640 1 -- 172.21.15.28:0/3606072146 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7e14013420 con 0x7f7e2414c130 2023-11-16T02:30:22.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.987+0000 7f7e1a7fc640 1 --2- 172.21.15.28:0/3606072146 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f7e08065a90 0x7f7e08067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:22.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.987+0000 7f7e1a7fc640 1 -- 172.21.15.28:0/3606072146 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e14082e10 con 0x7f7e2414c130 2023-11-16T02:30:22.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.987+0000 7f7e29a6f640 1 --2- 172.21.15.28:0/3606072146 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f7e08065a90 0x7f7e08067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:22.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.987+0000 7f7e29a6f640 1 --2- 172.21.15.28:0/3606072146 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f7e08065a90 0x7f7e08067f50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7e20009a30 tx=0x7f7e20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:22.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:22.991+0000 7f7e1a7fc640 1 -- 172.21.15.28:0/3606072146 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f7e2414a640 con 0x7f7e2414c130 2023-11-16T02:30:23.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.135+0000 7f7e2bcd3640 1 -- 172.21.15.28:0/3606072146 --> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7e240b5d00 con 0x7f7e08065a90 2023-11-16T02:30:23.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.147+0000 7f7e1a7fc640 1 -- 172.21.15.28:0/3606072146 <== mgr.4104 v2:172.21.15.28:6832/38651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+263353 (secure 0 0 0) 0x7f7e20013a20 con 0x7f7e08065a90 2023-11-16T02:30:23.152 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:30:23.155 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-11-16T02:30:23.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.151+0000 7f7e2bcd3640 1 -- 172.21.15.28:0/3606072146 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f7e08065a90 msgr2=0x7f7e08067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:23.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.151+0000 7f7e2bcd3640 1 --2- 172.21.15.28:0/3606072146 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f7e08065a90 0x7f7e08067f50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7e20009a30 tx=0x7f7e20008040 comp rx=0 tx=0).stop 2023-11-16T02:30:23.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.151+0000 7f7e2bcd3640 1 -- 172.21.15.28:0/3606072146 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7e2414c130 msgr2=0x7f7e2414c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:23.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.151+0000 7f7e2bcd3640 1 --2- 172.21.15.28:0/3606072146 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7e2414c130 0x7f7e2414c590 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7e14001ec0 tx=0x7f7e1400ed50 comp rx=0 tx=0).stop 2023-11-16T02:30:23.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.151+0000 7f7e2bcd3640 1 -- 172.21.15.28:0/3606072146 shutdown_connections 2023-11-16T02:30:23.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.151+0000 7f7e2bcd3640 1 --2- 172.21.15.28:0/3606072146 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f7e08065a90 0x7f7e08067f50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:23.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.151+0000 7f7e2bcd3640 1 --2- 172.21.15.28:0/3606072146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e2413e150 0x7f7e2413e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:23.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.151+0000 7f7e2bcd3640 1 --2- 172.21.15.28:0/3606072146 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7e2414c130 0x7f7e2414c590 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:23.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.151+0000 7f7e2bcd3640 1 --2- 172.21.15.28:0/3606072146 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f7e10004d10 0x7f7e2414b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:23.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.151+0000 7f7e2bcd3640 1 -- 172.21.15.28:0/3606072146 >> 172.21.15.28:0/3606072146 conn(0x7f7e240b9050 msgr2=0x7f7e240b6640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:23.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.151+0000 7f7e2bcd3640 1 -- 172.21.15.28:0/3606072146 shutdown_connections 2023-11-16T02:30:23.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.151+0000 7f7e2bcd3640 1 -- 172.21.15.28:0/3606072146 wait complete. 2023-11-16T02:30:23.171 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-11-16T02:30:22.428531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":200,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":178,"acting":178,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252248,"kb_used_data":3864,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754722472,"statfs":{"total":773094113280,"available":772835811328,"internally_reserved":0,"allocated":3956736,"data_stored":2209228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":60,"apply_latency_ms":60,"commit_latency_ns":60000000,"apply_latency_ns":60000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.002315"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.884818+0000","last_change":"2023-11-16T02:30:19.870271+0000","last_active":"2023-11-16T02:30:19.884818+0000","last_peered":"2023-11-16T02:30:19.884818+0000","last_clean":"2023-11-16T02:30:19.884818+0000","last_became_active":"2023-11-16T02:30:19.869530+0000","last_became_peered":"2023-11-16T02:30:19.869530+0000","last_unstale":"2023-11-16T02:30:19.884818+0000","last_undegraded":"2023-11-16T02:30:19.884818+0000","last_fullsized":"2023-11-16T02:30:19.884818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:34:33.419560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.851719+0000","last_change":"2023-11-16T02:30:19.847500+0000","last_active":"2023-11-16T02:30:19.851719+0000","last_peered":"2023-11-16T02:30:19.851719+0000","last_clean":"2023-11-16T02:30:19.851719+0000","last_became_active":"2023-11-16T02:30:19.847125+0000","last_became_peered":"2023-11-16T02:30:19.847125+0000","last_unstale":"2023-11-16T02:30:19.851719+0000","last_undegraded":"2023-11-16T02:30:19.851719+0000","last_fullsized":"2023-11-16T02:30:19.851719+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:04:02.319109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878367+0000","last_change":"2023-11-16T02:30:19.866614+0000","last_active":"2023-11-16T02:30:19.878367+0000","last_peered":"2023-11-16T02:30:19.878367+0000","last_clean":"2023-11-16T02:30:19.878367+0000","last_became_active":"2023-11-16T02:30:19.865850+0000","last_became_peered":"2023-11-16T02:30:19.865850+0000","last_unstale":"2023-11-16T02:30:19.878367+0000","last_undegraded":"2023-11-16T02:30:19.878367+0000","last_fullsized":"2023-11-16T02:30:19.878367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:26:35.043805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.883440+0000","last_change":"2023-11-16T02:30:19.882299+0000","last_active":"2023-11-16T02:30:19.883440+0000","last_peered":"2023-11-16T02:30:19.883440+0000","last_clean":"2023-11-16T02:30:19.883440+0000","last_became_active":"2023-11-16T02:30:19.882012+0000","last_became_peered":"2023-11-16T02:30:19.882012+0000","last_unstale":"2023-11-16T02:30:19.883440+0000","last_undegraded":"2023-11-16T02:30:19.883440+0000","last_fullsized":"2023-11-16T02:30:19.883440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:05:48.808451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.873934+0000","last_change":"2023-11-16T02:30:19.873025+0000","last_active":"2023-11-16T02:30:19.873934+0000","last_peered":"2023-11-16T02:30:19.873934+0000","last_clean":"2023-11-16T02:30:19.873934+0000","last_became_active":"2023-11-16T02:30:19.872781+0000","last_became_peered":"2023-11-16T02:30:19.872781+0000","last_unstale":"2023-11-16T02:30:19.873934+0000","last_undegraded":"2023-11-16T02:30:19.873934+0000","last_fullsized":"2023-11-16T02:30:19.873934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:19:10.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893391+0000","last_change":"2023-11-16T02:30:19.886324+0000","last_active":"2023-11-16T02:30:19.893391+0000","last_peered":"2023-11-16T02:30:19.893391+0000","last_clean":"2023-11-16T02:30:19.893391+0000","last_became_active":"2023-11-16T02:30:19.885725+0000","last_became_peered":"2023-11-16T02:30:19.885725+0000","last_unstale":"2023-11-16T02:30:19.893391+0000","last_undegraded":"2023-11-16T02:30:19.893391+0000","last_fullsized":"2023-11-16T02:30:19.893391+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:29:41.914615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.890750+0000","last_change":"2023-11-16T02:30:19.874493+0000","last_active":"2023-11-16T02:30:19.890750+0000","last_peered":"2023-11-16T02:30:19.890750+0000","last_clean":"2023-11-16T02:30:19.890750+0000","last_became_active":"2023-11-16T02:30:19.872914+0000","last_became_peered":"2023-11-16T02:30:19.872914+0000","last_unstale":"2023-11-16T02:30:19.890750+0000","last_undegraded":"2023-11-16T02:30:19.890750+0000","last_fullsized":"2023-11-16T02:30:19.890750+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:58:23.597351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.876394+0000","last_change":"2023-11-16T02:30:19.846299+0000","last_active":"2023-11-16T02:30:19.876394+0000","last_peered":"2023-11-16T02:30:19.876394+0000","last_clean":"2023-11-16T02:30:19.876394+0000","last_became_active":"2023-11-16T02:30:19.845561+0000","last_became_peered":"2023-11-16T02:30:19.845561+0000","last_unstale":"2023-11-16T02:30:19.876394+0000","last_undegraded":"2023-11-16T02:30:19.876394+0000","last_fullsized":"2023-11-16T02:30:19.876394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:24:43.125348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.848786+0000","last_change":"2023-11-16T02:30:19.843307+0000","last_active":"2023-11-16T02:30:19.848786+0000","last_peered":"2023-11-16T02:30:19.848786+0000","last_clean":"2023-11-16T02:30:19.848786+0000","last_became_active":"2023-11-16T02:30:19.842948+0000","last_became_peered":"2023-11-16T02:30:19.842948+0000","last_unstale":"2023-11-16T02:30:19.848786+0000","last_undegraded":"2023-11-16T02:30:19.848786+0000","last_fullsized":"2023-11-16T02:30:19.848786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:51:01.130415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893290+0000","last_change":"2023-11-16T02:30:19.884857+0000","last_active":"2023-11-16T02:30:19.893290+0000","last_peered":"2023-11-16T02:30:19.893290+0000","last_clean":"2023-11-16T02:30:19.893290+0000","last_became_active":"2023-11-16T02:30:19.884211+0000","last_became_peered":"2023-11-16T02:30:19.884211+0000","last_unstale":"2023-11-16T02:30:19.893290+0000","last_undegraded":"2023-11-16T02:30:19.893290+0000","last_fullsized":"2023-11-16T02:30:19.893290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:26:35.043805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.883207+0000","last_change":"2023-11-16T02:30:19.873333+0000","last_active":"2023-11-16T02:30:19.883207+0000","last_peered":"2023-11-16T02:30:19.883207+0000","last_clean":"2023-11-16T02:30:19.883207+0000","last_became_active":"2023-11-16T02:30:19.872312+0000","last_became_peered":"2023-11-16T02:30:19.872312+0000","last_unstale":"2023-11-16T02:30:19.883207+0000","last_undegraded":"2023-11-16T02:30:19.883207+0000","last_fullsized":"2023-11-16T02:30:19.883207+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:01:25.904236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.851670+0000","last_change":"2023-11-16T02:30:19.847259+0000","last_active":"2023-11-16T02:30:19.851670+0000","last_peered":"2023-11-16T02:30:19.851670+0000","last_clean":"2023-11-16T02:30:19.851670+0000","last_became_active":"2023-11-16T02:30:19.846960+0000","last_became_peered":"2023-11-16T02:30:19.846960+0000","last_unstale":"2023-11-16T02:30:19.851670+0000","last_undegraded":"2023-11-16T02:30:19.851670+0000","last_fullsized":"2023-11-16T02:30:19.851670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T09:23:18.109208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878474+0000","last_change":"2023-11-16T02:30:19.866095+0000","last_active":"2023-11-16T02:30:19.878474+0000","last_peered":"2023-11-16T02:30:19.878474+0000","last_clean":"2023-11-16T02:30:19.878474+0000","last_became_active":"2023-11-16T02:30:19.865309+0000","last_became_peered":"2023-11-16T02:30:19.865309+0000","last_unstale":"2023-11-16T02:30:19.878474+0000","last_undegraded":"2023-11-16T02:30:19.878474+0000","last_fullsized":"2023-11-16T02:30:19.878474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:05:48.808451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.890791+0000","last_change":"2023-11-16T02:30:19.874960+0000","last_active":"2023-11-16T02:30:19.890791+0000","last_peered":"2023-11-16T02:30:19.890791+0000","last_clean":"2023-11-16T02:30:19.890791+0000","last_became_active":"2023-11-16T02:30:19.873799+0000","last_became_peered":"2023-11-16T02:30:19.873799+0000","last_unstale":"2023-11-16T02:30:19.890791+0000","last_undegraded":"2023-11-16T02:30:19.890791+0000","last_fullsized":"2023-11-16T02:30:19.890791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:25:44.847232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893326+0000","last_change":"2023-11-16T02:30:19.885005+0000","last_active":"2023-11-16T02:30:19.893326+0000","last_peered":"2023-11-16T02:30:19.893326+0000","last_clean":"2023-11-16T02:30:19.893326+0000","last_became_active":"2023-11-16T02:30:19.884513+0000","last_became_peered":"2023-11-16T02:30:19.884513+0000","last_unstale":"2023-11-16T02:30:19.893326+0000","last_undegraded":"2023-11-16T02:30:19.893326+0000","last_fullsized":"2023-11-16T02:30:19.893326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:23:28.656034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.850304+0000","last_change":"2023-11-16T02:30:19.840626+0000","last_active":"2023-11-16T02:30:19.850304+0000","last_peered":"2023-11-16T02:30:19.850304+0000","last_clean":"2023-11-16T02:30:19.850304+0000","last_became_active":"2023-11-16T02:30:19.840345+0000","last_became_peered":"2023-11-16T02:30:19.840345+0000","last_unstale":"2023-11-16T02:30:19.850304+0000","last_undegraded":"2023-11-16T02:30:19.850304+0000","last_fullsized":"2023-11-16T02:30:19.850304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:23:28.656034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.851576+0000","last_change":"2023-11-16T02:30:19.845327+0000","last_active":"2023-11-16T02:30:19.851576+0000","last_peered":"2023-11-16T02:30:19.851576+0000","last_clean":"2023-11-16T02:30:19.851576+0000","last_became_active":"2023-11-16T02:30:19.845068+0000","last_became_peered":"2023-11-16T02:30:19.845068+0000","last_unstale":"2023-11-16T02:30:19.851576+0000","last_undegraded":"2023-11-16T02:30:19.851576+0000","last_fullsized":"2023-11-16T02:30:19.851576+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:58:23.597351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.890272+0000","last_change":"2023-11-16T02:30:19.879907+0000","last_active":"2023-11-16T02:30:19.890272+0000","last_peered":"2023-11-16T02:30:19.890272+0000","last_clean":"2023-11-16T02:30:19.890272+0000","last_became_active":"2023-11-16T02:30:19.878794+0000","last_became_peered":"2023-11-16T02:30:19.878794+0000","last_unstale":"2023-11-16T02:30:19.890272+0000","last_undegraded":"2023-11-16T02:30:19.890272+0000","last_fullsized":"2023-11-16T02:30:19.890272+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:05:25.212455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.884390+0000","last_change":"2023-11-16T02:30:19.867043+0000","last_active":"2023-11-16T02:30:19.884390+0000","last_peered":"2023-11-16T02:30:19.884390+0000","last_clean":"2023-11-16T02:30:19.884390+0000","last_became_active":"2023-11-16T02:30:19.866232+0000","last_became_peered":"2023-11-16T02:30:19.866232+0000","last_unstale":"2023-11-16T02:30:19.884390+0000","last_undegraded":"2023-11-16T02:30:19.884390+0000","last_fullsized":"2023-11-16T02:30:19.884390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:51:01.130415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.877328+0000","last_change":"2023-11-16T02:30:19.875797+0000","last_active":"2023-11-16T02:30:19.877328+0000","last_peered":"2023-11-16T02:30:19.877328+0000","last_clean":"2023-11-16T02:30:19.877328+0000","last_became_active":"2023-11-16T02:30:19.875422+0000","last_became_peered":"2023-11-16T02:30:19.875422+0000","last_unstale":"2023-11-16T02:30:19.877328+0000","last_undegraded":"2023-11-16T02:30:19.877328+0000","last_fullsized":"2023-11-16T02:30:19.877328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:51:01.130415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878399+0000","last_change":"2023-11-16T02:30:19.867144+0000","last_active":"2023-11-16T02:30:19.878399+0000","last_peered":"2023-11-16T02:30:19.878399+0000","last_clean":"2023-11-16T02:30:19.878399+0000","last_became_active":"2023-11-16T02:30:19.865272+0000","last_became_peered":"2023-11-16T02:30:19.865272+0000","last_unstale":"2023-11-16T02:30:19.878399+0000","last_undegraded":"2023-11-16T02:30:19.878399+0000","last_fullsized":"2023-11-16T02:30:19.878399+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:53:26.356470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.873118+0000","last_change":"2023-11-16T02:30:19.872380+0000","last_active":"2023-11-16T02:30:19.873118+0000","last_peered":"2023-11-16T02:30:19.873118+0000","last_clean":"2023-11-16T02:30:19.873118+0000","last_became_active":"2023-11-16T02:30:19.872131+0000","last_became_peered":"2023-11-16T02:30:19.872131+0000","last_unstale":"2023-11-16T02:30:19.873118+0000","last_undegraded":"2023-11-16T02:30:19.873118+0000","last_fullsized":"2023-11-16T02:30:19.873118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:14:02.468285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.873930+0000","last_change":"2023-11-16T02:30:19.873009+0000","last_active":"2023-11-16T02:30:19.873930+0000","last_peered":"2023-11-16T02:30:19.873930+0000","last_clean":"2023-11-16T02:30:19.873930+0000","last_became_active":"2023-11-16T02:30:19.872718+0000","last_became_peered":"2023-11-16T02:30:19.872718+0000","last_unstale":"2023-11-16T02:30:19.873930+0000","last_undegraded":"2023-11-16T02:30:19.873930+0000","last_fullsized":"2023-11-16T02:30:19.873930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:57:16.626801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878500+0000","last_change":"2023-11-16T02:30:19.877492+0000","last_active":"2023-11-16T02:30:19.878500+0000","last_peered":"2023-11-16T02:30:19.878500+0000","last_clean":"2023-11-16T02:30:19.878500+0000","last_became_active":"2023-11-16T02:30:19.877055+0000","last_became_peered":"2023-11-16T02:30:19.877055+0000","last_unstale":"2023-11-16T02:30:19.878500+0000","last_undegraded":"2023-11-16T02:30:19.878500+0000","last_fullsized":"2023-11-16T02:30:19.878500+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:30:57.683829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.883250+0000","last_change":"2023-11-16T02:30:19.873823+0000","last_active":"2023-11-16T02:30:19.883250+0000","last_peered":"2023-11-16T02:30:19.883250+0000","last_clean":"2023-11-16T02:30:19.883250+0000","last_became_active":"2023-11-16T02:30:19.873097+0000","last_became_peered":"2023-11-16T02:30:19.873097+0000","last_unstale":"2023-11-16T02:30:19.883250+0000","last_undegraded":"2023-11-16T02:30:19.883250+0000","last_fullsized":"2023-11-16T02:30:19.883250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:11:01.176911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.890230+0000","last_change":"2023-11-16T02:30:19.879438+0000","last_active":"2023-11-16T02:30:19.890230+0000","last_peered":"2023-11-16T02:30:19.890230+0000","last_clean":"2023-11-16T02:30:19.890230+0000","last_became_active":"2023-11-16T02:30:19.878067+0000","last_became_peered":"2023-11-16T02:30:19.878067+0000","last_unstale":"2023-11-16T02:30:19.890230+0000","last_undegraded":"2023-11-16T02:30:19.890230+0000","last_fullsized":"2023-11-16T02:30:19.890230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:53:26.356470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893346+0000","last_change":"2023-11-16T02:30:19.885674+0000","last_active":"2023-11-16T02:30:19.893346+0000","last_peered":"2023-11-16T02:30:19.893346+0000","last_clean":"2023-11-16T02:30:19.893346+0000","last_became_active":"2023-11-16T02:30:19.884062+0000","last_became_peered":"2023-11-16T02:30:19.884062+0000","last_unstale":"2023-11-16T02:30:19.893346+0000","last_undegraded":"2023-11-16T02:30:19.893346+0000","last_fullsized":"2023-11-16T02:30:19.893346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:59:15.040356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.872486+0000","last_change":"2023-11-16T02:30:19.859781+0000","last_active":"2023-11-16T02:30:19.872486+0000","last_peered":"2023-11-16T02:30:19.872486+0000","last_clean":"2023-11-16T02:30:19.872486+0000","last_became_active":"2023-11-16T02:30:19.857455+0000","last_became_peered":"2023-11-16T02:30:19.857455+0000","last_unstale":"2023-11-16T02:30:19.872486+0000","last_undegraded":"2023-11-16T02:30:19.872486+0000","last_fullsized":"2023-11-16T02:30:19.872486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:17:17.336842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893099+0000","last_change":"2023-11-16T02:30:19.880769+0000","last_active":"2023-11-16T02:30:19.893099+0000","last_peered":"2023-11-16T02:30:19.893099+0000","last_clean":"2023-11-16T02:30:19.893099+0000","last_became_active":"2023-11-16T02:30:19.878925+0000","last_became_peered":"2023-11-16T02:30:19.878925+0000","last_unstale":"2023-11-16T02:30:19.893099+0000","last_undegraded":"2023-11-16T02:30:19.893099+0000","last_fullsized":"2023-11-16T02:30:19.893099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:57:16.626801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.877326+0000","last_change":"2023-11-16T02:30:19.875765+0000","last_active":"2023-11-16T02:30:19.877326+0000","last_peered":"2023-11-16T02:30:19.877326+0000","last_clean":"2023-11-16T02:30:19.877326+0000","last_became_active":"2023-11-16T02:30:19.875438+0000","last_became_peered":"2023-11-16T02:30:19.875438+0000","last_unstale":"2023-11-16T02:30:19.877326+0000","last_undegraded":"2023-11-16T02:30:19.877326+0000","last_fullsized":"2023-11-16T02:30:19.877326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:53:26.356470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.884630+0000","last_change":"2023-11-16T02:30:19.484973+0000","last_active":"2023-11-16T02:30:19.884630+0000","last_peered":"2023-11-16T02:30:19.884630+0000","last_clean":"2023-11-16T02:30:19.884630+0000","last_became_active":"2023-11-16T02:30:19.484403+0000","last_became_peered":"2023-11-16T02:30:19.484403+0000","last_unstale":"2023-11-16T02:30:19.884630+0000","last_undegraded":"2023-11-16T02:30:19.884630+0000","last_fullsized":"2023-11-16T02:30:19.884630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:30:11.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.891352+0000","last_change":"2023-11-16T02:30:19.886424+0000","last_active":"2023-11-16T02:30:19.891352+0000","last_peered":"2023-11-16T02:30:19.891352+0000","last_clean":"2023-11-16T02:30:19.891352+0000","last_became_active":"2023-11-16T02:30:19.885778+0000","last_became_peered":"2023-11-16T02:30:19.885778+0000","last_unstale":"2023-11-16T02:30:19.891352+0000","last_undegraded":"2023-11-16T02:30:19.891352+0000","last_fullsized":"2023-11-16T02:30:19.891352+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:26:16.324058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.875204+0000","last_change":"2023-11-16T02:30:19.467799+0000","last_active":"2023-11-16T02:30:19.875204+0000","last_peered":"2023-11-16T02:30:19.875204+0000","last_clean":"2023-11-16T02:30:19.875204+0000","last_became_active":"2023-11-16T02:30:19.467517+0000","last_became_peered":"2023-11-16T02:30:19.467517+0000","last_unstale":"2023-11-16T02:30:19.875204+0000","last_undegraded":"2023-11-16T02:30:19.875204+0000","last_fullsized":"2023-11-16T02:30:19.875204+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:53:29.543335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.884546+0000","last_change":"2023-11-16T02:30:19.865354+0000","last_active":"2023-11-16T02:30:19.884546+0000","last_peered":"2023-11-16T02:30:19.884546+0000","last_clean":"2023-11-16T02:30:19.884546+0000","last_became_active":"2023-11-16T02:30:19.864635+0000","last_became_peered":"2023-11-16T02:30:19.864635+0000","last_unstale":"2023-11-16T02:30:19.884546+0000","last_undegraded":"2023-11-16T02:30:19.884546+0000","last_fullsized":"2023-11-16T02:30:19.884546+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T09:30:55.572569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.857320+0000","last_change":"2023-11-16T02:30:19.463569+0000","last_active":"2023-11-16T02:30:19.857320+0000","last_peered":"2023-11-16T02:30:19.857320+0000","last_clean":"2023-11-16T02:30:19.857320+0000","last_became_active":"2023-11-16T02:30:19.463298+0000","last_became_peered":"2023-11-16T02:30:19.463298+0000","last_unstale":"2023-11-16T02:30:19.857320+0000","last_undegraded":"2023-11-16T02:30:19.857320+0000","last_fullsized":"2023-11-16T02:30:19.857320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:26:15.319244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878131+0000","last_change":"2023-11-16T02:30:19.876755+0000","last_active":"2023-11-16T02:30:19.878131+0000","last_peered":"2023-11-16T02:30:19.878131+0000","last_clean":"2023-11-16T02:30:19.878131+0000","last_became_active":"2023-11-16T02:30:19.876454+0000","last_became_peered":"2023-11-16T02:30:19.876454+0000","last_unstale":"2023-11-16T02:30:19.878131+0000","last_undegraded":"2023-11-16T02:30:19.878131+0000","last_fullsized":"2023-11-16T02:30:19.878131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T09:30:55.572569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-16T02:30:18.431898+0000","last_change":"2023-11-16T02:30:18.431898+0000","last_active":"2023-11-16T02:30:18.421000+0000","last_peered":"2023-11-16T02:30:18.421000+0000","last_clean":"2023-11-16T02:30:18.421000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:18.431898+0000","last_undegraded":"2023-11-16T02:30:18.431898+0000","last_fullsized":"2023-11-16T02:30:18.431898+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:15:52.039420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893400+0000","last_change":"2023-11-16T02:30:19.887577+0000","last_active":"2023-11-16T02:30:19.893400+0000","last_peered":"2023-11-16T02:30:19.893400+0000","last_clean":"2023-11-16T02:30:19.893400+0000","last_became_active":"2023-11-16T02:30:19.886948+0000","last_became_peered":"2023-11-16T02:30:19.886948+0000","last_unstale":"2023-11-16T02:30:19.893400+0000","last_undegraded":"2023-11-16T02:30:19.893400+0000","last_fullsized":"2023-11-16T02:30:19.893400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:11:01.176911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.877547+0000","last_change":"2023-11-16T02:30:19.461227+0000","last_active":"2023-11-16T02:30:19.877547+0000","last_peered":"2023-11-16T02:30:19.877547+0000","last_clean":"2023-11-16T02:30:19.877547+0000","last_became_active":"2023-11-16T02:30:19.460450+0000","last_became_peered":"2023-11-16T02:30:19.460450+0000","last_unstale":"2023-11-16T02:30:19.877547+0000","last_undegraded":"2023-11-16T02:30:19.877547+0000","last_fullsized":"2023-11-16T02:30:19.877547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:07:18.071597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878430+0000","last_change":"2023-11-16T02:30:19.868426+0000","last_active":"2023-11-16T02:30:19.878430+0000","last_peered":"2023-11-16T02:30:19.878430+0000","last_clean":"2023-11-16T02:30:19.878430+0000","last_became_active":"2023-11-16T02:30:19.866177+0000","last_became_peered":"2023-11-16T02:30:19.866177+0000","last_unstale":"2023-11-16T02:30:19.878430+0000","last_undegraded":"2023-11-16T02:30:19.878430+0000","last_fullsized":"2023-11-16T02:30:19.878430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:14:02.468285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.876474+0000","last_change":"2023-11-16T02:30:19.461149+0000","last_active":"2023-11-16T02:30:19.876474+0000","last_peered":"2023-11-16T02:30:19.876474+0000","last_clean":"2023-11-16T02:30:19.876474+0000","last_became_active":"2023-11-16T02:30:19.460646+0000","last_became_peered":"2023-11-16T02:30:19.460646+0000","last_unstale":"2023-11-16T02:30:19.876474+0000","last_undegraded":"2023-11-16T02:30:19.876474+0000","last_fullsized":"2023-11-16T02:30:19.876474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:08:35.892877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.890191+0000","last_change":"2023-11-16T02:30:19.878750+0000","last_active":"2023-11-16T02:30:19.890191+0000","last_peered":"2023-11-16T02:30:19.890191+0000","last_clean":"2023-11-16T02:30:19.890191+0000","last_became_active":"2023-11-16T02:30:19.878234+0000","last_became_peered":"2023-11-16T02:30:19.878234+0000","last_unstale":"2023-11-16T02:30:19.890191+0000","last_undegraded":"2023-11-16T02:30:19.890191+0000","last_fullsized":"2023-11-16T02:30:19.890191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:11:46.387664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.835183+0000","last_change":"2023-11-16T02:30:19.469556+0000","last_active":"2023-11-16T02:30:19.835183+0000","last_peered":"2023-11-16T02:30:19.835183+0000","last_clean":"2023-11-16T02:30:19.835183+0000","last_became_active":"2023-11-16T02:30:19.468872+0000","last_became_peered":"2023-11-16T02:30:19.468872+0000","last_unstale":"2023-11-16T02:30:19.835183+0000","last_undegraded":"2023-11-16T02:30:19.835183+0000","last_fullsized":"2023-11-16T02:30:19.835183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:11:45.382850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.871173+0000","last_change":"2023-11-16T02:30:19.869582+0000","last_active":"2023-11-16T02:30:19.871173+0000","last_peered":"2023-11-16T02:30:19.871173+0000","last_clean":"2023-11-16T02:30:19.871173+0000","last_became_active":"2023-11-16T02:30:19.869254+0000","last_became_peered":"2023-11-16T02:30:19.869254+0000","last_unstale":"2023-11-16T02:30:19.871173+0000","last_undegraded":"2023-11-16T02:30:19.871173+0000","last_fullsized":"2023-11-16T02:30:19.871173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:26:35.043805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.834349+0000","last_change":"2023-11-16T02:30:19.466145+0000","last_active":"2023-11-16T02:30:19.834349+0000","last_peered":"2023-11-16T02:30:19.834349+0000","last_clean":"2023-11-16T02:30:19.834349+0000","last_became_active":"2023-11-16T02:30:19.465726+0000","last_became_peered":"2023-11-16T02:30:19.465726+0000","last_unstale":"2023-11-16T02:30:19.834349+0000","last_undegraded":"2023-11-16T02:30:19.834349+0000","last_fullsized":"2023-11-16T02:30:19.834349+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:23:32.728712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878486+0000","last_change":"2023-11-16T02:30:19.867919+0000","last_active":"2023-11-16T02:30:19.878486+0000","last_peered":"2023-11-16T02:30:19.878486+0000","last_clean":"2023-11-16T02:30:19.878486+0000","last_became_active":"2023-11-16T02:30:19.867061+0000","last_became_peered":"2023-11-16T02:30:19.867061+0000","last_unstale":"2023-11-16T02:30:19.878486+0000","last_undegraded":"2023-11-16T02:30:19.878486+0000","last_fullsized":"2023-11-16T02:30:19.878486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:30:57.683829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.836643+0000","last_change":"2023-11-16T02:30:19.472891+0000","last_active":"2023-11-16T02:30:19.836643+0000","last_peered":"2023-11-16T02:30:19.836643+0000","last_clean":"2023-11-16T02:30:19.836643+0000","last_became_active":"2023-11-16T02:30:19.472450+0000","last_became_peered":"2023-11-16T02:30:19.472450+0000","last_unstale":"2023-11-16T02:30:19.836643+0000","last_undegraded":"2023-11-16T02:30:19.836643+0000","last_fullsized":"2023-11-16T02:30:19.836643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:34:32.414746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.848452+0000","last_change":"2023-11-16T02:30:19.840186+0000","last_active":"2023-11-16T02:30:19.848452+0000","last_peered":"2023-11-16T02:30:19.848452+0000","last_clean":"2023-11-16T02:30:19.848452+0000","last_became_active":"2023-11-16T02:30:19.839901+0000","last_became_peered":"2023-11-16T02:30:19.839901+0000","last_unstale":"2023-11-16T02:30:19.848452+0000","last_undegraded":"2023-11-16T02:30:19.848452+0000","last_fullsized":"2023-11-16T02:30:19.848452+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:00:28.306611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.829875+0000","last_change":"2023-11-16T02:30:19.467692+0000","last_active":"2023-11-16T02:30:19.829875+0000","last_peered":"2023-11-16T02:30:19.829875+0000","last_clean":"2023-11-16T02:30:19.829875+0000","last_became_active":"2023-11-16T02:30:19.467180+0000","last_became_peered":"2023-11-16T02:30:19.467180+0000","last_unstale":"2023-11-16T02:30:19.829875+0000","last_undegraded":"2023-11-16T02:30:19.829875+0000","last_fullsized":"2023-11-16T02:30:19.829875+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:02:05.395662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878009+0000","last_change":"2023-11-16T02:30:19.877297+0000","last_active":"2023-11-16T02:30:19.878009+0000","last_peered":"2023-11-16T02:30:19.878009+0000","last_clean":"2023-11-16T02:30:19.878009+0000","last_became_active":"2023-11-16T02:30:19.876717+0000","last_became_peered":"2023-11-16T02:30:19.876717+0000","last_unstale":"2023-11-16T02:30:19.878009+0000","last_undegraded":"2023-11-16T02:30:19.878009+0000","last_fullsized":"2023-11-16T02:30:19.878009+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:00:21.607056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.888776+0000","last_change":"2023-11-16T02:30:19.482605+0000","last_active":"2023-11-16T02:30:19.888776+0000","last_peered":"2023-11-16T02:30:19.888776+0000","last_clean":"2023-11-16T02:30:19.888776+0000","last_became_active":"2023-11-16T02:30:19.481717+0000","last_became_peered":"2023-11-16T02:30:19.481717+0000","last_unstale":"2023-11-16T02:30:19.888776+0000","last_undegraded":"2023-11-16T02:30:19.888776+0000","last_fullsized":"2023-11-16T02:30:19.888776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:27:42.254533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878420+0000","last_change":"2023-11-16T02:30:19.868734+0000","last_active":"2023-11-16T02:30:19.878420+0000","last_peered":"2023-11-16T02:30:19.878420+0000","last_clean":"2023-11-16T02:30:19.878420+0000","last_became_active":"2023-11-16T02:30:19.868028+0000","last_became_peered":"2023-11-16T02:30:19.868028+0000","last_unstale":"2023-11-16T02:30:19.878420+0000","last_undegraded":"2023-11-16T02:30:19.878420+0000","last_fullsized":"2023-11-16T02:30:19.878420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:29:41.914615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.880000+0000","last_change":"2023-11-16T02:30:19.465379+0000","last_active":"2023-11-16T02:30:19.880000+0000","last_peered":"2023-11-16T02:30:19.880000+0000","last_clean":"2023-11-16T02:30:19.880000+0000","last_became_active":"2023-11-16T02:30:19.464674+0000","last_became_peered":"2023-11-16T02:30:19.464674+0000","last_unstale":"2023-11-16T02:30:19.880000+0000","last_undegraded":"2023-11-16T02:30:19.880000+0000","last_fullsized":"2023-11-16T02:30:19.880000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:33:12.505379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.883395+0000","last_change":"2023-11-16T02:30:19.882010+0000","last_active":"2023-11-16T02:30:19.883395+0000","last_peered":"2023-11-16T02:30:19.883395+0000","last_clean":"2023-11-16T02:30:19.883395+0000","last_became_active":"2023-11-16T02:30:19.881685+0000","last_became_peered":"2023-11-16T02:30:19.881685+0000","last_unstale":"2023-11-16T02:30:19.883395+0000","last_undegraded":"2023-11-16T02:30:19.883395+0000","last_fullsized":"2023-11-16T02:30:19.883395+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:11:01.176911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.885297+0000","last_change":"2023-11-16T02:30:19.467910+0000","last_active":"2023-11-16T02:30:19.885297+0000","last_peered":"2023-11-16T02:30:19.885297+0000","last_clean":"2023-11-16T02:30:19.885297+0000","last_became_active":"2023-11-16T02:30:19.467432+0000","last_became_peered":"2023-11-16T02:30:19.467432+0000","last_unstale":"2023-11-16T02:30:19.885297+0000","last_undegraded":"2023-11-16T02:30:19.885297+0000","last_fullsized":"2023-11-16T02:30:19.885297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:59:51.546762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.850327+0000","last_change":"2023-11-16T02:30:19.840706+0000","last_active":"2023-11-16T02:30:19.850327+0000","last_peered":"2023-11-16T02:30:19.850327+0000","last_clean":"2023-11-16T02:30:19.850327+0000","last_became_active":"2023-11-16T02:30:19.840310+0000","last_became_peered":"2023-11-16T02:30:19.840310+0000","last_unstale":"2023-11-16T02:30:19.850327+0000","last_undegraded":"2023-11-16T02:30:19.850327+0000","last_fullsized":"2023-11-16T02:30:19.850327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:01:25.904236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.835925+0000","last_change":"2023-11-16T02:30:19.467641+0000","last_active":"2023-11-16T02:30:19.835925+0000","last_peered":"2023-11-16T02:30:19.835925+0000","last_clean":"2023-11-16T02:30:19.835925+0000","last_became_active":"2023-11-16T02:30:19.467184+0000","last_became_peered":"2023-11-16T02:30:19.467184+0000","last_unstale":"2023-11-16T02:30:19.835925+0000","last_undegraded":"2023-11-16T02:30:19.835925+0000","last_fullsized":"2023-11-16T02:30:19.835925+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:40:26.674869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893121+0000","last_change":"2023-11-16T02:30:19.881218+0000","last_active":"2023-11-16T02:30:19.893121+0000","last_peered":"2023-11-16T02:30:19.893121+0000","last_clean":"2023-11-16T02:30:19.893121+0000","last_became_active":"2023-11-16T02:30:19.879762+0000","last_became_peered":"2023-11-16T02:30:19.879762+0000","last_unstale":"2023-11-16T02:30:19.893121+0000","last_undegraded":"2023-11-16T02:30:19.893121+0000","last_fullsized":"2023-11-16T02:30:19.893121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:01:25.904236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.835106+0000","last_change":"2023-11-16T02:30:19.472885+0000","last_active":"2023-11-16T02:30:19.835106+0000","last_peered":"2023-11-16T02:30:19.835106+0000","last_clean":"2023-11-16T02:30:19.835106+0000","last_became_active":"2023-11-16T02:30:19.472418+0000","last_became_peered":"2023-11-16T02:30:19.472418+0000","last_unstale":"2023-11-16T02:30:19.835106+0000","last_undegraded":"2023-11-16T02:30:19.835106+0000","last_fullsized":"2023-11-16T02:30:19.835106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:05:24.207641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.891248+0000","last_change":"2023-11-16T02:30:19.880084+0000","last_active":"2023-11-16T02:30:19.891248+0000","last_peered":"2023-11-16T02:30:19.891248+0000","last_clean":"2023-11-16T02:30:19.891248+0000","last_became_active":"2023-11-16T02:30:19.879577+0000","last_became_peered":"2023-11-16T02:30:19.879577+0000","last_unstale":"2023-11-16T02:30:19.891248+0000","last_undegraded":"2023-11-16T02:30:19.891248+0000","last_fullsized":"2023-11-16T02:30:19.891248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:05:25.212455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.858621+0000","last_change":"2023-11-16T02:30:19.459454+0000","last_active":"2023-11-16T02:30:19.858621+0000","last_peered":"2023-11-16T02:30:19.858621+0000","last_clean":"2023-11-16T02:30:19.858621+0000","last_became_active":"2023-11-16T02:30:19.458959+0000","last_became_peered":"2023-11-16T02:30:19.458959+0000","last_unstale":"2023-11-16T02:30:19.858621+0000","last_undegraded":"2023-11-16T02:30:19.858621+0000","last_fullsized":"2023-11-16T02:30:19.858621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:27:42.254533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.890110+0000","last_change":"2023-11-16T02:30:19.877024+0000","last_active":"2023-11-16T02:30:19.890110+0000","last_peered":"2023-11-16T02:30:19.890110+0000","last_clean":"2023-11-16T02:30:19.890110+0000","last_became_active":"2023-11-16T02:30:19.876487+0000","last_became_peered":"2023-11-16T02:30:19.876487+0000","last_unstale":"2023-11-16T02:30:19.890110+0000","last_undegraded":"2023-11-16T02:30:19.890110+0000","last_fullsized":"2023-11-16T02:30:19.890110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:30:57.683829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.852631+0000","last_change":"2023-11-16T02:30:19.461811+0000","last_active":"2023-11-16T02:30:19.852631+0000","last_peered":"2023-11-16T02:30:19.852631+0000","last_clean":"2023-11-16T02:30:19.852631+0000","last_became_active":"2023-11-16T02:30:19.460313+0000","last_became_peered":"2023-11-16T02:30:19.460313+0000","last_unstale":"2023-11-16T02:30:19.852631+0000","last_undegraded":"2023-11-16T02:30:19.852631+0000","last_fullsized":"2023-11-16T02:30:19.852631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:02:05.395662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.887669+0000","last_change":"2023-11-16T02:30:19.885693+0000","last_active":"2023-11-16T02:30:19.887669+0000","last_peered":"2023-11-16T02:30:19.887669+0000","last_clean":"2023-11-16T02:30:19.887669+0000","last_became_active":"2023-11-16T02:30:19.885102+0000","last_became_peered":"2023-11-16T02:30:19.885102+0000","last_unstale":"2023-11-16T02:30:19.887669+0000","last_undegraded":"2023-11-16T02:30:19.887669+0000","last_fullsized":"2023-11-16T02:30:19.887669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:59:15.040356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.877415+0000","last_change":"2023-11-16T02:30:19.477174+0000","last_active":"2023-11-16T02:30:19.877415+0000","last_peered":"2023-11-16T02:30:19.877415+0000","last_clean":"2023-11-16T02:30:19.877415+0000","last_became_active":"2023-11-16T02:30:19.475945+0000","last_became_peered":"2023-11-16T02:30:19.475945+0000","last_unstale":"2023-11-16T02:30:19.877415+0000","last_undegraded":"2023-11-16T02:30:19.877415+0000","last_fullsized":"2023-11-16T02:30:19.877415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:29:26.977995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.883430+0000","last_change":"2023-11-16T02:30:19.882218+0000","last_active":"2023-11-16T02:30:19.883430+0000","last_peered":"2023-11-16T02:30:19.883430+0000","last_clean":"2023-11-16T02:30:19.883430+0000","last_became_active":"2023-11-16T02:30:19.881908+0000","last_became_peered":"2023-11-16T02:30:19.881908+0000","last_unstale":"2023-11-16T02:30:19.883430+0000","last_undegraded":"2023-11-16T02:30:19.883430+0000","last_fullsized":"2023-11-16T02:30:19.883430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:24:43.125348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.876969+0000","last_change":"2023-11-16T02:30:19.470192+0000","last_active":"2023-11-16T02:30:19.876969+0000","last_peered":"2023-11-16T02:30:19.876969+0000","last_clean":"2023-11-16T02:30:19.876969+0000","last_became_active":"2023-11-16T02:30:19.469472+0000","last_became_peered":"2023-11-16T02:30:19.469472+0000","last_unstale":"2023-11-16T02:30:19.876969+0000","last_undegraded":"2023-11-16T02:30:19.876969+0000","last_fullsized":"2023-11-16T02:30:19.876969+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:17:41.856951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.836885+0000","last_change":"2023-11-16T02:30:19.468369+0000","last_active":"2023-11-16T02:30:19.836885+0000","last_peered":"2023-11-16T02:30:19.836885+0000","last_clean":"2023-11-16T02:30:19.836885+0000","last_became_active":"2023-11-16T02:30:19.467924+0000","last_became_peered":"2023-11-16T02:30:19.467924+0000","last_unstale":"2023-11-16T02:30:19.836885+0000","last_undegraded":"2023-11-16T02:30:19.836885+0000","last_fullsized":"2023-11-16T02:30:19.836885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:30:11.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.853040+0000","last_change":"2023-11-16T02:30:19.467061+0000","last_active":"2023-11-16T02:30:19.853040+0000","last_peered":"2023-11-16T02:30:19.853040+0000","last_clean":"2023-11-16T02:30:19.853040+0000","last_became_active":"2023-11-16T02:30:19.466792+0000","last_became_peered":"2023-11-16T02:30:19.466792+0000","last_unstale":"2023-11-16T02:30:19.853040+0000","last_undegraded":"2023-11-16T02:30:19.853040+0000","last_fullsized":"2023-11-16T02:30:19.853040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T02:52:12.747285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.836867+0000","last_change":"2023-11-16T02:30:19.465478+0000","last_active":"2023-11-16T02:30:19.836867+0000","last_peered":"2023-11-16T02:30:19.836867+0000","last_clean":"2023-11-16T02:30:19.836867+0000","last_became_active":"2023-11-16T02:30:19.464658+0000","last_became_peered":"2023-11-16T02:30:19.464658+0000","last_unstale":"2023-11-16T02:30:19.836867+0000","last_undegraded":"2023-11-16T02:30:19.836867+0000","last_fullsized":"2023-11-16T02:30:19.836867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:23:32.728712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.834793+0000","last_change":"2023-11-16T02:30:19.485044+0000","last_active":"2023-11-16T02:30:19.834793+0000","last_peered":"2023-11-16T02:30:19.834793+0000","last_clean":"2023-11-16T02:30:19.834793+0000","last_became_active":"2023-11-16T02:30:19.484575+0000","last_became_peered":"2023-11-16T02:30:19.484575+0000","last_unstale":"2023-11-16T02:30:19.834793+0000","last_undegraded":"2023-11-16T02:30:19.834793+0000","last_fullsized":"2023-11-16T02:30:19.834793+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:48:59.158704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893198+0000","last_change":"2023-11-16T02:30:19.881226+0000","last_active":"2023-11-16T02:30:19.893198+0000","last_peered":"2023-11-16T02:30:19.893198+0000","last_clean":"2023-11-16T02:30:19.893198+0000","last_became_active":"2023-11-16T02:30:19.880563+0000","last_became_peered":"2023-11-16T02:30:19.880563+0000","last_unstale":"2023-11-16T02:30:19.893198+0000","last_undegraded":"2023-11-16T02:30:19.893198+0000","last_fullsized":"2023-11-16T02:30:19.893198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:04:02.319109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.842049+0000","last_change":"2023-11-16T02:30:19.482268+0000","last_active":"2023-11-16T02:30:19.842049+0000","last_peered":"2023-11-16T02:30:19.842049+0000","last_clean":"2023-11-16T02:30:19.842049+0000","last_became_active":"2023-11-16T02:30:19.481547+0000","last_became_peered":"2023-11-16T02:30:19.481547+0000","last_unstale":"2023-11-16T02:30:19.842049+0000","last_undegraded":"2023-11-16T02:30:19.842049+0000","last_fullsized":"2023-11-16T02:30:19.842049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:53:29.543335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.881681+0000","last_change":"2023-11-16T02:30:19.486403+0000","last_active":"2023-11-16T02:30:19.881681+0000","last_peered":"2023-11-16T02:30:19.881681+0000","last_clean":"2023-11-16T02:30:19.881681+0000","last_became_active":"2023-11-16T02:30:19.485982+0000","last_became_peered":"2023-11-16T02:30:19.485982+0000","last_unstale":"2023-11-16T02:30:19.881681+0000","last_undegraded":"2023-11-16T02:30:19.881681+0000","last_fullsized":"2023-11-16T02:30:19.881681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T02:52:12.747285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878779+0000","last_change":"2023-11-16T02:30:19.868154+0000","last_active":"2023-11-16T02:30:19.878779+0000","last_peered":"2023-11-16T02:30:19.878779+0000","last_clean":"2023-11-16T02:30:19.878779+0000","last_became_active":"2023-11-16T02:30:19.867219+0000","last_became_peered":"2023-11-16T02:30:19.867219+0000","last_unstale":"2023-11-16T02:30:19.878779+0000","last_undegraded":"2023-11-16T02:30:19.878779+0000","last_fullsized":"2023-11-16T02:30:19.878779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:04:02.319109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.829792+0000","last_change":"2023-11-16T02:30:19.467493+0000","last_active":"2023-11-16T02:30:19.829792+0000","last_peered":"2023-11-16T02:30:19.829792+0000","last_clean":"2023-11-16T02:30:19.829792+0000","last_became_active":"2023-11-16T02:30:19.466854+0000","last_became_peered":"2023-11-16T02:30:19.466854+0000","last_unstale":"2023-11-16T02:30:19.829792+0000","last_undegraded":"2023-11-16T02:30:19.829792+0000","last_fullsized":"2023-11-16T02:30:19.829792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:40:26.674869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.843656+0000","last_change":"2023-11-16T02:30:19.839272+0000","last_active":"2023-11-16T02:30:19.843656+0000","last_peered":"2023-11-16T02:30:19.843656+0000","last_clean":"2023-11-16T02:30:19.843656+0000","last_became_active":"2023-11-16T02:30:19.838628+0000","last_became_peered":"2023-11-16T02:30:19.838628+0000","last_unstale":"2023-11-16T02:30:19.843656+0000","last_undegraded":"2023-11-16T02:30:19.843656+0000","last_fullsized":"2023-11-16T02:30:19.843656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:34:33.419560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.835792+0000","last_change":"2023-11-16T02:30:19.468928+0000","last_active":"2023-11-16T02:30:19.835792+0000","last_peered":"2023-11-16T02:30:19.835792+0000","last_clean":"2023-11-16T02:30:19.835792+0000","last_became_active":"2023-11-16T02:30:19.468602+0000","last_became_peered":"2023-11-16T02:30:19.468602+0000","last_unstale":"2023-11-16T02:30:19.835792+0000","last_undegraded":"2023-11-16T02:30:19.835792+0000","last_fullsized":"2023-11-16T02:30:19.835792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:30:11.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.871844+0000","last_change":"2023-11-16T02:30:19.859362+0000","last_active":"2023-11-16T02:30:19.871844+0000","last_peered":"2023-11-16T02:30:19.871844+0000","last_clean":"2023-11-16T02:30:19.871844+0000","last_became_active":"2023-11-16T02:30:19.858630+0000","last_became_peered":"2023-11-16T02:30:19.858630+0000","last_unstale":"2023-11-16T02:30:19.871844+0000","last_undegraded":"2023-11-16T02:30:19.871844+0000","last_fullsized":"2023-11-16T02:30:19.871844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:11:46.387664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.829236+0000","last_change":"2023-11-16T02:30:19.482379+0000","last_active":"2023-11-16T02:30:19.829236+0000","last_peered":"2023-11-16T02:30:19.829236+0000","last_clean":"2023-11-16T02:30:19.829236+0000","last_became_active":"2023-11-16T02:30:19.481905+0000","last_became_peered":"2023-11-16T02:30:19.481905+0000","last_unstale":"2023-11-16T02:30:19.829236+0000","last_undegraded":"2023-11-16T02:30:19.829236+0000","last_fullsized":"2023-11-16T02:30:19.829236+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:30:11.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.860430+0000","last_change":"2023-11-16T02:30:19.859522+0000","last_active":"2023-11-16T02:30:19.860430+0000","last_peered":"2023-11-16T02:30:19.860430+0000","last_clean":"2023-11-16T02:30:19.860430+0000","last_became_active":"2023-11-16T02:30:19.859274+0000","last_became_peered":"2023-11-16T02:30:19.859274+0000","last_unstale":"2023-11-16T02:30:19.860430+0000","last_undegraded":"2023-11-16T02:30:19.860430+0000","last_fullsized":"2023-11-16T02:30:19.860430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:17:17.336842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.836027+0000","last_change":"2023-11-16T02:30:19.481967+0000","last_active":"2023-11-16T02:30:19.836027+0000","last_peered":"2023-11-16T02:30:19.836027+0000","last_clean":"2023-11-16T02:30:19.836027+0000","last_became_active":"2023-11-16T02:30:19.481503+0000","last_became_peered":"2023-11-16T02:30:19.481503+0000","last_unstale":"2023-11-16T02:30:19.836027+0000","last_undegraded":"2023-11-16T02:30:19.836027+0000","last_fullsized":"2023-11-16T02:30:19.836027+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:55:12.932877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.852314+0000","last_change":"2023-11-16T02:30:19.840571+0000","last_active":"2023-11-16T02:30:19.852314+0000","last_peered":"2023-11-16T02:30:19.852314+0000","last_clean":"2023-11-16T02:30:19.852314+0000","last_became_active":"2023-11-16T02:30:19.840277+0000","last_became_peered":"2023-11-16T02:30:19.840277+0000","last_unstale":"2023-11-16T02:30:19.852314+0000","last_undegraded":"2023-11-16T02:30:19.852314+0000","last_fullsized":"2023-11-16T02:30:19.852314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:59:15.040356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.835041+0000","last_change":"2023-11-16T02:30:19.485297+0000","last_active":"2023-11-16T02:30:19.835041+0000","last_peered":"2023-11-16T02:30:19.835041+0000","last_clean":"2023-11-16T02:30:19.835041+0000","last_became_active":"2023-11-16T02:30:19.484515+0000","last_became_peered":"2023-11-16T02:30:19.484515+0000","last_unstale":"2023-11-16T02:30:19.835041+0000","last_undegraded":"2023-11-16T02:30:19.835041+0000","last_fullsized":"2023-11-16T02:30:19.835041+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:52:21.172818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.884462+0000","last_change":"2023-11-16T02:30:19.864997+0000","last_active":"2023-11-16T02:30:19.884462+0000","last_peered":"2023-11-16T02:30:19.884462+0000","last_clean":"2023-11-16T02:30:19.884462+0000","last_became_active":"2023-11-16T02:30:19.864281+0000","last_became_peered":"2023-11-16T02:30:19.864281+0000","last_unstale":"2023-11-16T02:30:19.884462+0000","last_undegraded":"2023-11-16T02:30:19.884462+0000","last_fullsized":"2023-11-16T02:30:19.884462+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:05:48.808451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.832593+0000","last_change":"2023-11-16T02:30:19.480325+0000","last_active":"2023-11-16T02:30:19.832593+0000","last_peered":"2023-11-16T02:30:19.832593+0000","last_clean":"2023-11-16T02:30:19.832593+0000","last_became_active":"2023-11-16T02:30:19.480062+0000","last_became_peered":"2023-11-16T02:30:19.480062+0000","last_unstale":"2023-11-16T02:30:19.832593+0000","last_undegraded":"2023-11-16T02:30:19.832593+0000","last_fullsized":"2023-11-16T02:30:19.832593+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:17:16.332028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893192+0000","last_change":"2023-11-16T02:30:19.884211+0000","last_active":"2023-11-16T02:30:19.893192+0000","last_peered":"2023-11-16T02:30:19.893192+0000","last_clean":"2023-11-16T02:30:19.893192+0000","last_became_active":"2023-11-16T02:30:19.880825+0000","last_became_peered":"2023-11-16T02:30:19.880825+0000","last_unstale":"2023-11-16T02:30:19.893192+0000","last_undegraded":"2023-11-16T02:30:19.893192+0000","last_fullsized":"2023-11-16T02:30:19.893192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:00:28.306611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.834224+0000","last_change":"2023-11-16T02:30:19.479112+0000","last_active":"2023-11-16T02:30:19.834224+0000","last_peered":"2023-11-16T02:30:19.834224+0000","last_clean":"2023-11-16T02:30:19.834224+0000","last_became_active":"2023-11-16T02:30:19.478459+0000","last_became_peered":"2023-11-16T02:30:19.478459+0000","last_unstale":"2023-11-16T02:30:19.834224+0000","last_undegraded":"2023-11-16T02:30:19.834224+0000","last_fullsized":"2023-11-16T02:30:19.834224+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:55:12.932877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.466612+0000","last_change":"2023-11-16T02:29:27.538359+0000","last_active":"2023-11-16T02:30:19.466612+0000","last_peered":"2023-11-16T02:30:19.466612+0000","last_clean":"2023-11-16T02:30:19.466612+0000","last_became_active":"2023-11-16T02:29:27.536606+0000","last_became_peered":"2023-11-16T02:29:27.536606+0000","last_unstale":"2023-11-16T02:30:19.466612+0000","last_undegraded":"2023-11-16T02:30:19.466612+0000","last_fullsized":"2023-11-16T02:30:19.466612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:26.491990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:26.491990+0000","last_clean_scrub_stamp":"2023-11-16T02:29:26.491990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:29:40.434297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":112,"acting":112,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":933888,"data_stored":716897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":360448,"data_stored":133920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":339968,"data_stored":126529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]}]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":339968,"data_stored":126529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":368640,"data_stored":134890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":339968,"data_stored":126529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":946176,"data_stored":723672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":327680,"data_stored":120262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-16T02:30:23.178 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-16T02:30:23.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.331+0000 7faa44e16640 1 Processor -- start 2023-11-16T02:30:23.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.331+0000 7faa44e16640 1 -- start start 2023-11-16T02:30:23.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.331+0000 7faa44e16640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7faa4006edd0 0x7faa40153240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:23.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.331+0000 7faa44e16640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa40071bf0 con 0x7faa4014bb00 2023-11-16T02:30:23.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.331+0000 7faa44e16640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa4014b020 con 0x7faa400b7cc0 2023-11-16T02:30:23.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.331+0000 7faa44e16640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4014b6e0 con 0x7faa4006edd0 2023-11-16T02:30:23.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3dd9b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7faa4014bb00 0x7faa40141840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54300/0 (socket says 172.21.15.28:54300) 2023-11-16T02:30:23.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3dd9b640 1 -- 172.21.15.28:0/3357988411 learned_addr learned my addr 172.21.15.28:0/3357988411 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:23.337 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3ed9d640 1 --2- 172.21.15.28:0/3357988411 >> v2:172.21.15.70:3300/0 conn(0x7faa4006edd0 0x7faa40153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:23.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3d59a640 1 -- 172.21.15.28:0/3357988411 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2613217821 0 0) 0x7faa40071bf0 con 0x7faa4014bb00 2023-11-16T02:30:23.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3d59a640 1 -- 172.21.15.28:0/3357988411 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa28003530 con 0x7faa4014bb00 2023-11-16T02:30:23.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3d59a640 1 -- 172.21.15.28:0/3357988411 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 334365975 0 0) 0x7faa28003530 con 0x7faa4014bb00 2023-11-16T02:30:23.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3d59a640 1 -- 172.21.15.28:0/3357988411 >> v2:172.21.15.70:3300/0 conn(0x7faa4006edd0 msgr2=0x7faa40153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:23.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3d59a640 1 --2- 172.21.15.28:0/3357988411 >> v2:172.21.15.70:3300/0 conn(0x7faa4006edd0 0x7faa40153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:23.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3d59a640 1 -- 172.21.15.28:0/3357988411 >> v1:172.21.15.70:6789/0 conn(0x7faa400b7cc0 legacy=0x7faa40071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:23.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3d59a640 1 -- 172.21.15.28:0/3357988411 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4014b300 con 0x7faa4014bb00 2023-11-16T02:30:23.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3d59a640 1 -- 172.21.15.28:0/3357988411 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7faa34001680 con 0x7faa4014bb00 2023-11-16T02:30:23.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3d59a640 1 -- 172.21.15.28:0/3357988411 >> v1:172.21.15.28:6789/0 conn(0x7faa4014bb00 legacy=0x7faa40141840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:23.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3d59a640 1 --2- 172.21.15.28:0/3357988411 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa28003980 0x7faa28003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:23.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3d59a640 1 --2- 172.21.15.28:0/3357988411 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faa280047d0 0x7faa28004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:23.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3d59a640 1 --2- 172.21.15.28:0/3357988411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa28005190 0x7faa2800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:23.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3d59a640 1 -- 172.21.15.28:0/3357988411 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4014b6e0 con 0x7faa28003980 2023-11-16T02:30:23.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3d59a640 1 -- 172.21.15.28:0/3357988411 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2800c130 con 0x7faa28005190 2023-11-16T02:30:23.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3d59a640 1 -- 172.21.15.28:0/3357988411 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa2800c2f0 con 0x7faa280047d0 2023-11-16T02:30:23.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3e59c640 1 --2- 172.21.15.28:0/3357988411 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa28003980 0x7faa28003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:23.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3dd9b640 1 --2- 172.21.15.28:0/3357988411 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faa280047d0 0x7faa28004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:23.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3e59c640 1 -- 172.21.15.28:0/3357988411 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faa280047d0 msgr2=0x7faa28004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:23.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3e59c640 1 --2- 172.21.15.28:0/3357988411 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faa280047d0 0x7faa28004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:23.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3e59c640 1 -- 172.21.15.28:0/3357988411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa28005190 msgr2=0x7faa2800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:23.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3e59c640 1 --2- 172.21.15.28:0/3357988411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa28005190 0x7faa2800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:23.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3e59c640 1 -- 172.21.15.28:0/3357988411 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa28003530 con 0x7faa28003980 2023-11-16T02:30:23.340 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3ed9d640 1 -- 172.21.15.28:0/3357988411 reap_dead start 2023-11-16T02:30:23.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3e59c640 1 --2- 172.21.15.28:0/3357988411 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa28003980 0x7faa28003da0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7faa30001780 tx=0x7faa3001c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86aff57af9af3dc server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:23.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3d59a640 1 -- 172.21.15.28:0/3357988411 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa300050d0 con 0x7faa28003980 2023-11-16T02:30:23.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3d59a640 1 -- 172.21.15.28:0/3357988411 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa30005250 con 0x7faa28003980 2023-11-16T02:30:23.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa3d59a640 1 -- 172.21.15.28:0/3357988411 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa30003600 con 0x7faa28003980 2023-11-16T02:30:23.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa44e16640 1 -- 172.21.15.28:0/3357988411 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa28003980 msgr2=0x7faa28003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:23.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa44e16640 1 --2- 172.21.15.28:0/3357988411 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa28003980 0x7faa28003da0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7faa30001780 tx=0x7faa3001c220 comp rx=0 tx=0).stop 2023-11-16T02:30:23.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa44e16640 1 -- 172.21.15.28:0/3357988411 shutdown_connections 2023-11-16T02:30:23.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa44e16640 1 --2- 172.21.15.28:0/3357988411 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa28003980 0x7faa28003da0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:23.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.335+0000 7faa44e16640 1 -- 172.21.15.28:0/3357988411 >> 172.21.15.28:0/3357988411 conn(0x7faa400b9050 msgr2=0x7faa400bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:23.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa44e16640 1 -- 172.21.15.28:0/3357988411 shutdown_connections 2023-11-16T02:30:23.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa44e16640 1 -- 172.21.15.28:0/3357988411 wait complete. 2023-11-16T02:30:23.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa44e16640 1 Processor -- start 2023-11-16T02:30:23.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa44e16640 1 -- start start 2023-11-16T02:30:23.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa44e16640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa28003980 0x7faa401d5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:23.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa44e16640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa401d6bf0 0x7faa400bb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:23.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa44e16640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faa401d74f0 0x7faa40139070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:23.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa44e16640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa401d58c0 con 0x7faa28003980 2023-11-16T02:30:23.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa44e16640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa401d4a60 con 0x7faa401d6bf0 2023-11-16T02:30:23.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa44e16640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa401d70d0 con 0x7faa401d74f0 2023-11-16T02:30:23.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa3e59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa28003980 0x7faa401d5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:23.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa3e59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa28003980 0x7faa401d5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54236/0 (socket says 172.21.15.28:54236) 2023-11-16T02:30:23.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa3e59c640 1 -- 172.21.15.28:0/3993204887 learned_addr learned my addr 172.21.15.28:0/3993204887 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:23.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa3dd9b640 1 --2- 172.21.15.28:0/3993204887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa401d6bf0 0x7faa400bb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:23.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa3e59c640 1 -- 172.21.15.28:0/3993204887 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faa401d74f0 msgr2=0x7faa40139070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:23.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa3ed9d640 1 --2- 172.21.15.28:0/3993204887 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faa401d74f0 0x7faa40139070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:23.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa3e59c640 1 --2- 172.21.15.28:0/3993204887 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faa401d74f0 0x7faa40139070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:23.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa3e59c640 1 -- 172.21.15.28:0/3993204887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa401d6bf0 msgr2=0x7faa400bb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:23.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa3e59c640 1 --2- 172.21.15.28:0/3993204887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa401d6bf0 0x7faa400bb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:23.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa3e59c640 1 -- 172.21.15.28:0/3993204887 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa400ba940 con 0x7faa28003980 2023-11-16T02:30:23.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa3e59c640 1 --2- 172.21.15.28:0/3993204887 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa28003980 0x7faa401d5380 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7faa3001c050 tx=0x7faa28005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:23.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa2effd640 1 -- 172.21.15.28:0/3993204887 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa30007a40 con 0x7faa28003980 2023-11-16T02:30:23.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa2effd640 1 -- 172.21.15.28:0/3993204887 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa30000ee0 con 0x7faa28003980 2023-11-16T02:30:23.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa44e16640 1 -- 172.21.15.28:0/3993204887 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa400bac20 con 0x7faa28003980 2023-11-16T02:30:23.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa2effd640 1 -- 172.21.15.28:0/3993204887 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa300067e0 con 0x7faa28003980 2023-11-16T02:30:23.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa44e16640 1 -- 172.21.15.28:0/3993204887 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa400bba00 con 0x7faa28003980 2023-11-16T02:30:23.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.339+0000 7faa44e16640 1 -- 172.21.15.28:0/3993204887 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa4004e8a0 con 0x7faa28003980 2023-11-16T02:30:23.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.343+0000 7faa2effd640 1 -- 172.21.15.28:0/3993204887 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7faa30006940 con 0x7faa28003980 2023-11-16T02:30:23.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.343+0000 7faa2effd640 1 --2- 172.21.15.28:0/3993204887 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7faa20065a60 0x7faa20067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:23.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.343+0000 7faa2effd640 1 -- 172.21.15.28:0/3993204887 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa3011c5e0 con 0x7faa28003980 2023-11-16T02:30:23.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.343+0000 7faa3dd9b640 1 --2- 172.21.15.28:0/3993204887 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7faa20065a60 0x7faa20067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:23.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.343+0000 7faa3dd9b640 1 --2- 172.21.15.28:0/3993204887 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7faa20065a60 0x7faa20067f20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7faa34001210 tx=0x7faa34000f40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:23.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.347+0000 7faa2effd640 1 -- 172.21.15.28:0/3993204887 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7faa300ea030 con 0x7faa28003980 2023-11-16T02:30:23.502 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.499+0000 7faa44e16640 1 -- 172.21.15.28:0/3993204887 --> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faa400ba7c0 con 0x7faa20065a60 2023-11-16T02:30:23.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.507+0000 7faa2effd640 1 -- 172.21.15.28:0/3993204887 <== mgr.4104 v2:172.21.15.28:6832/38651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+263353 (secure 0 0 0) 0x7faa34005db0 con 0x7faa20065a60 2023-11-16T02:30:23.512 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:30:23.514 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-11-16T02:30:23.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.511+0000 7faa44e16640 1 -- 172.21.15.28:0/3993204887 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7faa20065a60 msgr2=0x7faa20067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:23.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.511+0000 7faa44e16640 1 --2- 172.21.15.28:0/3993204887 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7faa20065a60 0x7faa20067f20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7faa34001210 tx=0x7faa34000f40 comp rx=0 tx=0).stop 2023-11-16T02:30:23.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.511+0000 7faa44e16640 1 -- 172.21.15.28:0/3993204887 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa28003980 msgr2=0x7faa401d5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:23.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.511+0000 7faa44e16640 1 --2- 172.21.15.28:0/3993204887 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa28003980 0x7faa401d5380 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7faa3001c050 tx=0x7faa28005800 comp rx=0 tx=0).stop 2023-11-16T02:30:23.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.511+0000 7faa44e16640 1 -- 172.21.15.28:0/3993204887 shutdown_connections 2023-11-16T02:30:23.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.511+0000 7faa44e16640 1 --2- 172.21.15.28:0/3993204887 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7faa20065a60 0x7faa20067f20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:23.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.511+0000 7faa44e16640 1 --2- 172.21.15.28:0/3993204887 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7faa401d74f0 0x7faa40139070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:23.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.511+0000 7faa44e16640 1 --2- 172.21.15.28:0/3993204887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faa401d6bf0 0x7faa400bb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:23.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.511+0000 7faa44e16640 1 --2- 172.21.15.28:0/3993204887 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa28003980 0x7faa401d5380 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:23.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.511+0000 7faa44e16640 1 -- 172.21.15.28:0/3993204887 >> 172.21.15.28:0/3993204887 conn(0x7faa400b9050 msgr2=0x7faa400b5340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:23.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.511+0000 7faa44e16640 1 -- 172.21.15.28:0/3993204887 shutdown_connections 2023-11-16T02:30:23.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.511+0000 7faa44e16640 1 -- 172.21.15.28:0/3993204887 wait complete. 2023-11-16T02:30:23.531 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-11-16T02:30:22.428531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":200,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":178,"acting":178,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252248,"kb_used_data":3864,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754722472,"statfs":{"total":773094113280,"available":772835811328,"internally_reserved":0,"allocated":3956736,"data_stored":2209228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":60,"apply_latency_ms":60,"commit_latency_ns":60000000,"apply_latency_ns":60000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.002315"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.884818+0000","last_change":"2023-11-16T02:30:19.870271+0000","last_active":"2023-11-16T02:30:19.884818+0000","last_peered":"2023-11-16T02:30:19.884818+0000","last_clean":"2023-11-16T02:30:19.884818+0000","last_became_active":"2023-11-16T02:30:19.869530+0000","last_became_peered":"2023-11-16T02:30:19.869530+0000","last_unstale":"2023-11-16T02:30:19.884818+0000","last_undegraded":"2023-11-16T02:30:19.884818+0000","last_fullsized":"2023-11-16T02:30:19.884818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:34:33.419560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.851719+0000","last_change":"2023-11-16T02:30:19.847500+0000","last_active":"2023-11-16T02:30:19.851719+0000","last_peered":"2023-11-16T02:30:19.851719+0000","last_clean":"2023-11-16T02:30:19.851719+0000","last_became_active":"2023-11-16T02:30:19.847125+0000","last_became_peered":"2023-11-16T02:30:19.847125+0000","last_unstale":"2023-11-16T02:30:19.851719+0000","last_undegraded":"2023-11-16T02:30:19.851719+0000","last_fullsized":"2023-11-16T02:30:19.851719+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:04:02.319109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878367+0000","last_change":"2023-11-16T02:30:19.866614+0000","last_active":"2023-11-16T02:30:19.878367+0000","last_peered":"2023-11-16T02:30:19.878367+0000","last_clean":"2023-11-16T02:30:19.878367+0000","last_became_active":"2023-11-16T02:30:19.865850+0000","last_became_peered":"2023-11-16T02:30:19.865850+0000","last_unstale":"2023-11-16T02:30:19.878367+0000","last_undegraded":"2023-11-16T02:30:19.878367+0000","last_fullsized":"2023-11-16T02:30:19.878367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:26:35.043805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.883440+0000","last_change":"2023-11-16T02:30:19.882299+0000","last_active":"2023-11-16T02:30:19.883440+0000","last_peered":"2023-11-16T02:30:19.883440+0000","last_clean":"2023-11-16T02:30:19.883440+0000","last_became_active":"2023-11-16T02:30:19.882012+0000","last_became_peered":"2023-11-16T02:30:19.882012+0000","last_unstale":"2023-11-16T02:30:19.883440+0000","last_undegraded":"2023-11-16T02:30:19.883440+0000","last_fullsized":"2023-11-16T02:30:19.883440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:05:48.808451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.873934+0000","last_change":"2023-11-16T02:30:19.873025+0000","last_active":"2023-11-16T02:30:19.873934+0000","last_peered":"2023-11-16T02:30:19.873934+0000","last_clean":"2023-11-16T02:30:19.873934+0000","last_became_active":"2023-11-16T02:30:19.872781+0000","last_became_peered":"2023-11-16T02:30:19.872781+0000","last_unstale":"2023-11-16T02:30:19.873934+0000","last_undegraded":"2023-11-16T02:30:19.873934+0000","last_fullsized":"2023-11-16T02:30:19.873934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:19:10.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893391+0000","last_change":"2023-11-16T02:30:19.886324+0000","last_active":"2023-11-16T02:30:19.893391+0000","last_peered":"2023-11-16T02:30:19.893391+0000","last_clean":"2023-11-16T02:30:19.893391+0000","last_became_active":"2023-11-16T02:30:19.885725+0000","last_became_peered":"2023-11-16T02:30:19.885725+0000","last_unstale":"2023-11-16T02:30:19.893391+0000","last_undegraded":"2023-11-16T02:30:19.893391+0000","last_fullsized":"2023-11-16T02:30:19.893391+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:29:41.914615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.890750+0000","last_change":"2023-11-16T02:30:19.874493+0000","last_active":"2023-11-16T02:30:19.890750+0000","last_peered":"2023-11-16T02:30:19.890750+0000","last_clean":"2023-11-16T02:30:19.890750+0000","last_became_active":"2023-11-16T02:30:19.872914+0000","last_became_peered":"2023-11-16T02:30:19.872914+0000","last_unstale":"2023-11-16T02:30:19.890750+0000","last_undegraded":"2023-11-16T02:30:19.890750+0000","last_fullsized":"2023-11-16T02:30:19.890750+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:58:23.597351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.876394+0000","last_change":"2023-11-16T02:30:19.846299+0000","last_active":"2023-11-16T02:30:19.876394+0000","last_peered":"2023-11-16T02:30:19.876394+0000","last_clean":"2023-11-16T02:30:19.876394+0000","last_became_active":"2023-11-16T02:30:19.845561+0000","last_became_peered":"2023-11-16T02:30:19.845561+0000","last_unstale":"2023-11-16T02:30:19.876394+0000","last_undegraded":"2023-11-16T02:30:19.876394+0000","last_fullsized":"2023-11-16T02:30:19.876394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:24:43.125348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.848786+0000","last_change":"2023-11-16T02:30:19.843307+0000","last_active":"2023-11-16T02:30:19.848786+0000","last_peered":"2023-11-16T02:30:19.848786+0000","last_clean":"2023-11-16T02:30:19.848786+0000","last_became_active":"2023-11-16T02:30:19.842948+0000","last_became_peered":"2023-11-16T02:30:19.842948+0000","last_unstale":"2023-11-16T02:30:19.848786+0000","last_undegraded":"2023-11-16T02:30:19.848786+0000","last_fullsized":"2023-11-16T02:30:19.848786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:51:01.130415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893290+0000","last_change":"2023-11-16T02:30:19.884857+0000","last_active":"2023-11-16T02:30:19.893290+0000","last_peered":"2023-11-16T02:30:19.893290+0000","last_clean":"2023-11-16T02:30:19.893290+0000","last_became_active":"2023-11-16T02:30:19.884211+0000","last_became_peered":"2023-11-16T02:30:19.884211+0000","last_unstale":"2023-11-16T02:30:19.893290+0000","last_undegraded":"2023-11-16T02:30:19.893290+0000","last_fullsized":"2023-11-16T02:30:19.893290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:26:35.043805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.883207+0000","last_change":"2023-11-16T02:30:19.873333+0000","last_active":"2023-11-16T02:30:19.883207+0000","last_peered":"2023-11-16T02:30:19.883207+0000","last_clean":"2023-11-16T02:30:19.883207+0000","last_became_active":"2023-11-16T02:30:19.872312+0000","last_became_peered":"2023-11-16T02:30:19.872312+0000","last_unstale":"2023-11-16T02:30:19.883207+0000","last_undegraded":"2023-11-16T02:30:19.883207+0000","last_fullsized":"2023-11-16T02:30:19.883207+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:01:25.904236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.851670+0000","last_change":"2023-11-16T02:30:19.847259+0000","last_active":"2023-11-16T02:30:19.851670+0000","last_peered":"2023-11-16T02:30:19.851670+0000","last_clean":"2023-11-16T02:30:19.851670+0000","last_became_active":"2023-11-16T02:30:19.846960+0000","last_became_peered":"2023-11-16T02:30:19.846960+0000","last_unstale":"2023-11-16T02:30:19.851670+0000","last_undegraded":"2023-11-16T02:30:19.851670+0000","last_fullsized":"2023-11-16T02:30:19.851670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T09:23:18.109208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878474+0000","last_change":"2023-11-16T02:30:19.866095+0000","last_active":"2023-11-16T02:30:19.878474+0000","last_peered":"2023-11-16T02:30:19.878474+0000","last_clean":"2023-11-16T02:30:19.878474+0000","last_became_active":"2023-11-16T02:30:19.865309+0000","last_became_peered":"2023-11-16T02:30:19.865309+0000","last_unstale":"2023-11-16T02:30:19.878474+0000","last_undegraded":"2023-11-16T02:30:19.878474+0000","last_fullsized":"2023-11-16T02:30:19.878474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:05:48.808451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.890791+0000","last_change":"2023-11-16T02:30:19.874960+0000","last_active":"2023-11-16T02:30:19.890791+0000","last_peered":"2023-11-16T02:30:19.890791+0000","last_clean":"2023-11-16T02:30:19.890791+0000","last_became_active":"2023-11-16T02:30:19.873799+0000","last_became_peered":"2023-11-16T02:30:19.873799+0000","last_unstale":"2023-11-16T02:30:19.890791+0000","last_undegraded":"2023-11-16T02:30:19.890791+0000","last_fullsized":"2023-11-16T02:30:19.890791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:25:44.847232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893326+0000","last_change":"2023-11-16T02:30:19.885005+0000","last_active":"2023-11-16T02:30:19.893326+0000","last_peered":"2023-11-16T02:30:19.893326+0000","last_clean":"2023-11-16T02:30:19.893326+0000","last_became_active":"2023-11-16T02:30:19.884513+0000","last_became_peered":"2023-11-16T02:30:19.884513+0000","last_unstale":"2023-11-16T02:30:19.893326+0000","last_undegraded":"2023-11-16T02:30:19.893326+0000","last_fullsized":"2023-11-16T02:30:19.893326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:23:28.656034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.850304+0000","last_change":"2023-11-16T02:30:19.840626+0000","last_active":"2023-11-16T02:30:19.850304+0000","last_peered":"2023-11-16T02:30:19.850304+0000","last_clean":"2023-11-16T02:30:19.850304+0000","last_became_active":"2023-11-16T02:30:19.840345+0000","last_became_peered":"2023-11-16T02:30:19.840345+0000","last_unstale":"2023-11-16T02:30:19.850304+0000","last_undegraded":"2023-11-16T02:30:19.850304+0000","last_fullsized":"2023-11-16T02:30:19.850304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:23:28.656034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.851576+0000","last_change":"2023-11-16T02:30:19.845327+0000","last_active":"2023-11-16T02:30:19.851576+0000","last_peered":"2023-11-16T02:30:19.851576+0000","last_clean":"2023-11-16T02:30:19.851576+0000","last_became_active":"2023-11-16T02:30:19.845068+0000","last_became_peered":"2023-11-16T02:30:19.845068+0000","last_unstale":"2023-11-16T02:30:19.851576+0000","last_undegraded":"2023-11-16T02:30:19.851576+0000","last_fullsized":"2023-11-16T02:30:19.851576+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:58:23.597351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.890272+0000","last_change":"2023-11-16T02:30:19.879907+0000","last_active":"2023-11-16T02:30:19.890272+0000","last_peered":"2023-11-16T02:30:19.890272+0000","last_clean":"2023-11-16T02:30:19.890272+0000","last_became_active":"2023-11-16T02:30:19.878794+0000","last_became_peered":"2023-11-16T02:30:19.878794+0000","last_unstale":"2023-11-16T02:30:19.890272+0000","last_undegraded":"2023-11-16T02:30:19.890272+0000","last_fullsized":"2023-11-16T02:30:19.890272+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:05:25.212455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.884390+0000","last_change":"2023-11-16T02:30:19.867043+0000","last_active":"2023-11-16T02:30:19.884390+0000","last_peered":"2023-11-16T02:30:19.884390+0000","last_clean":"2023-11-16T02:30:19.884390+0000","last_became_active":"2023-11-16T02:30:19.866232+0000","last_became_peered":"2023-11-16T02:30:19.866232+0000","last_unstale":"2023-11-16T02:30:19.884390+0000","last_undegraded":"2023-11-16T02:30:19.884390+0000","last_fullsized":"2023-11-16T02:30:19.884390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:51:01.130415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.877328+0000","last_change":"2023-11-16T02:30:19.875797+0000","last_active":"2023-11-16T02:30:19.877328+0000","last_peered":"2023-11-16T02:30:19.877328+0000","last_clean":"2023-11-16T02:30:19.877328+0000","last_became_active":"2023-11-16T02:30:19.875422+0000","last_became_peered":"2023-11-16T02:30:19.875422+0000","last_unstale":"2023-11-16T02:30:19.877328+0000","last_undegraded":"2023-11-16T02:30:19.877328+0000","last_fullsized":"2023-11-16T02:30:19.877328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:51:01.130415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878399+0000","last_change":"2023-11-16T02:30:19.867144+0000","last_active":"2023-11-16T02:30:19.878399+0000","last_peered":"2023-11-16T02:30:19.878399+0000","last_clean":"2023-11-16T02:30:19.878399+0000","last_became_active":"2023-11-16T02:30:19.865272+0000","last_became_peered":"2023-11-16T02:30:19.865272+0000","last_unstale":"2023-11-16T02:30:19.878399+0000","last_undegraded":"2023-11-16T02:30:19.878399+0000","last_fullsized":"2023-11-16T02:30:19.878399+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:53:26.356470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.873118+0000","last_change":"2023-11-16T02:30:19.872380+0000","last_active":"2023-11-16T02:30:19.873118+0000","last_peered":"2023-11-16T02:30:19.873118+0000","last_clean":"2023-11-16T02:30:19.873118+0000","last_became_active":"2023-11-16T02:30:19.872131+0000","last_became_peered":"2023-11-16T02:30:19.872131+0000","last_unstale":"2023-11-16T02:30:19.873118+0000","last_undegraded":"2023-11-16T02:30:19.873118+0000","last_fullsized":"2023-11-16T02:30:19.873118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:14:02.468285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.873930+0000","last_change":"2023-11-16T02:30:19.873009+0000","last_active":"2023-11-16T02:30:19.873930+0000","last_peered":"2023-11-16T02:30:19.873930+0000","last_clean":"2023-11-16T02:30:19.873930+0000","last_became_active":"2023-11-16T02:30:19.872718+0000","last_became_peered":"2023-11-16T02:30:19.872718+0000","last_unstale":"2023-11-16T02:30:19.873930+0000","last_undegraded":"2023-11-16T02:30:19.873930+0000","last_fullsized":"2023-11-16T02:30:19.873930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:57:16.626801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878500+0000","last_change":"2023-11-16T02:30:19.877492+0000","last_active":"2023-11-16T02:30:19.878500+0000","last_peered":"2023-11-16T02:30:19.878500+0000","last_clean":"2023-11-16T02:30:19.878500+0000","last_became_active":"2023-11-16T02:30:19.877055+0000","last_became_peered":"2023-11-16T02:30:19.877055+0000","last_unstale":"2023-11-16T02:30:19.878500+0000","last_undegraded":"2023-11-16T02:30:19.878500+0000","last_fullsized":"2023-11-16T02:30:19.878500+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:30:57.683829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.883250+0000","last_change":"2023-11-16T02:30:19.873823+0000","last_active":"2023-11-16T02:30:19.883250+0000","last_peered":"2023-11-16T02:30:19.883250+0000","last_clean":"2023-11-16T02:30:19.883250+0000","last_became_active":"2023-11-16T02:30:19.873097+0000","last_became_peered":"2023-11-16T02:30:19.873097+0000","last_unstale":"2023-11-16T02:30:19.883250+0000","last_undegraded":"2023-11-16T02:30:19.883250+0000","last_fullsized":"2023-11-16T02:30:19.883250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:11:01.176911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.890230+0000","last_change":"2023-11-16T02:30:19.879438+0000","last_active":"2023-11-16T02:30:19.890230+0000","last_peered":"2023-11-16T02:30:19.890230+0000","last_clean":"2023-11-16T02:30:19.890230+0000","last_became_active":"2023-11-16T02:30:19.878067+0000","last_became_peered":"2023-11-16T02:30:19.878067+0000","last_unstale":"2023-11-16T02:30:19.890230+0000","last_undegraded":"2023-11-16T02:30:19.890230+0000","last_fullsized":"2023-11-16T02:30:19.890230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:53:26.356470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893346+0000","last_change":"2023-11-16T02:30:19.885674+0000","last_active":"2023-11-16T02:30:19.893346+0000","last_peered":"2023-11-16T02:30:19.893346+0000","last_clean":"2023-11-16T02:30:19.893346+0000","last_became_active":"2023-11-16T02:30:19.884062+0000","last_became_peered":"2023-11-16T02:30:19.884062+0000","last_unstale":"2023-11-16T02:30:19.893346+0000","last_undegraded":"2023-11-16T02:30:19.893346+0000","last_fullsized":"2023-11-16T02:30:19.893346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:59:15.040356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.872486+0000","last_change":"2023-11-16T02:30:19.859781+0000","last_active":"2023-11-16T02:30:19.872486+0000","last_peered":"2023-11-16T02:30:19.872486+0000","last_clean":"2023-11-16T02:30:19.872486+0000","last_became_active":"2023-11-16T02:30:19.857455+0000","last_became_peered":"2023-11-16T02:30:19.857455+0000","last_unstale":"2023-11-16T02:30:19.872486+0000","last_undegraded":"2023-11-16T02:30:19.872486+0000","last_fullsized":"2023-11-16T02:30:19.872486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:17:17.336842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893099+0000","last_change":"2023-11-16T02:30:19.880769+0000","last_active":"2023-11-16T02:30:19.893099+0000","last_peered":"2023-11-16T02:30:19.893099+0000","last_clean":"2023-11-16T02:30:19.893099+0000","last_became_active":"2023-11-16T02:30:19.878925+0000","last_became_peered":"2023-11-16T02:30:19.878925+0000","last_unstale":"2023-11-16T02:30:19.893099+0000","last_undegraded":"2023-11-16T02:30:19.893099+0000","last_fullsized":"2023-11-16T02:30:19.893099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:57:16.626801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.877326+0000","last_change":"2023-11-16T02:30:19.875765+0000","last_active":"2023-11-16T02:30:19.877326+0000","last_peered":"2023-11-16T02:30:19.877326+0000","last_clean":"2023-11-16T02:30:19.877326+0000","last_became_active":"2023-11-16T02:30:19.875438+0000","last_became_peered":"2023-11-16T02:30:19.875438+0000","last_unstale":"2023-11-16T02:30:19.877326+0000","last_undegraded":"2023-11-16T02:30:19.877326+0000","last_fullsized":"2023-11-16T02:30:19.877326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:53:26.356470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.884630+0000","last_change":"2023-11-16T02:30:19.484973+0000","last_active":"2023-11-16T02:30:19.884630+0000","last_peered":"2023-11-16T02:30:19.884630+0000","last_clean":"2023-11-16T02:30:19.884630+0000","last_became_active":"2023-11-16T02:30:19.484403+0000","last_became_peered":"2023-11-16T02:30:19.484403+0000","last_unstale":"2023-11-16T02:30:19.884630+0000","last_undegraded":"2023-11-16T02:30:19.884630+0000","last_fullsized":"2023-11-16T02:30:19.884630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:30:11.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.891352+0000","last_change":"2023-11-16T02:30:19.886424+0000","last_active":"2023-11-16T02:30:19.891352+0000","last_peered":"2023-11-16T02:30:19.891352+0000","last_clean":"2023-11-16T02:30:19.891352+0000","last_became_active":"2023-11-16T02:30:19.885778+0000","last_became_peered":"2023-11-16T02:30:19.885778+0000","last_unstale":"2023-11-16T02:30:19.891352+0000","last_undegraded":"2023-11-16T02:30:19.891352+0000","last_fullsized":"2023-11-16T02:30:19.891352+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:26:16.324058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.875204+0000","last_change":"2023-11-16T02:30:19.467799+0000","last_active":"2023-11-16T02:30:19.875204+0000","last_peered":"2023-11-16T02:30:19.875204+0000","last_clean":"2023-11-16T02:30:19.875204+0000","last_became_active":"2023-11-16T02:30:19.467517+0000","last_became_peered":"2023-11-16T02:30:19.467517+0000","last_unstale":"2023-11-16T02:30:19.875204+0000","last_undegraded":"2023-11-16T02:30:19.875204+0000","last_fullsized":"2023-11-16T02:30:19.875204+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:53:29.543335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.884546+0000","last_change":"2023-11-16T02:30:19.865354+0000","last_active":"2023-11-16T02:30:19.884546+0000","last_peered":"2023-11-16T02:30:19.884546+0000","last_clean":"2023-11-16T02:30:19.884546+0000","last_became_active":"2023-11-16T02:30:19.864635+0000","last_became_peered":"2023-11-16T02:30:19.864635+0000","last_unstale":"2023-11-16T02:30:19.884546+0000","last_undegraded":"2023-11-16T02:30:19.884546+0000","last_fullsized":"2023-11-16T02:30:19.884546+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T09:30:55.572569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.857320+0000","last_change":"2023-11-16T02:30:19.463569+0000","last_active":"2023-11-16T02:30:19.857320+0000","last_peered":"2023-11-16T02:30:19.857320+0000","last_clean":"2023-11-16T02:30:19.857320+0000","last_became_active":"2023-11-16T02:30:19.463298+0000","last_became_peered":"2023-11-16T02:30:19.463298+0000","last_unstale":"2023-11-16T02:30:19.857320+0000","last_undegraded":"2023-11-16T02:30:19.857320+0000","last_fullsized":"2023-11-16T02:30:19.857320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:26:15.319244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878131+0000","last_change":"2023-11-16T02:30:19.876755+0000","last_active":"2023-11-16T02:30:19.878131+0000","last_peered":"2023-11-16T02:30:19.878131+0000","last_clean":"2023-11-16T02:30:19.878131+0000","last_became_active":"2023-11-16T02:30:19.876454+0000","last_became_peered":"2023-11-16T02:30:19.876454+0000","last_unstale":"2023-11-16T02:30:19.878131+0000","last_undegraded":"2023-11-16T02:30:19.878131+0000","last_fullsized":"2023-11-16T02:30:19.878131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T09:30:55.572569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-16T02:30:18.431898+0000","last_change":"2023-11-16T02:30:18.431898+0000","last_active":"2023-11-16T02:30:18.421000+0000","last_peered":"2023-11-16T02:30:18.421000+0000","last_clean":"2023-11-16T02:30:18.421000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:18.431898+0000","last_undegraded":"2023-11-16T02:30:18.431898+0000","last_fullsized":"2023-11-16T02:30:18.431898+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:15:52.039420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893400+0000","last_change":"2023-11-16T02:30:19.887577+0000","last_active":"2023-11-16T02:30:19.893400+0000","last_peered":"2023-11-16T02:30:19.893400+0000","last_clean":"2023-11-16T02:30:19.893400+0000","last_became_active":"2023-11-16T02:30:19.886948+0000","last_became_peered":"2023-11-16T02:30:19.886948+0000","last_unstale":"2023-11-16T02:30:19.893400+0000","last_undegraded":"2023-11-16T02:30:19.893400+0000","last_fullsized":"2023-11-16T02:30:19.893400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:11:01.176911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.877547+0000","last_change":"2023-11-16T02:30:19.461227+0000","last_active":"2023-11-16T02:30:19.877547+0000","last_peered":"2023-11-16T02:30:19.877547+0000","last_clean":"2023-11-16T02:30:19.877547+0000","last_became_active":"2023-11-16T02:30:19.460450+0000","last_became_peered":"2023-11-16T02:30:19.460450+0000","last_unstale":"2023-11-16T02:30:19.877547+0000","last_undegraded":"2023-11-16T02:30:19.877547+0000","last_fullsized":"2023-11-16T02:30:19.877547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:07:18.071597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878430+0000","last_change":"2023-11-16T02:30:19.868426+0000","last_active":"2023-11-16T02:30:19.878430+0000","last_peered":"2023-11-16T02:30:19.878430+0000","last_clean":"2023-11-16T02:30:19.878430+0000","last_became_active":"2023-11-16T02:30:19.866177+0000","last_became_peered":"2023-11-16T02:30:19.866177+0000","last_unstale":"2023-11-16T02:30:19.878430+0000","last_undegraded":"2023-11-16T02:30:19.878430+0000","last_fullsized":"2023-11-16T02:30:19.878430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:14:02.468285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.876474+0000","last_change":"2023-11-16T02:30:19.461149+0000","last_active":"2023-11-16T02:30:19.876474+0000","last_peered":"2023-11-16T02:30:19.876474+0000","last_clean":"2023-11-16T02:30:19.876474+0000","last_became_active":"2023-11-16T02:30:19.460646+0000","last_became_peered":"2023-11-16T02:30:19.460646+0000","last_unstale":"2023-11-16T02:30:19.876474+0000","last_undegraded":"2023-11-16T02:30:19.876474+0000","last_fullsized":"2023-11-16T02:30:19.876474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:08:35.892877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.890191+0000","last_change":"2023-11-16T02:30:19.878750+0000","last_active":"2023-11-16T02:30:19.890191+0000","last_peered":"2023-11-16T02:30:19.890191+0000","last_clean":"2023-11-16T02:30:19.890191+0000","last_became_active":"2023-11-16T02:30:19.878234+0000","last_became_peered":"2023-11-16T02:30:19.878234+0000","last_unstale":"2023-11-16T02:30:19.890191+0000","last_undegraded":"2023-11-16T02:30:19.890191+0000","last_fullsized":"2023-11-16T02:30:19.890191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:11:46.387664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.835183+0000","last_change":"2023-11-16T02:30:19.469556+0000","last_active":"2023-11-16T02:30:19.835183+0000","last_peered":"2023-11-16T02:30:19.835183+0000","last_clean":"2023-11-16T02:30:19.835183+0000","last_became_active":"2023-11-16T02:30:19.468872+0000","last_became_peered":"2023-11-16T02:30:19.468872+0000","last_unstale":"2023-11-16T02:30:19.835183+0000","last_undegraded":"2023-11-16T02:30:19.835183+0000","last_fullsized":"2023-11-16T02:30:19.835183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:11:45.382850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.871173+0000","last_change":"2023-11-16T02:30:19.869582+0000","last_active":"2023-11-16T02:30:19.871173+0000","last_peered":"2023-11-16T02:30:19.871173+0000","last_clean":"2023-11-16T02:30:19.871173+0000","last_became_active":"2023-11-16T02:30:19.869254+0000","last_became_peered":"2023-11-16T02:30:19.869254+0000","last_unstale":"2023-11-16T02:30:19.871173+0000","last_undegraded":"2023-11-16T02:30:19.871173+0000","last_fullsized":"2023-11-16T02:30:19.871173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:26:35.043805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.834349+0000","last_change":"2023-11-16T02:30:19.466145+0000","last_active":"2023-11-16T02:30:19.834349+0000","last_peered":"2023-11-16T02:30:19.834349+0000","last_clean":"2023-11-16T02:30:19.834349+0000","last_became_active":"2023-11-16T02:30:19.465726+0000","last_became_peered":"2023-11-16T02:30:19.465726+0000","last_unstale":"2023-11-16T02:30:19.834349+0000","last_undegraded":"2023-11-16T02:30:19.834349+0000","last_fullsized":"2023-11-16T02:30:19.834349+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:23:32.728712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878486+0000","last_change":"2023-11-16T02:30:19.867919+0000","last_active":"2023-11-16T02:30:19.878486+0000","last_peered":"2023-11-16T02:30:19.878486+0000","last_clean":"2023-11-16T02:30:19.878486+0000","last_became_active":"2023-11-16T02:30:19.867061+0000","last_became_peered":"2023-11-16T02:30:19.867061+0000","last_unstale":"2023-11-16T02:30:19.878486+0000","last_undegraded":"2023-11-16T02:30:19.878486+0000","last_fullsized":"2023-11-16T02:30:19.878486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:30:57.683829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.836643+0000","last_change":"2023-11-16T02:30:19.472891+0000","last_active":"2023-11-16T02:30:19.836643+0000","last_peered":"2023-11-16T02:30:19.836643+0000","last_clean":"2023-11-16T02:30:19.836643+0000","last_became_active":"2023-11-16T02:30:19.472450+0000","last_became_peered":"2023-11-16T02:30:19.472450+0000","last_unstale":"2023-11-16T02:30:19.836643+0000","last_undegraded":"2023-11-16T02:30:19.836643+0000","last_fullsized":"2023-11-16T02:30:19.836643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:34:32.414746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.848452+0000","last_change":"2023-11-16T02:30:19.840186+0000","last_active":"2023-11-16T02:30:19.848452+0000","last_peered":"2023-11-16T02:30:19.848452+0000","last_clean":"2023-11-16T02:30:19.848452+0000","last_became_active":"2023-11-16T02:30:19.839901+0000","last_became_peered":"2023-11-16T02:30:19.839901+0000","last_unstale":"2023-11-16T02:30:19.848452+0000","last_undegraded":"2023-11-16T02:30:19.848452+0000","last_fullsized":"2023-11-16T02:30:19.848452+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:00:28.306611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.829875+0000","last_change":"2023-11-16T02:30:19.467692+0000","last_active":"2023-11-16T02:30:19.829875+0000","last_peered":"2023-11-16T02:30:19.829875+0000","last_clean":"2023-11-16T02:30:19.829875+0000","last_became_active":"2023-11-16T02:30:19.467180+0000","last_became_peered":"2023-11-16T02:30:19.467180+0000","last_unstale":"2023-11-16T02:30:19.829875+0000","last_undegraded":"2023-11-16T02:30:19.829875+0000","last_fullsized":"2023-11-16T02:30:19.829875+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:02:05.395662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878009+0000","last_change":"2023-11-16T02:30:19.877297+0000","last_active":"2023-11-16T02:30:19.878009+0000","last_peered":"2023-11-16T02:30:19.878009+0000","last_clean":"2023-11-16T02:30:19.878009+0000","last_became_active":"2023-11-16T02:30:19.876717+0000","last_became_peered":"2023-11-16T02:30:19.876717+0000","last_unstale":"2023-11-16T02:30:19.878009+0000","last_undegraded":"2023-11-16T02:30:19.878009+0000","last_fullsized":"2023-11-16T02:30:19.878009+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:00:21.607056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.888776+0000","last_change":"2023-11-16T02:30:19.482605+0000","last_active":"2023-11-16T02:30:19.888776+0000","last_peered":"2023-11-16T02:30:19.888776+0000","last_clean":"2023-11-16T02:30:19.888776+0000","last_became_active":"2023-11-16T02:30:19.481717+0000","last_became_peered":"2023-11-16T02:30:19.481717+0000","last_unstale":"2023-11-16T02:30:19.888776+0000","last_undegraded":"2023-11-16T02:30:19.888776+0000","last_fullsized":"2023-11-16T02:30:19.888776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:27:42.254533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878420+0000","last_change":"2023-11-16T02:30:19.868734+0000","last_active":"2023-11-16T02:30:19.878420+0000","last_peered":"2023-11-16T02:30:19.878420+0000","last_clean":"2023-11-16T02:30:19.878420+0000","last_became_active":"2023-11-16T02:30:19.868028+0000","last_became_peered":"2023-11-16T02:30:19.868028+0000","last_unstale":"2023-11-16T02:30:19.878420+0000","last_undegraded":"2023-11-16T02:30:19.878420+0000","last_fullsized":"2023-11-16T02:30:19.878420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:29:41.914615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.880000+0000","last_change":"2023-11-16T02:30:19.465379+0000","last_active":"2023-11-16T02:30:19.880000+0000","last_peered":"2023-11-16T02:30:19.880000+0000","last_clean":"2023-11-16T02:30:19.880000+0000","last_became_active":"2023-11-16T02:30:19.464674+0000","last_became_peered":"2023-11-16T02:30:19.464674+0000","last_unstale":"2023-11-16T02:30:19.880000+0000","last_undegraded":"2023-11-16T02:30:19.880000+0000","last_fullsized":"2023-11-16T02:30:19.880000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:33:12.505379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.883395+0000","last_change":"2023-11-16T02:30:19.882010+0000","last_active":"2023-11-16T02:30:19.883395+0000","last_peered":"2023-11-16T02:30:19.883395+0000","last_clean":"2023-11-16T02:30:19.883395+0000","last_became_active":"2023-11-16T02:30:19.881685+0000","last_became_peered":"2023-11-16T02:30:19.881685+0000","last_unstale":"2023-11-16T02:30:19.883395+0000","last_undegraded":"2023-11-16T02:30:19.883395+0000","last_fullsized":"2023-11-16T02:30:19.883395+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:11:01.176911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.885297+0000","last_change":"2023-11-16T02:30:19.467910+0000","last_active":"2023-11-16T02:30:19.885297+0000","last_peered":"2023-11-16T02:30:19.885297+0000","last_clean":"2023-11-16T02:30:19.885297+0000","last_became_active":"2023-11-16T02:30:19.467432+0000","last_became_peered":"2023-11-16T02:30:19.467432+0000","last_unstale":"2023-11-16T02:30:19.885297+0000","last_undegraded":"2023-11-16T02:30:19.885297+0000","last_fullsized":"2023-11-16T02:30:19.885297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:59:51.546762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.850327+0000","last_change":"2023-11-16T02:30:19.840706+0000","last_active":"2023-11-16T02:30:19.850327+0000","last_peered":"2023-11-16T02:30:19.850327+0000","last_clean":"2023-11-16T02:30:19.850327+0000","last_became_active":"2023-11-16T02:30:19.840310+0000","last_became_peered":"2023-11-16T02:30:19.840310+0000","last_unstale":"2023-11-16T02:30:19.850327+0000","last_undegraded":"2023-11-16T02:30:19.850327+0000","last_fullsized":"2023-11-16T02:30:19.850327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:01:25.904236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.835925+0000","last_change":"2023-11-16T02:30:19.467641+0000","last_active":"2023-11-16T02:30:19.835925+0000","last_peered":"2023-11-16T02:30:19.835925+0000","last_clean":"2023-11-16T02:30:19.835925+0000","last_became_active":"2023-11-16T02:30:19.467184+0000","last_became_peered":"2023-11-16T02:30:19.467184+0000","last_unstale":"2023-11-16T02:30:19.835925+0000","last_undegraded":"2023-11-16T02:30:19.835925+0000","last_fullsized":"2023-11-16T02:30:19.835925+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:40:26.674869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893121+0000","last_change":"2023-11-16T02:30:19.881218+0000","last_active":"2023-11-16T02:30:19.893121+0000","last_peered":"2023-11-16T02:30:19.893121+0000","last_clean":"2023-11-16T02:30:19.893121+0000","last_became_active":"2023-11-16T02:30:19.879762+0000","last_became_peered":"2023-11-16T02:30:19.879762+0000","last_unstale":"2023-11-16T02:30:19.893121+0000","last_undegraded":"2023-11-16T02:30:19.893121+0000","last_fullsized":"2023-11-16T02:30:19.893121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:01:25.904236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.835106+0000","last_change":"2023-11-16T02:30:19.472885+0000","last_active":"2023-11-16T02:30:19.835106+0000","last_peered":"2023-11-16T02:30:19.835106+0000","last_clean":"2023-11-16T02:30:19.835106+0000","last_became_active":"2023-11-16T02:30:19.472418+0000","last_became_peered":"2023-11-16T02:30:19.472418+0000","last_unstale":"2023-11-16T02:30:19.835106+0000","last_undegraded":"2023-11-16T02:30:19.835106+0000","last_fullsized":"2023-11-16T02:30:19.835106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:05:24.207641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.891248+0000","last_change":"2023-11-16T02:30:19.880084+0000","last_active":"2023-11-16T02:30:19.891248+0000","last_peered":"2023-11-16T02:30:19.891248+0000","last_clean":"2023-11-16T02:30:19.891248+0000","last_became_active":"2023-11-16T02:30:19.879577+0000","last_became_peered":"2023-11-16T02:30:19.879577+0000","last_unstale":"2023-11-16T02:30:19.891248+0000","last_undegraded":"2023-11-16T02:30:19.891248+0000","last_fullsized":"2023-11-16T02:30:19.891248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:05:25.212455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.858621+0000","last_change":"2023-11-16T02:30:19.459454+0000","last_active":"2023-11-16T02:30:19.858621+0000","last_peered":"2023-11-16T02:30:19.858621+0000","last_clean":"2023-11-16T02:30:19.858621+0000","last_became_active":"2023-11-16T02:30:19.458959+0000","last_became_peered":"2023-11-16T02:30:19.458959+0000","last_unstale":"2023-11-16T02:30:19.858621+0000","last_undegraded":"2023-11-16T02:30:19.858621+0000","last_fullsized":"2023-11-16T02:30:19.858621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:27:42.254533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.890110+0000","last_change":"2023-11-16T02:30:19.877024+0000","last_active":"2023-11-16T02:30:19.890110+0000","last_peered":"2023-11-16T02:30:19.890110+0000","last_clean":"2023-11-16T02:30:19.890110+0000","last_became_active":"2023-11-16T02:30:19.876487+0000","last_became_peered":"2023-11-16T02:30:19.876487+0000","last_unstale":"2023-11-16T02:30:19.890110+0000","last_undegraded":"2023-11-16T02:30:19.890110+0000","last_fullsized":"2023-11-16T02:30:19.890110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:30:57.683829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.852631+0000","last_change":"2023-11-16T02:30:19.461811+0000","last_active":"2023-11-16T02:30:19.852631+0000","last_peered":"2023-11-16T02:30:19.852631+0000","last_clean":"2023-11-16T02:30:19.852631+0000","last_became_active":"2023-11-16T02:30:19.460313+0000","last_became_peered":"2023-11-16T02:30:19.460313+0000","last_unstale":"2023-11-16T02:30:19.852631+0000","last_undegraded":"2023-11-16T02:30:19.852631+0000","last_fullsized":"2023-11-16T02:30:19.852631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:02:05.395662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.887669+0000","last_change":"2023-11-16T02:30:19.885693+0000","last_active":"2023-11-16T02:30:19.887669+0000","last_peered":"2023-11-16T02:30:19.887669+0000","last_clean":"2023-11-16T02:30:19.887669+0000","last_became_active":"2023-11-16T02:30:19.885102+0000","last_became_peered":"2023-11-16T02:30:19.885102+0000","last_unstale":"2023-11-16T02:30:19.887669+0000","last_undegraded":"2023-11-16T02:30:19.887669+0000","last_fullsized":"2023-11-16T02:30:19.887669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:59:15.040356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.877415+0000","last_change":"2023-11-16T02:30:19.477174+0000","last_active":"2023-11-16T02:30:19.877415+0000","last_peered":"2023-11-16T02:30:19.877415+0000","last_clean":"2023-11-16T02:30:19.877415+0000","last_became_active":"2023-11-16T02:30:19.475945+0000","last_became_peered":"2023-11-16T02:30:19.475945+0000","last_unstale":"2023-11-16T02:30:19.877415+0000","last_undegraded":"2023-11-16T02:30:19.877415+0000","last_fullsized":"2023-11-16T02:30:19.877415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:29:26.977995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.883430+0000","last_change":"2023-11-16T02:30:19.882218+0000","last_active":"2023-11-16T02:30:19.883430+0000","last_peered":"2023-11-16T02:30:19.883430+0000","last_clean":"2023-11-16T02:30:19.883430+0000","last_became_active":"2023-11-16T02:30:19.881908+0000","last_became_peered":"2023-11-16T02:30:19.881908+0000","last_unstale":"2023-11-16T02:30:19.883430+0000","last_undegraded":"2023-11-16T02:30:19.883430+0000","last_fullsized":"2023-11-16T02:30:19.883430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:24:43.125348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.876969+0000","last_change":"2023-11-16T02:30:19.470192+0000","last_active":"2023-11-16T02:30:19.876969+0000","last_peered":"2023-11-16T02:30:19.876969+0000","last_clean":"2023-11-16T02:30:19.876969+0000","last_became_active":"2023-11-16T02:30:19.469472+0000","last_became_peered":"2023-11-16T02:30:19.469472+0000","last_unstale":"2023-11-16T02:30:19.876969+0000","last_undegraded":"2023-11-16T02:30:19.876969+0000","last_fullsized":"2023-11-16T02:30:19.876969+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:17:41.856951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.836885+0000","last_change":"2023-11-16T02:30:19.468369+0000","last_active":"2023-11-16T02:30:19.836885+0000","last_peered":"2023-11-16T02:30:19.836885+0000","last_clean":"2023-11-16T02:30:19.836885+0000","last_became_active":"2023-11-16T02:30:19.467924+0000","last_became_peered":"2023-11-16T02:30:19.467924+0000","last_unstale":"2023-11-16T02:30:19.836885+0000","last_undegraded":"2023-11-16T02:30:19.836885+0000","last_fullsized":"2023-11-16T02:30:19.836885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:30:11.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.853040+0000","last_change":"2023-11-16T02:30:19.467061+0000","last_active":"2023-11-16T02:30:19.853040+0000","last_peered":"2023-11-16T02:30:19.853040+0000","last_clean":"2023-11-16T02:30:19.853040+0000","last_became_active":"2023-11-16T02:30:19.466792+0000","last_became_peered":"2023-11-16T02:30:19.466792+0000","last_unstale":"2023-11-16T02:30:19.853040+0000","last_undegraded":"2023-11-16T02:30:19.853040+0000","last_fullsized":"2023-11-16T02:30:19.853040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T02:52:12.747285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.836867+0000","last_change":"2023-11-16T02:30:19.465478+0000","last_active":"2023-11-16T02:30:19.836867+0000","last_peered":"2023-11-16T02:30:19.836867+0000","last_clean":"2023-11-16T02:30:19.836867+0000","last_became_active":"2023-11-16T02:30:19.464658+0000","last_became_peered":"2023-11-16T02:30:19.464658+0000","last_unstale":"2023-11-16T02:30:19.836867+0000","last_undegraded":"2023-11-16T02:30:19.836867+0000","last_fullsized":"2023-11-16T02:30:19.836867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:23:32.728712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.834793+0000","last_change":"2023-11-16T02:30:19.485044+0000","last_active":"2023-11-16T02:30:19.834793+0000","last_peered":"2023-11-16T02:30:19.834793+0000","last_clean":"2023-11-16T02:30:19.834793+0000","last_became_active":"2023-11-16T02:30:19.484575+0000","last_became_peered":"2023-11-16T02:30:19.484575+0000","last_unstale":"2023-11-16T02:30:19.834793+0000","last_undegraded":"2023-11-16T02:30:19.834793+0000","last_fullsized":"2023-11-16T02:30:19.834793+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:48:59.158704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893198+0000","last_change":"2023-11-16T02:30:19.881226+0000","last_active":"2023-11-16T02:30:19.893198+0000","last_peered":"2023-11-16T02:30:19.893198+0000","last_clean":"2023-11-16T02:30:19.893198+0000","last_became_active":"2023-11-16T02:30:19.880563+0000","last_became_peered":"2023-11-16T02:30:19.880563+0000","last_unstale":"2023-11-16T02:30:19.893198+0000","last_undegraded":"2023-11-16T02:30:19.893198+0000","last_fullsized":"2023-11-16T02:30:19.893198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:04:02.319109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.842049+0000","last_change":"2023-11-16T02:30:19.482268+0000","last_active":"2023-11-16T02:30:19.842049+0000","last_peered":"2023-11-16T02:30:19.842049+0000","last_clean":"2023-11-16T02:30:19.842049+0000","last_became_active":"2023-11-16T02:30:19.481547+0000","last_became_peered":"2023-11-16T02:30:19.481547+0000","last_unstale":"2023-11-16T02:30:19.842049+0000","last_undegraded":"2023-11-16T02:30:19.842049+0000","last_fullsized":"2023-11-16T02:30:19.842049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:53:29.543335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.881681+0000","last_change":"2023-11-16T02:30:19.486403+0000","last_active":"2023-11-16T02:30:19.881681+0000","last_peered":"2023-11-16T02:30:19.881681+0000","last_clean":"2023-11-16T02:30:19.881681+0000","last_became_active":"2023-11-16T02:30:19.485982+0000","last_became_peered":"2023-11-16T02:30:19.485982+0000","last_unstale":"2023-11-16T02:30:19.881681+0000","last_undegraded":"2023-11-16T02:30:19.881681+0000","last_fullsized":"2023-11-16T02:30:19.881681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T02:52:12.747285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878779+0000","last_change":"2023-11-16T02:30:19.868154+0000","last_active":"2023-11-16T02:30:19.878779+0000","last_peered":"2023-11-16T02:30:19.878779+0000","last_clean":"2023-11-16T02:30:19.878779+0000","last_became_active":"2023-11-16T02:30:19.867219+0000","last_became_peered":"2023-11-16T02:30:19.867219+0000","last_unstale":"2023-11-16T02:30:19.878779+0000","last_undegraded":"2023-11-16T02:30:19.878779+0000","last_fullsized":"2023-11-16T02:30:19.878779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:04:02.319109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.829792+0000","last_change":"2023-11-16T02:30:19.467493+0000","last_active":"2023-11-16T02:30:19.829792+0000","last_peered":"2023-11-16T02:30:19.829792+0000","last_clean":"2023-11-16T02:30:19.829792+0000","last_became_active":"2023-11-16T02:30:19.466854+0000","last_became_peered":"2023-11-16T02:30:19.466854+0000","last_unstale":"2023-11-16T02:30:19.829792+0000","last_undegraded":"2023-11-16T02:30:19.829792+0000","last_fullsized":"2023-11-16T02:30:19.829792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:40:26.674869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.843656+0000","last_change":"2023-11-16T02:30:19.839272+0000","last_active":"2023-11-16T02:30:19.843656+0000","last_peered":"2023-11-16T02:30:19.843656+0000","last_clean":"2023-11-16T02:30:19.843656+0000","last_became_active":"2023-11-16T02:30:19.838628+0000","last_became_peered":"2023-11-16T02:30:19.838628+0000","last_unstale":"2023-11-16T02:30:19.843656+0000","last_undegraded":"2023-11-16T02:30:19.843656+0000","last_fullsized":"2023-11-16T02:30:19.843656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:34:33.419560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.835792+0000","last_change":"2023-11-16T02:30:19.468928+0000","last_active":"2023-11-16T02:30:19.835792+0000","last_peered":"2023-11-16T02:30:19.835792+0000","last_clean":"2023-11-16T02:30:19.835792+0000","last_became_active":"2023-11-16T02:30:19.468602+0000","last_became_peered":"2023-11-16T02:30:19.468602+0000","last_unstale":"2023-11-16T02:30:19.835792+0000","last_undegraded":"2023-11-16T02:30:19.835792+0000","last_fullsized":"2023-11-16T02:30:19.835792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:30:11.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.871844+0000","last_change":"2023-11-16T02:30:19.859362+0000","last_active":"2023-11-16T02:30:19.871844+0000","last_peered":"2023-11-16T02:30:19.871844+0000","last_clean":"2023-11-16T02:30:19.871844+0000","last_became_active":"2023-11-16T02:30:19.858630+0000","last_became_peered":"2023-11-16T02:30:19.858630+0000","last_unstale":"2023-11-16T02:30:19.871844+0000","last_undegraded":"2023-11-16T02:30:19.871844+0000","last_fullsized":"2023-11-16T02:30:19.871844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:11:46.387664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.829236+0000","last_change":"2023-11-16T02:30:19.482379+0000","last_active":"2023-11-16T02:30:19.829236+0000","last_peered":"2023-11-16T02:30:19.829236+0000","last_clean":"2023-11-16T02:30:19.829236+0000","last_became_active":"2023-11-16T02:30:19.481905+0000","last_became_peered":"2023-11-16T02:30:19.481905+0000","last_unstale":"2023-11-16T02:30:19.829236+0000","last_undegraded":"2023-11-16T02:30:19.829236+0000","last_fullsized":"2023-11-16T02:30:19.829236+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:30:11.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.860430+0000","last_change":"2023-11-16T02:30:19.859522+0000","last_active":"2023-11-16T02:30:19.860430+0000","last_peered":"2023-11-16T02:30:19.860430+0000","last_clean":"2023-11-16T02:30:19.860430+0000","last_became_active":"2023-11-16T02:30:19.859274+0000","last_became_peered":"2023-11-16T02:30:19.859274+0000","last_unstale":"2023-11-16T02:30:19.860430+0000","last_undegraded":"2023-11-16T02:30:19.860430+0000","last_fullsized":"2023-11-16T02:30:19.860430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:17:17.336842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.836027+0000","last_change":"2023-11-16T02:30:19.481967+0000","last_active":"2023-11-16T02:30:19.836027+0000","last_peered":"2023-11-16T02:30:19.836027+0000","last_clean":"2023-11-16T02:30:19.836027+0000","last_became_active":"2023-11-16T02:30:19.481503+0000","last_became_peered":"2023-11-16T02:30:19.481503+0000","last_unstale":"2023-11-16T02:30:19.836027+0000","last_undegraded":"2023-11-16T02:30:19.836027+0000","last_fullsized":"2023-11-16T02:30:19.836027+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:55:12.932877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.852314+0000","last_change":"2023-11-16T02:30:19.840571+0000","last_active":"2023-11-16T02:30:19.852314+0000","last_peered":"2023-11-16T02:30:19.852314+0000","last_clean":"2023-11-16T02:30:19.852314+0000","last_became_active":"2023-11-16T02:30:19.840277+0000","last_became_peered":"2023-11-16T02:30:19.840277+0000","last_unstale":"2023-11-16T02:30:19.852314+0000","last_undegraded":"2023-11-16T02:30:19.852314+0000","last_fullsized":"2023-11-16T02:30:19.852314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:59:15.040356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.835041+0000","last_change":"2023-11-16T02:30:19.485297+0000","last_active":"2023-11-16T02:30:19.835041+0000","last_peered":"2023-11-16T02:30:19.835041+0000","last_clean":"2023-11-16T02:30:19.835041+0000","last_became_active":"2023-11-16T02:30:19.484515+0000","last_became_peered":"2023-11-16T02:30:19.484515+0000","last_unstale":"2023-11-16T02:30:19.835041+0000","last_undegraded":"2023-11-16T02:30:19.835041+0000","last_fullsized":"2023-11-16T02:30:19.835041+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:52:21.172818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.884462+0000","last_change":"2023-11-16T02:30:19.864997+0000","last_active":"2023-11-16T02:30:19.884462+0000","last_peered":"2023-11-16T02:30:19.884462+0000","last_clean":"2023-11-16T02:30:19.884462+0000","last_became_active":"2023-11-16T02:30:19.864281+0000","last_became_peered":"2023-11-16T02:30:19.864281+0000","last_unstale":"2023-11-16T02:30:19.884462+0000","last_undegraded":"2023-11-16T02:30:19.884462+0000","last_fullsized":"2023-11-16T02:30:19.884462+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:05:48.808451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.832593+0000","last_change":"2023-11-16T02:30:19.480325+0000","last_active":"2023-11-16T02:30:19.832593+0000","last_peered":"2023-11-16T02:30:19.832593+0000","last_clean":"2023-11-16T02:30:19.832593+0000","last_became_active":"2023-11-16T02:30:19.480062+0000","last_became_peered":"2023-11-16T02:30:19.480062+0000","last_unstale":"2023-11-16T02:30:19.832593+0000","last_undegraded":"2023-11-16T02:30:19.832593+0000","last_fullsized":"2023-11-16T02:30:19.832593+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:17:16.332028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893192+0000","last_change":"2023-11-16T02:30:19.884211+0000","last_active":"2023-11-16T02:30:19.893192+0000","last_peered":"2023-11-16T02:30:19.893192+0000","last_clean":"2023-11-16T02:30:19.893192+0000","last_became_active":"2023-11-16T02:30:19.880825+0000","last_became_peered":"2023-11-16T02:30:19.880825+0000","last_unstale":"2023-11-16T02:30:19.893192+0000","last_undegraded":"2023-11-16T02:30:19.893192+0000","last_fullsized":"2023-11-16T02:30:19.893192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:00:28.306611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.834224+0000","last_change":"2023-11-16T02:30:19.479112+0000","last_active":"2023-11-16T02:30:19.834224+0000","last_peered":"2023-11-16T02:30:19.834224+0000","last_clean":"2023-11-16T02:30:19.834224+0000","last_became_active":"2023-11-16T02:30:19.478459+0000","last_became_peered":"2023-11-16T02:30:19.478459+0000","last_unstale":"2023-11-16T02:30:19.834224+0000","last_undegraded":"2023-11-16T02:30:19.834224+0000","last_fullsized":"2023-11-16T02:30:19.834224+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:55:12.932877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.466612+0000","last_change":"2023-11-16T02:29:27.538359+0000","last_active":"2023-11-16T02:30:19.466612+0000","last_peered":"2023-11-16T02:30:19.466612+0000","last_clean":"2023-11-16T02:30:19.466612+0000","last_became_active":"2023-11-16T02:29:27.536606+0000","last_became_peered":"2023-11-16T02:29:27.536606+0000","last_unstale":"2023-11-16T02:30:19.466612+0000","last_undegraded":"2023-11-16T02:30:19.466612+0000","last_fullsized":"2023-11-16T02:30:19.466612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:26.491990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:26.491990+0000","last_clean_scrub_stamp":"2023-11-16T02:29:26.491990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:29:40.434297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":112,"acting":112,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":933888,"data_stored":716897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":360448,"data_stored":133920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":339968,"data_stored":126529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]}]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":339968,"data_stored":126529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":368640,"data_stored":134890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":339968,"data_stored":126529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":946176,"data_stored":723672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":327680,"data_stored":120262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-16T02:30:23.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-11-16T02:30:23.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-16T02:30:19.425814+0000', 'last_change': '2023-11-16T02:30:19.425814+0000', 'last_active': '2023-11-16T02:30:19.425814+0000', 'last_peered': '2023-11-16T02:30:19.425814+0000', 'last_clean': '2023-11-16T02:30:19.425814+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-16T02:30:19.425814+0000', 'last_undegraded': '2023-11-16T02:30:19.425814+0000', 'last_fullsized': '2023-11-16T02:30:19.425814+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-16T02:30:19.425814+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-16T02:30:19.425814+0000', 'last_clean_scrub_stamp': '2023-11-16T02:30:19.425814+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-16T02:30:23.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-11-16T02:30:23.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-16T02:30:19.425814+0000', 'last_change': '2023-11-16T02:30:19.425814+0000', 'last_active': '2023-11-16T02:30:19.425814+0000', 'last_peered': '2023-11-16T02:30:19.425814+0000', 'last_clean': '2023-11-16T02:30:19.425814+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-16T02:30:19.425814+0000', 'last_undegraded': '2023-11-16T02:30:19.425814+0000', 'last_fullsized': '2023-11-16T02:30:19.425814+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-16T02:30:19.425814+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-16T02:30:19.425814+0000', 'last_clean_scrub_stamp': '2023-11-16T02:30:19.425814+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-16T02:30:23.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-11-16T02:30:23.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-16T02:30:19.425814+0000', 'last_change': '2023-11-16T02:30:19.425814+0000', 'last_active': '2023-11-16T02:30:19.425814+0000', 'last_peered': '2023-11-16T02:30:19.425814+0000', 'last_clean': '2023-11-16T02:30:19.425814+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-16T02:30:19.425814+0000', 'last_undegraded': '2023-11-16T02:30:19.425814+0000', 'last_fullsized': '2023-11-16T02:30:19.425814+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-16T02:30:19.425814+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-16T02:30:19.425814+0000', 'last_clean_scrub_stamp': '2023-11-16T02:30:19.425814+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-16T02:30:23.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-11-16T02:30:23.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-16T02:30:18.431898+0000', 'last_change': '2023-11-16T02:30:18.431898+0000', 'last_active': '2023-11-16T02:30:18.421000+0000', 'last_peered': '2023-11-16T02:30:18.421000+0000', 'last_clean': '2023-11-16T02:30:18.421000+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-16T02:30:18.431898+0000', 'last_undegraded': '2023-11-16T02:30:18.431898+0000', 'last_fullsized': '2023-11-16T02:30:18.431898+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-16T02:30:18.421000+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-16T02:30:18.421000+0000', 'last_clean_scrub_stamp': '2023-11-16T02:30:18.421000+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-17T07:15:52.039420+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-16T02:30:23.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-11-16T02:30:23.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-16T02:30:19.425814+0000', 'last_change': '2023-11-16T02:30:19.425814+0000', 'last_active': '2023-11-16T02:30:19.425814+0000', 'last_peered': '2023-11-16T02:30:19.425814+0000', 'last_clean': '2023-11-16T02:30:19.425814+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-16T02:30:19.425814+0000', 'last_undegraded': '2023-11-16T02:30:19.425814+0000', 'last_fullsized': '2023-11-16T02:30:19.425814+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-16T02:30:19.425814+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-16T02:30:19.425814+0000', 'last_clean_scrub_stamp': '2023-11-16T02:30:19.425814+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-16T02:30:23.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-11-16T02:30:23.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-16T02:30:19.425814+0000', 'last_change': '2023-11-16T02:30:19.425814+0000', 'last_active': '2023-11-16T02:30:19.425814+0000', 'last_peered': '2023-11-16T02:30:19.425814+0000', 'last_clean': '2023-11-16T02:30:19.425814+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-16T02:30:19.425814+0000', 'last_undegraded': '2023-11-16T02:30:19.425814+0000', 'last_fullsized': '2023-11-16T02:30:19.425814+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-16T02:30:19.425814+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-16T02:30:19.425814+0000', 'last_clean_scrub_stamp': '2023-11-16T02:30:19.425814+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-16T02:30:23.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-11-16T02:30:23.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-16T02:30:19.425814+0000', 'last_change': '2023-11-16T02:30:19.425814+0000', 'last_active': '2023-11-16T02:30:19.425814+0000', 'last_peered': '2023-11-16T02:30:19.425814+0000', 'last_clean': '2023-11-16T02:30:19.425814+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-16T02:30:19.425814+0000', 'last_undegraded': '2023-11-16T02:30:19.425814+0000', 'last_fullsized': '2023-11-16T02:30:19.425814+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-16T02:30:19.425814+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-16T02:30:19.425814+0000', 'last_clean_scrub_stamp': '2023-11-16T02:30:19.425814+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-16T02:30:23.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-11-16T02:30:23.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-16T02:30:19.425814+0000', 'last_change': '2023-11-16T02:30:19.425814+0000', 'last_active': '2023-11-16T02:30:19.425814+0000', 'last_peered': '2023-11-16T02:30:19.425814+0000', 'last_clean': '2023-11-16T02:30:19.425814+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-16T02:30:19.425814+0000', 'last_undegraded': '2023-11-16T02:30:19.425814+0000', 'last_fullsized': '2023-11-16T02:30:19.425814+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-16T02:30:19.425814+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-16T02:30:19.425814+0000', 'last_clean_scrub_stamp': '2023-11-16T02:30:19.425814+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-16T02:30:23.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-11-16T02:30:23.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-16T02:30:19.425814+0000', 'last_change': '2023-11-16T02:30:19.425814+0000', 'last_active': '2023-11-16T02:30:19.425814+0000', 'last_peered': '2023-11-16T02:30:19.425814+0000', 'last_clean': '2023-11-16T02:30:19.425814+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-16T02:30:19.425814+0000', 'last_undegraded': '2023-11-16T02:30:19.425814+0000', 'last_fullsized': '2023-11-16T02:30:19.425814+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-16T02:30:19.425814+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-16T02:30:19.425814+0000', 'last_clean_scrub_stamp': '2023-11-16T02:30:19.425814+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-16T02:30:23.537 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-16T02:30:23.657 INFO:tasks.ceph.mds.c.smithi028.stderr:2023-11-16T02:30:23.655+0000 7faaf479f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-16T02:30:23.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb2eb3e640 1 Processor -- start 2023-11-16T02:30:23.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb2eb3e640 1 -- start start 2023-11-16T02:30:23.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb2eb3e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb28148f40 0x7fdb2814f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:23.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb2eb3e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb2806f5f0 con 0x7fdb28149380 2023-11-16T02:30:23.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb2eb3e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb28070100 con 0x7fdb280bc900 2023-11-16T02:30:23.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb2eb3e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb28071430 con 0x7fdb28148f40 2023-11-16T02:30:23.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb2d0db640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fdb28149380 0x7fdb28159920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54302/0 (socket says 172.21.15.28:54302) 2023-11-16T02:30:23.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb2d0db640 1 -- 172.21.15.28:0/189576288 learned_addr learned my addr 172.21.15.28:0/189576288 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:23.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb27fff640 1 --2- 172.21.15.28:0/189576288 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb28148f40 0x7fdb2814f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:23.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb277fe640 1 -- 172.21.15.28:0/189576288 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192274683 0 0) 0x7fdb2806f5f0 con 0x7fdb28149380 2023-11-16T02:30:23.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb277fe640 1 -- 172.21.15.28:0/189576288 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb10003530 con 0x7fdb28149380 2023-11-16T02:30:23.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb277fe640 1 -- 172.21.15.28:0/189576288 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 369355205 0 0) 0x7fdb10003530 con 0x7fdb28149380 2023-11-16T02:30:23.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb277fe640 1 -- 172.21.15.28:0/189576288 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb28148f40 msgr2=0x7fdb2814f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:23.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb277fe640 1 --2- 172.21.15.28:0/189576288 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb28148f40 0x7fdb2814f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:23.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb277fe640 1 -- 172.21.15.28:0/189576288 >> v1:172.21.15.70:6789/0 conn(0x7fdb280bc900 legacy=0x7fdb2806edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:23.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb277fe640 1 -- 172.21.15.28:0/189576288 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb280703e0 con 0x7fdb28149380 2023-11-16T02:30:23.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb277fe640 1 -- 172.21.15.28:0/189576288 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7fdb20001a00 con 0x7fdb28149380 2023-11-16T02:30:23.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb277fe640 1 -- 172.21.15.28:0/189576288 >> v1:172.21.15.28:6789/0 conn(0x7fdb28149380 legacy=0x7fdb28159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:23.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb277fe640 1 --2- 172.21.15.28:0/189576288 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb28148f40 0x7fdb100039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:23.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb277fe640 1 --2- 172.21.15.28:0/189576288 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb10003f30 0x7fdb100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:23.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb277fe640 1 --2- 172.21.15.28:0/189576288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb10004d10 0x7fdb10005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:23.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb277fe640 1 -- 172.21.15.28:0/189576288 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1000bba0 con 0x7fdb10003f30 2023-11-16T02:30:23.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb277fe640 1 -- 172.21.15.28:0/189576288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1000bd10 con 0x7fdb10004d10 2023-11-16T02:30:23.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb277fe640 1 -- 172.21.15.28:0/189576288 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1000bed0 con 0x7fdb28148f40 2023-11-16T02:30:23.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb27fff640 1 --2- 172.21.15.28:0/189576288 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb10003f30 0x7fdb100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:23.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb2d0db640 1 --2- 172.21.15.28:0/189576288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb10004d10 0x7fdb10005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:23.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.695+0000 7fdb2c8da640 1 --2- 172.21.15.28:0/189576288 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb28148f40 0x7fdb100039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:23.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.699+0000 7fdb27fff640 1 -- 172.21.15.28:0/189576288 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb28148f40 msgr2=0x7fdb100039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:23.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.699+0000 7fdb27fff640 1 --2- 172.21.15.28:0/189576288 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb28148f40 0x7fdb100039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:23.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.699+0000 7fdb27fff640 1 -- 172.21.15.28:0/189576288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb10004d10 msgr2=0x7fdb10005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:23.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.699+0000 7fdb27fff640 1 --2- 172.21.15.28:0/189576288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb10004d10 0x7fdb10005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:23.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.699+0000 7fdb27fff640 1 -- 172.21.15.28:0/189576288 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb10003530 con 0x7fdb10003f30 2023-11-16T02:30:23.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.699+0000 7fdb27fff640 1 --2- 172.21.15.28:0/189576288 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb10003f30 0x7fdb100047d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c009ae0 tx=0x7fdb1c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b526e0b54257891 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:23.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.699+0000 7fdb277fe640 1 -- 172.21.15.28:0/189576288 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c0a5640 con 0x7fdb10003f30 2023-11-16T02:30:23.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.699+0000 7fdb277fe640 1 -- 172.21.15.28:0/189576288 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1c0a57a0 con 0x7fdb10003f30 2023-11-16T02:30:23.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.699+0000 7fdb277fe640 1 -- 172.21.15.28:0/189576288 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c0a5b50 con 0x7fdb10003f30 2023-11-16T02:30:23.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.699+0000 7fdb2eb3e640 1 -- 172.21.15.28:0/189576288 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb10003f30 msgr2=0x7fdb100047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:23.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.699+0000 7fdb2eb3e640 1 --2- 172.21.15.28:0/189576288 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb10003f30 0x7fdb100047d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c009ae0 tx=0x7fdb1c01ca50 comp rx=0 tx=0).stop 2023-11-16T02:30:23.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.699+0000 7fdb2d0db640 1 -- 172.21.15.28:0/189576288 reap_dead start 2023-11-16T02:30:23.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.699+0000 7fdb2eb3e640 1 -- 172.21.15.28:0/189576288 shutdown_connections 2023-11-16T02:30:23.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.699+0000 7fdb2eb3e640 1 -- 172.21.15.28:0/189576288 >> 172.21.15.28:0/189576288 conn(0x7fdb280b9050 msgr2=0x7fdb280bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:23.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb2eb3e640 1 -- 172.21.15.28:0/189576288 shutdown_connections 2023-11-16T02:30:23.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb2eb3e640 1 -- 172.21.15.28:0/189576288 wait complete. 2023-11-16T02:30:23.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb2eb3e640 1 Processor -- start 2023-11-16T02:30:23.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb2eb3e640 1 -- start start 2023-11-16T02:30:23.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb2eb3e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb2814d070 0x7fdb2814dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:23.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb2eb3e640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb281e72a0 0x7fdb281e7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:23.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb2eb3e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb28159bf0 0x7fdb2815a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:23.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb2eb3e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2814ea80 con 0x7fdb28159bf0 2023-11-16T02:30:23.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb2eb3e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2814e3e0 con 0x7fdb2814d070 2023-11-16T02:30:23.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb2eb3e640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb281e7c40 con 0x7fdb281e72a0 2023-11-16T02:30:23.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb2d0db640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb28159bf0 0x7fdb2815a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:23.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb2d0db640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb28159bf0 0x7fdb2815a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54258/0 (socket says 172.21.15.28:54258) 2023-11-16T02:30:23.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb2d0db640 1 -- 172.21.15.28:0/755719302 learned_addr learned my addr 172.21.15.28:0/755719302 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:23.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb2c8da640 1 --2- 172.21.15.28:0/755719302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb2814d070 0x7fdb2814dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:23.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb27fff640 1 --2- 172.21.15.28:0/755719302 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb281e72a0 0x7fdb281e7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:23.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb2d0db640 1 -- 172.21.15.28:0/755719302 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb281e72a0 msgr2=0x7fdb281e7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:23.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb2d0db640 1 --2- 172.21.15.28:0/755719302 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb281e72a0 0x7fdb281e7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:23.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb2d0db640 1 -- 172.21.15.28:0/755719302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb2814d070 msgr2=0x7fdb2814dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:23.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb2d0db640 1 --2- 172.21.15.28:0/755719302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb2814d070 0x7fdb2814dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:23.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb2d0db640 1 -- 172.21.15.28:0/755719302 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2814ed00 con 0x7fdb28159bf0 2023-11-16T02:30:23.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb2c8da640 1 --2- 172.21.15.28:0/755719302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb2814d070 0x7fdb2814dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:30:23.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb2d0db640 1 --2- 172.21.15.28:0/755719302 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb28159bf0 0x7fdb2815a070 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdb20004bd0 tx=0x7fdb2000e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:23.710 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb257fa640 1 -- 172.21.15.28:0/755719302 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb20013420 con 0x7fdb28159bf0 2023-11-16T02:30:23.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb257fa640 1 -- 172.21.15.28:0/755719302 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb20013580 con 0x7fdb28159bf0 2023-11-16T02:30:23.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb2eb3e640 1 -- 172.21.15.28:0/755719302 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb28154db0 con 0x7fdb28159bf0 2023-11-16T02:30:23.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb257fa640 1 -- 172.21.15.28:0/755719302 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb20013930 con 0x7fdb28159bf0 2023-11-16T02:30:23.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb2eb3e640 1 -- 172.21.15.28:0/755719302 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb28155370 con 0x7fdb28159bf0 2023-11-16T02:30:23.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.703+0000 7fdb2eb3e640 1 -- 172.21.15.28:0/755719302 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb2804e8a0 con 0x7fdb28159bf0 2023-11-16T02:30:23.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.707+0000 7fdb257fa640 1 -- 172.21.15.28:0/755719302 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdb20013a90 con 0x7fdb28159bf0 2023-11-16T02:30:23.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.707+0000 7fdb257fa640 1 --2- 172.21.15.28:0/755719302 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fdb14065a60 0x7fdb14067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:23.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.707+0000 7fdb257fa640 1 -- 172.21.15.28:0/755719302 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb20083aa0 con 0x7fdb28159bf0 2023-11-16T02:30:23.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.707+0000 7fdb2c8da640 1 --2- 172.21.15.28:0/755719302 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fdb14065a60 0x7fdb14067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:23.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.707+0000 7fdb2c8da640 1 --2- 172.21.15.28:0/755719302 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fdb14065a60 0x7fdb14067f20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdb18005630 tx=0x7fdb18009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:23.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.711+0000 7fdb257fa640 1 -- 172.21.15.28:0/755719302 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fdb200513d0 con 0x7fdb28159bf0 2023-11-16T02:30:23.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.923+0000 7fdb2eb3e640 1 -- 172.21.15.28:0/755719302 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fdb28155560 con 0x7fdb28159bf0 2023-11-16T02:30:23.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.923+0000 7fdb257fa640 1 -- 172.21.15.28:0/755719302 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2658 (secure 0 0 0) 0x7fdb200549f0 con 0x7fdb28159bf0 2023-11-16T02:30:23.927 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:30:23.928 INFO:teuthology.orchestra.run.smithi028.stdout:{"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":70,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":33,"num_osds":8,"num_up_osds":8,"osd_up_since":1700101764,"num_in_osds":8,"osd_in_since":1700101756,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":88},{"state_name":"unknown","count":8},{"state_name":"creating+peering","count":1}],"num_pgs":97,"num_pools":3,"num_objects":22,"data_bytes":592730,"bytes_used":258301952,"bytes_avail":772835811328,"bytes_total":773094113280,"unknown_pgs_ratio":0.082474224269390106,"inactive_pgs_ratio":0.010309278033673763,"write_bytes_sec":3581,"read_op_per_sec":0,"write_op_per_sec":10},"fsmap":{"epoch":13,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":4950}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2023-11-16T02:30:20.428113+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-16T02:30:23.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.927+0000 7fdb2eb3e640 1 -- 172.21.15.28:0/755719302 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fdb14065a60 msgr2=0x7fdb14067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:23.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.927+0000 7fdb2eb3e640 1 --2- 172.21.15.28:0/755719302 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fdb14065a60 0x7fdb14067f20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdb18005630 tx=0x7fdb18009040 comp rx=0 tx=0).stop 2023-11-16T02:30:23.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.927+0000 7fdb2eb3e640 1 -- 172.21.15.28:0/755719302 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb28159bf0 msgr2=0x7fdb2815a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:23.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.927+0000 7fdb2eb3e640 1 --2- 172.21.15.28:0/755719302 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb28159bf0 0x7fdb2815a070 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdb20004bd0 tx=0x7fdb2000e5f0 comp rx=0 tx=0).stop 2023-11-16T02:30:23.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.927+0000 7fdb2eb3e640 1 -- 172.21.15.28:0/755719302 shutdown_connections 2023-11-16T02:30:23.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.927+0000 7fdb2eb3e640 1 --2- 172.21.15.28:0/755719302 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fdb14065a60 0x7fdb14067f20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:23.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.927+0000 7fdb2eb3e640 1 --2- 172.21.15.28:0/755719302 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb28159bf0 0x7fdb2815a070 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:23.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.927+0000 7fdb2eb3e640 1 --2- 172.21.15.28:0/755719302 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fdb281e72a0 0x7fdb281e7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:23.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.927+0000 7fdb2eb3e640 1 --2- 172.21.15.28:0/755719302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb2814d070 0x7fdb2814dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:23.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.927+0000 7fdb2eb3e640 1 -- 172.21.15.28:0/755719302 >> 172.21.15.28:0/755719302 conn(0x7fdb280b9050 msgr2=0x7fdb280ba580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:23.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.927+0000 7fdb2eb3e640 1 -- 172.21.15.28:0/755719302 shutdown_connections 2023-11-16T02:30:23.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:23.927+0000 7fdb2eb3e640 1 -- 172.21.15.28:0/755719302 wait complete. 2023-11-16T02:30:23.944 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-16T02:30:23.945 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-16T02:30:24.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b98ea640 1 Processor -- start 2023-11-16T02:30:24.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b98ea640 1 -- start start 2023-11-16T02:30:24.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b98ea640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54b40b32c0 0x7f54b40b8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:24.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b98ea640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b40708f0 con 0x7f54b40b8f70 2023-11-16T02:30:24.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b98ea640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b4070bb0 con 0x7f54b4070140 2023-11-16T02:30:24.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b98ea640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b40b2af0 con 0x7f54b40b32c0 2023-11-16T02:30:24.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b37fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f54b40b8f70 0x7f54b41428e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54316/0 (socket says 172.21.15.28:54316) 2023-11-16T02:30:24.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b37fe640 1 -- 172.21.15.28:0/1303945104 learned_addr learned my addr 172.21.15.28:0/1303945104 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:24.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b27fc640 1 --2- 172.21.15.28:0/1303945104 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54b40b32c0 0x7f54b40b8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:24.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b1ffb640 1 -- 172.21.15.28:0/1303945104 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1335454943 0 0) 0x7f54b40708f0 con 0x7f54b40b8f70 2023-11-16T02:30:24.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b1ffb640 1 -- 172.21.15.28:0/1303945104 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54a0003530 con 0x7f54b40b8f70 2023-11-16T02:30:24.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b1ffb640 1 -- 172.21.15.28:0/1303945104 <== mon.1 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465379254 0 0) 0x7f54b4070bb0 con 0x7f54b4070140 2023-11-16T02:30:24.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b1ffb640 1 -- 172.21.15.28:0/1303945104 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54b40708f0 con 0x7f54b4070140 2023-11-16T02:30:24.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b1ffb640 1 -- 172.21.15.28:0/1303945104 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4054905604 0 0) 0x7f54a0003530 con 0x7f54b40b8f70 2023-11-16T02:30:24.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b1ffb640 1 -- 172.21.15.28:0/1303945104 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54b40b32c0 msgr2=0x7f54b40b8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:24.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b1ffb640 1 --2- 172.21.15.28:0/1303945104 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54b40b32c0 0x7f54b40b8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:24.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b1ffb640 1 -- 172.21.15.28:0/1303945104 >> v1:172.21.15.70:6789/0 conn(0x7f54b4070140 legacy=0x7f54b4071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:24.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b1ffb640 1 -- 172.21.15.28:0/1303945104 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b4070e90 con 0x7f54b40b8f70 2023-11-16T02:30:24.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b1ffb640 1 -- 172.21.15.28:0/1303945104 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7f54a40016d0 con 0x7f54b40b8f70 2023-11-16T02:30:24.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b1ffb640 1 -- 172.21.15.28:0/1303945104 >> v1:172.21.15.28:6789/0 conn(0x7f54b40b8f70 legacy=0x7f54b41428e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:24.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b1ffb640 1 --2- 172.21.15.28:0/1303945104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54a0003b40 0x7f54a0003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:24.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b1ffb640 1 --2- 172.21.15.28:0/1303945104 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54a00047d0 0x7f54a0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:24.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b1ffb640 1 --2- 172.21.15.28:0/1303945104 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54b40b32c0 0x7f54a00051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:24.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b1ffb640 1 -- 172.21.15.28:0/1303945104 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b40b2af0 con 0x7f54a00047d0 2023-11-16T02:30:24.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b1ffb640 1 -- 172.21.15.28:0/1303945104 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a000bb20 con 0x7f54a0003b40 2023-11-16T02:30:24.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b1ffb640 1 -- 172.21.15.28:0/1303945104 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a000bcb0 con 0x7f54b40b32c0 2023-11-16T02:30:24.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b27fc640 1 --2- 172.21.15.28:0/1303945104 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54a00047d0 0x7f54a0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:24.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b2ffd640 1 --2- 172.21.15.28:0/1303945104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54a0003b40 0x7f54a0003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:24.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b37fe640 1 --2- 172.21.15.28:0/1303945104 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54b40b32c0 0x7f54a00051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:24.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b27fc640 1 -- 172.21.15.28:0/1303945104 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54b40b32c0 msgr2=0x7f54a00051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:24.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b27fc640 1 --2- 172.21.15.28:0/1303945104 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54b40b32c0 0x7f54a00051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:24.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b27fc640 1 -- 172.21.15.28:0/1303945104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54a0003b40 msgr2=0x7f54a0003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:24.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b27fc640 1 --2- 172.21.15.28:0/1303945104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54a0003b40 0x7f54a0003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:24.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b27fc640 1 -- 172.21.15.28:0/1303945104 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a0003530 con 0x7f54a00047d0 2023-11-16T02:30:24.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.063+0000 7f54b37fe640 1 --2- 172.21.15.28:0/1303945104 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54b40b32c0 0x7f54a00051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:24.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.067+0000 7f54b27fc640 1 --2- 172.21.15.28:0/1303945104 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54a00047d0 0x7f54a0004c50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f549c009ae0 tx=0x7f549c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35cd415695c4e0fd server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:24.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.067+0000 7f54b1ffb640 1 -- 172.21.15.28:0/1303945104 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c0a6510 con 0x7f54a00047d0 2023-11-16T02:30:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.067+0000 7f54b1ffb640 1 -- 172.21.15.28:0/1303945104 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c0a6670 con 0x7f54a00047d0 2023-11-16T02:30:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.067+0000 7f54b1ffb640 1 -- 172.21.15.28:0/1303945104 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c0a6a20 con 0x7f54a00047d0 2023-11-16T02:30:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.067+0000 7f54b98ea640 1 -- 172.21.15.28:0/1303945104 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54a00047d0 msgr2=0x7f54a0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.067+0000 7f54b98ea640 1 --2- 172.21.15.28:0/1303945104 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54a00047d0 0x7f54a0004c50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f549c009ae0 tx=0x7f549c01c9c0 comp rx=0 tx=0).stop 2023-11-16T02:30:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.067+0000 7f54b37fe640 1 -- 172.21.15.28:0/1303945104 reap_dead start 2023-11-16T02:30:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.067+0000 7f54b98ea640 1 -- 172.21.15.28:0/1303945104 shutdown_connections 2023-11-16T02:30:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.067+0000 7f54b98ea640 1 -- 172.21.15.28:0/1303945104 >> 172.21.15.28:0/1303945104 conn(0x7f54b40b9b20 msgr2=0x7f54b40b9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.067+0000 7f54b98ea640 1 -- 172.21.15.28:0/1303945104 shutdown_connections 2023-11-16T02:30:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.067+0000 7f54b98ea640 1 -- 172.21.15.28:0/1303945104 wait complete. 2023-11-16T02:30:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.067+0000 7f54b98ea640 1 Processor -- start 2023-11-16T02:30:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.067+0000 7f54b98ea640 1 -- start start 2023-11-16T02:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54b98ea640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54a00047d0 0x7f54b406dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54b98ea640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54b409d860 0x7f54b40bb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54b98ea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54b4140320 0x7f54b41407a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54b98ea640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b406e3e0 con 0x7f54b409d860 2023-11-16T02:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54b98ea640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b409ee40 con 0x7f54b4140320 2023-11-16T02:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54b98ea640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b40bc830 con 0x7f54a00047d0 2023-11-16T02:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54b27fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54b409d860 0x7f54b40bb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54b27fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54b409d860 0x7f54b40bb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54278/0 (socket says 172.21.15.28:54278) 2023-11-16T02:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54b27fc640 1 -- 172.21.15.28:0/1503604713 learned_addr learned my addr 172.21.15.28:0/1503604713 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54b37fe640 1 --2- 172.21.15.28:0/1503604713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54b4140320 0x7f54b41407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54b2ffd640 1 --2- 172.21.15.28:0/1503604713 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54a00047d0 0x7f54b406dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54b27fc640 1 -- 172.21.15.28:0/1503604713 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54a00047d0 msgr2=0x7f54b406dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54b27fc640 1 --2- 172.21.15.28:0/1503604713 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54a00047d0 0x7f54b406dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54b27fc640 1 -- 172.21.15.28:0/1503604713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54b4140320 msgr2=0x7f54b41407a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54b27fc640 1 --2- 172.21.15.28:0/1503604713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54b4140320 0x7f54b41407a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54b27fc640 1 -- 172.21.15.28:0/1503604713 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b409eb60 con 0x7f54b409d860 2023-11-16T02:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54b2ffd640 1 --2- 172.21.15.28:0/1503604713 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54a00047d0 0x7f54b406dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54b27fc640 1 --2- 172.21.15.28:0/1503604713 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54b409d860 0x7f54b40bb0c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f549c0b0040 tx=0x7f54a0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54abfff640 1 -- 172.21.15.28:0/1503604713 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c00f000 con 0x7f54b409d860 2023-11-16T02:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54abfff640 1 -- 172.21.15.28:0/1503604713 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c0a67e0 con 0x7f54b409d860 2023-11-16T02:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54b98ea640 1 -- 172.21.15.28:0/1503604713 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b40bc4c0 con 0x7f54b409d860 2023-11-16T02:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54abfff640 1 -- 172.21.15.28:0/1503604713 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c0a6b90 con 0x7f54b409d860 2023-11-16T02:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54b98ea640 1 -- 172.21.15.28:0/1503604713 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b409dcc0 con 0x7f54b409d860 2023-11-16T02:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54b98ea640 1 -- 172.21.15.28:0/1503604713 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b4066f00 con 0x7f54b409d860 2023-11-16T02:30:24.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54abfff640 1 -- 172.21.15.28:0/1503604713 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f549c0a6cf0 con 0x7f54b409d860 2023-11-16T02:30:24.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54abfff640 1 --2- 172.21.15.28:0/1503604713 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5494065a60 0x7f5494067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:24.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54b2ffd640 1 --2- 172.21.15.28:0/1503604713 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5494065a60 0x7f5494067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:24.078 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54abfff640 1 -- 172.21.15.28:0/1503604713 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f549c0aa070 con 0x7f54b409d860 2023-11-16T02:30:24.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.071+0000 7f54b2ffd640 1 --2- 172.21.15.28:0/1503604713 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5494065a60 0x7f5494067f20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f54ac001e50 tx=0x7f54ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:24.079 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.075+0000 7f54abfff640 1 -- 172.21.15.28:0/1503604713 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f549c0eb690 con 0x7f54b409d860 2023-11-16T02:30:24.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.231+0000 7f54b98ea640 1 -- 172.21.15.28:0/1503604713 --> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54b4070630 con 0x7f5494065a60 2023-11-16T02:30:24.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.235+0000 7f54abfff640 1 -- 172.21.15.28:0/1503604713 <== mgr.4104 v2:172.21.15.28:6832/38651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+263353 (secure 0 0 0) 0x7f54ac00d050 con 0x7f5494065a60 2023-11-16T02:30:24.242 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:30:24.244 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-11-16T02:30:24.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.243+0000 7f54b98ea640 1 -- 172.21.15.28:0/1503604713 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5494065a60 msgr2=0x7f5494067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:24.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.243+0000 7f54b98ea640 1 --2- 172.21.15.28:0/1503604713 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5494065a60 0x7f5494067f20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f54ac001e50 tx=0x7f54ac009040 comp rx=0 tx=0).stop 2023-11-16T02:30:24.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.243+0000 7f54b98ea640 1 -- 172.21.15.28:0/1503604713 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54b409d860 msgr2=0x7f54b40bb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:24.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.243+0000 7f54b98ea640 1 --2- 172.21.15.28:0/1503604713 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54b409d860 0x7f54b40bb0c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f549c0b0040 tx=0x7f54a0005800 comp rx=0 tx=0).stop 2023-11-16T02:30:24.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.243+0000 7f54b98ea640 1 -- 172.21.15.28:0/1503604713 shutdown_connections 2023-11-16T02:30:24.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.243+0000 7f54b98ea640 1 --2- 172.21.15.28:0/1503604713 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f5494065a60 0x7f5494067f20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:24.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.243+0000 7f54b98ea640 1 --2- 172.21.15.28:0/1503604713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54b4140320 0x7f54b41407a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:24.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.243+0000 7f54b98ea640 1 --2- 172.21.15.28:0/1503604713 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f54b409d860 0x7f54b40bb0c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:24.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.243+0000 7f54b98ea640 1 --2- 172.21.15.28:0/1503604713 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f54a00047d0 0x7f54b406dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:24.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.243+0000 7f54b98ea640 1 -- 172.21.15.28:0/1503604713 >> 172.21.15.28:0/1503604713 conn(0x7f54b40b9b20 msgr2=0x7f54b413d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:24.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.243+0000 7f54b98ea640 1 -- 172.21.15.28:0/1503604713 shutdown_connections 2023-11-16T02:30:24.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:24.243+0000 7f54b98ea640 1 -- 172.21.15.28:0/1503604713 wait complete. 2023-11-16T02:30:24.261 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-11-16T02:30:22.428531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":200,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":178,"acting":178,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252248,"kb_used_data":3864,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754722472,"statfs":{"total":773094113280,"available":772835811328,"internally_reserved":0,"allocated":3956736,"data_stored":2209228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":60,"apply_latency_ms":60,"commit_latency_ns":60000000,"apply_latency_ns":60000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.002315"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.884818+0000","last_change":"2023-11-16T02:30:19.870271+0000","last_active":"2023-11-16T02:30:19.884818+0000","last_peered":"2023-11-16T02:30:19.884818+0000","last_clean":"2023-11-16T02:30:19.884818+0000","last_became_active":"2023-11-16T02:30:19.869530+0000","last_became_peered":"2023-11-16T02:30:19.869530+0000","last_unstale":"2023-11-16T02:30:19.884818+0000","last_undegraded":"2023-11-16T02:30:19.884818+0000","last_fullsized":"2023-11-16T02:30:19.884818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:34:33.419560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.851719+0000","last_change":"2023-11-16T02:30:19.847500+0000","last_active":"2023-11-16T02:30:19.851719+0000","last_peered":"2023-11-16T02:30:19.851719+0000","last_clean":"2023-11-16T02:30:19.851719+0000","last_became_active":"2023-11-16T02:30:19.847125+0000","last_became_peered":"2023-11-16T02:30:19.847125+0000","last_unstale":"2023-11-16T02:30:19.851719+0000","last_undegraded":"2023-11-16T02:30:19.851719+0000","last_fullsized":"2023-11-16T02:30:19.851719+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:04:02.319109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878367+0000","last_change":"2023-11-16T02:30:19.866614+0000","last_active":"2023-11-16T02:30:19.878367+0000","last_peered":"2023-11-16T02:30:19.878367+0000","last_clean":"2023-11-16T02:30:19.878367+0000","last_became_active":"2023-11-16T02:30:19.865850+0000","last_became_peered":"2023-11-16T02:30:19.865850+0000","last_unstale":"2023-11-16T02:30:19.878367+0000","last_undegraded":"2023-11-16T02:30:19.878367+0000","last_fullsized":"2023-11-16T02:30:19.878367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:26:35.043805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.883440+0000","last_change":"2023-11-16T02:30:19.882299+0000","last_active":"2023-11-16T02:30:19.883440+0000","last_peered":"2023-11-16T02:30:19.883440+0000","last_clean":"2023-11-16T02:30:19.883440+0000","last_became_active":"2023-11-16T02:30:19.882012+0000","last_became_peered":"2023-11-16T02:30:19.882012+0000","last_unstale":"2023-11-16T02:30:19.883440+0000","last_undegraded":"2023-11-16T02:30:19.883440+0000","last_fullsized":"2023-11-16T02:30:19.883440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:05:48.808451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.873934+0000","last_change":"2023-11-16T02:30:19.873025+0000","last_active":"2023-11-16T02:30:19.873934+0000","last_peered":"2023-11-16T02:30:19.873934+0000","last_clean":"2023-11-16T02:30:19.873934+0000","last_became_active":"2023-11-16T02:30:19.872781+0000","last_became_peered":"2023-11-16T02:30:19.872781+0000","last_unstale":"2023-11-16T02:30:19.873934+0000","last_undegraded":"2023-11-16T02:30:19.873934+0000","last_fullsized":"2023-11-16T02:30:19.873934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:19:10.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893391+0000","last_change":"2023-11-16T02:30:19.886324+0000","last_active":"2023-11-16T02:30:19.893391+0000","last_peered":"2023-11-16T02:30:19.893391+0000","last_clean":"2023-11-16T02:30:19.893391+0000","last_became_active":"2023-11-16T02:30:19.885725+0000","last_became_peered":"2023-11-16T02:30:19.885725+0000","last_unstale":"2023-11-16T02:30:19.893391+0000","last_undegraded":"2023-11-16T02:30:19.893391+0000","last_fullsized":"2023-11-16T02:30:19.893391+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:29:41.914615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.890750+0000","last_change":"2023-11-16T02:30:19.874493+0000","last_active":"2023-11-16T02:30:19.890750+0000","last_peered":"2023-11-16T02:30:19.890750+0000","last_clean":"2023-11-16T02:30:19.890750+0000","last_became_active":"2023-11-16T02:30:19.872914+0000","last_became_peered":"2023-11-16T02:30:19.872914+0000","last_unstale":"2023-11-16T02:30:19.890750+0000","last_undegraded":"2023-11-16T02:30:19.890750+0000","last_fullsized":"2023-11-16T02:30:19.890750+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:58:23.597351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.876394+0000","last_change":"2023-11-16T02:30:19.846299+0000","last_active":"2023-11-16T02:30:19.876394+0000","last_peered":"2023-11-16T02:30:19.876394+0000","last_clean":"2023-11-16T02:30:19.876394+0000","last_became_active":"2023-11-16T02:30:19.845561+0000","last_became_peered":"2023-11-16T02:30:19.845561+0000","last_unstale":"2023-11-16T02:30:19.876394+0000","last_undegraded":"2023-11-16T02:30:19.876394+0000","last_fullsized":"2023-11-16T02:30:19.876394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:24:43.125348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.848786+0000","last_change":"2023-11-16T02:30:19.843307+0000","last_active":"2023-11-16T02:30:19.848786+0000","last_peered":"2023-11-16T02:30:19.848786+0000","last_clean":"2023-11-16T02:30:19.848786+0000","last_became_active":"2023-11-16T02:30:19.842948+0000","last_became_peered":"2023-11-16T02:30:19.842948+0000","last_unstale":"2023-11-16T02:30:19.848786+0000","last_undegraded":"2023-11-16T02:30:19.848786+0000","last_fullsized":"2023-11-16T02:30:19.848786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:51:01.130415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893290+0000","last_change":"2023-11-16T02:30:19.884857+0000","last_active":"2023-11-16T02:30:19.893290+0000","last_peered":"2023-11-16T02:30:19.893290+0000","last_clean":"2023-11-16T02:30:19.893290+0000","last_became_active":"2023-11-16T02:30:19.884211+0000","last_became_peered":"2023-11-16T02:30:19.884211+0000","last_unstale":"2023-11-16T02:30:19.893290+0000","last_undegraded":"2023-11-16T02:30:19.893290+0000","last_fullsized":"2023-11-16T02:30:19.893290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:26:35.043805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.883207+0000","last_change":"2023-11-16T02:30:19.873333+0000","last_active":"2023-11-16T02:30:19.883207+0000","last_peered":"2023-11-16T02:30:19.883207+0000","last_clean":"2023-11-16T02:30:19.883207+0000","last_became_active":"2023-11-16T02:30:19.872312+0000","last_became_peered":"2023-11-16T02:30:19.872312+0000","last_unstale":"2023-11-16T02:30:19.883207+0000","last_undegraded":"2023-11-16T02:30:19.883207+0000","last_fullsized":"2023-11-16T02:30:19.883207+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:01:25.904236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.851670+0000","last_change":"2023-11-16T02:30:19.847259+0000","last_active":"2023-11-16T02:30:19.851670+0000","last_peered":"2023-11-16T02:30:19.851670+0000","last_clean":"2023-11-16T02:30:19.851670+0000","last_became_active":"2023-11-16T02:30:19.846960+0000","last_became_peered":"2023-11-16T02:30:19.846960+0000","last_unstale":"2023-11-16T02:30:19.851670+0000","last_undegraded":"2023-11-16T02:30:19.851670+0000","last_fullsized":"2023-11-16T02:30:19.851670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T09:23:18.109208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878474+0000","last_change":"2023-11-16T02:30:19.866095+0000","last_active":"2023-11-16T02:30:19.878474+0000","last_peered":"2023-11-16T02:30:19.878474+0000","last_clean":"2023-11-16T02:30:19.878474+0000","last_became_active":"2023-11-16T02:30:19.865309+0000","last_became_peered":"2023-11-16T02:30:19.865309+0000","last_unstale":"2023-11-16T02:30:19.878474+0000","last_undegraded":"2023-11-16T02:30:19.878474+0000","last_fullsized":"2023-11-16T02:30:19.878474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:05:48.808451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.890791+0000","last_change":"2023-11-16T02:30:19.874960+0000","last_active":"2023-11-16T02:30:19.890791+0000","last_peered":"2023-11-16T02:30:19.890791+0000","last_clean":"2023-11-16T02:30:19.890791+0000","last_became_active":"2023-11-16T02:30:19.873799+0000","last_became_peered":"2023-11-16T02:30:19.873799+0000","last_unstale":"2023-11-16T02:30:19.890791+0000","last_undegraded":"2023-11-16T02:30:19.890791+0000","last_fullsized":"2023-11-16T02:30:19.890791+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:25:44.847232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893326+0000","last_change":"2023-11-16T02:30:19.885005+0000","last_active":"2023-11-16T02:30:19.893326+0000","last_peered":"2023-11-16T02:30:19.893326+0000","last_clean":"2023-11-16T02:30:19.893326+0000","last_became_active":"2023-11-16T02:30:19.884513+0000","last_became_peered":"2023-11-16T02:30:19.884513+0000","last_unstale":"2023-11-16T02:30:19.893326+0000","last_undegraded":"2023-11-16T02:30:19.893326+0000","last_fullsized":"2023-11-16T02:30:19.893326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:23:28.656034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.850304+0000","last_change":"2023-11-16T02:30:19.840626+0000","last_active":"2023-11-16T02:30:19.850304+0000","last_peered":"2023-11-16T02:30:19.850304+0000","last_clean":"2023-11-16T02:30:19.850304+0000","last_became_active":"2023-11-16T02:30:19.840345+0000","last_became_peered":"2023-11-16T02:30:19.840345+0000","last_unstale":"2023-11-16T02:30:19.850304+0000","last_undegraded":"2023-11-16T02:30:19.850304+0000","last_fullsized":"2023-11-16T02:30:19.850304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:23:28.656034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.851576+0000","last_change":"2023-11-16T02:30:19.845327+0000","last_active":"2023-11-16T02:30:19.851576+0000","last_peered":"2023-11-16T02:30:19.851576+0000","last_clean":"2023-11-16T02:30:19.851576+0000","last_became_active":"2023-11-16T02:30:19.845068+0000","last_became_peered":"2023-11-16T02:30:19.845068+0000","last_unstale":"2023-11-16T02:30:19.851576+0000","last_undegraded":"2023-11-16T02:30:19.851576+0000","last_fullsized":"2023-11-16T02:30:19.851576+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:58:23.597351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.890272+0000","last_change":"2023-11-16T02:30:19.879907+0000","last_active":"2023-11-16T02:30:19.890272+0000","last_peered":"2023-11-16T02:30:19.890272+0000","last_clean":"2023-11-16T02:30:19.890272+0000","last_became_active":"2023-11-16T02:30:19.878794+0000","last_became_peered":"2023-11-16T02:30:19.878794+0000","last_unstale":"2023-11-16T02:30:19.890272+0000","last_undegraded":"2023-11-16T02:30:19.890272+0000","last_fullsized":"2023-11-16T02:30:19.890272+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:05:25.212455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.884390+0000","last_change":"2023-11-16T02:30:19.867043+0000","last_active":"2023-11-16T02:30:19.884390+0000","last_peered":"2023-11-16T02:30:19.884390+0000","last_clean":"2023-11-16T02:30:19.884390+0000","last_became_active":"2023-11-16T02:30:19.866232+0000","last_became_peered":"2023-11-16T02:30:19.866232+0000","last_unstale":"2023-11-16T02:30:19.884390+0000","last_undegraded":"2023-11-16T02:30:19.884390+0000","last_fullsized":"2023-11-16T02:30:19.884390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:51:01.130415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.877328+0000","last_change":"2023-11-16T02:30:19.875797+0000","last_active":"2023-11-16T02:30:19.877328+0000","last_peered":"2023-11-16T02:30:19.877328+0000","last_clean":"2023-11-16T02:30:19.877328+0000","last_became_active":"2023-11-16T02:30:19.875422+0000","last_became_peered":"2023-11-16T02:30:19.875422+0000","last_unstale":"2023-11-16T02:30:19.877328+0000","last_undegraded":"2023-11-16T02:30:19.877328+0000","last_fullsized":"2023-11-16T02:30:19.877328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:51:01.130415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878399+0000","last_change":"2023-11-16T02:30:19.867144+0000","last_active":"2023-11-16T02:30:19.878399+0000","last_peered":"2023-11-16T02:30:19.878399+0000","last_clean":"2023-11-16T02:30:19.878399+0000","last_became_active":"2023-11-16T02:30:19.865272+0000","last_became_peered":"2023-11-16T02:30:19.865272+0000","last_unstale":"2023-11-16T02:30:19.878399+0000","last_undegraded":"2023-11-16T02:30:19.878399+0000","last_fullsized":"2023-11-16T02:30:19.878399+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:53:26.356470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.873118+0000","last_change":"2023-11-16T02:30:19.872380+0000","last_active":"2023-11-16T02:30:19.873118+0000","last_peered":"2023-11-16T02:30:19.873118+0000","last_clean":"2023-11-16T02:30:19.873118+0000","last_became_active":"2023-11-16T02:30:19.872131+0000","last_became_peered":"2023-11-16T02:30:19.872131+0000","last_unstale":"2023-11-16T02:30:19.873118+0000","last_undegraded":"2023-11-16T02:30:19.873118+0000","last_fullsized":"2023-11-16T02:30:19.873118+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:14:02.468285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.873930+0000","last_change":"2023-11-16T02:30:19.873009+0000","last_active":"2023-11-16T02:30:19.873930+0000","last_peered":"2023-11-16T02:30:19.873930+0000","last_clean":"2023-11-16T02:30:19.873930+0000","last_became_active":"2023-11-16T02:30:19.872718+0000","last_became_peered":"2023-11-16T02:30:19.872718+0000","last_unstale":"2023-11-16T02:30:19.873930+0000","last_undegraded":"2023-11-16T02:30:19.873930+0000","last_fullsized":"2023-11-16T02:30:19.873930+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:57:16.626801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878500+0000","last_change":"2023-11-16T02:30:19.877492+0000","last_active":"2023-11-16T02:30:19.878500+0000","last_peered":"2023-11-16T02:30:19.878500+0000","last_clean":"2023-11-16T02:30:19.878500+0000","last_became_active":"2023-11-16T02:30:19.877055+0000","last_became_peered":"2023-11-16T02:30:19.877055+0000","last_unstale":"2023-11-16T02:30:19.878500+0000","last_undegraded":"2023-11-16T02:30:19.878500+0000","last_fullsized":"2023-11-16T02:30:19.878500+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:30:57.683829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.883250+0000","last_change":"2023-11-16T02:30:19.873823+0000","last_active":"2023-11-16T02:30:19.883250+0000","last_peered":"2023-11-16T02:30:19.883250+0000","last_clean":"2023-11-16T02:30:19.883250+0000","last_became_active":"2023-11-16T02:30:19.873097+0000","last_became_peered":"2023-11-16T02:30:19.873097+0000","last_unstale":"2023-11-16T02:30:19.883250+0000","last_undegraded":"2023-11-16T02:30:19.883250+0000","last_fullsized":"2023-11-16T02:30:19.883250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:11:01.176911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.890230+0000","last_change":"2023-11-16T02:30:19.879438+0000","last_active":"2023-11-16T02:30:19.890230+0000","last_peered":"2023-11-16T02:30:19.890230+0000","last_clean":"2023-11-16T02:30:19.890230+0000","last_became_active":"2023-11-16T02:30:19.878067+0000","last_became_peered":"2023-11-16T02:30:19.878067+0000","last_unstale":"2023-11-16T02:30:19.890230+0000","last_undegraded":"2023-11-16T02:30:19.890230+0000","last_fullsized":"2023-11-16T02:30:19.890230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:53:26.356470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893346+0000","last_change":"2023-11-16T02:30:19.885674+0000","last_active":"2023-11-16T02:30:19.893346+0000","last_peered":"2023-11-16T02:30:19.893346+0000","last_clean":"2023-11-16T02:30:19.893346+0000","last_became_active":"2023-11-16T02:30:19.884062+0000","last_became_peered":"2023-11-16T02:30:19.884062+0000","last_unstale":"2023-11-16T02:30:19.893346+0000","last_undegraded":"2023-11-16T02:30:19.893346+0000","last_fullsized":"2023-11-16T02:30:19.893346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:59:15.040356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.872486+0000","last_change":"2023-11-16T02:30:19.859781+0000","last_active":"2023-11-16T02:30:19.872486+0000","last_peered":"2023-11-16T02:30:19.872486+0000","last_clean":"2023-11-16T02:30:19.872486+0000","last_became_active":"2023-11-16T02:30:19.857455+0000","last_became_peered":"2023-11-16T02:30:19.857455+0000","last_unstale":"2023-11-16T02:30:19.872486+0000","last_undegraded":"2023-11-16T02:30:19.872486+0000","last_fullsized":"2023-11-16T02:30:19.872486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:17:17.336842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893099+0000","last_change":"2023-11-16T02:30:19.880769+0000","last_active":"2023-11-16T02:30:19.893099+0000","last_peered":"2023-11-16T02:30:19.893099+0000","last_clean":"2023-11-16T02:30:19.893099+0000","last_became_active":"2023-11-16T02:30:19.878925+0000","last_became_peered":"2023-11-16T02:30:19.878925+0000","last_unstale":"2023-11-16T02:30:19.893099+0000","last_undegraded":"2023-11-16T02:30:19.893099+0000","last_fullsized":"2023-11-16T02:30:19.893099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:57:16.626801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.877326+0000","last_change":"2023-11-16T02:30:19.875765+0000","last_active":"2023-11-16T02:30:19.877326+0000","last_peered":"2023-11-16T02:30:19.877326+0000","last_clean":"2023-11-16T02:30:19.877326+0000","last_became_active":"2023-11-16T02:30:19.875438+0000","last_became_peered":"2023-11-16T02:30:19.875438+0000","last_unstale":"2023-11-16T02:30:19.877326+0000","last_undegraded":"2023-11-16T02:30:19.877326+0000","last_fullsized":"2023-11-16T02:30:19.877326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:53:26.356470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.884630+0000","last_change":"2023-11-16T02:30:19.484973+0000","last_active":"2023-11-16T02:30:19.884630+0000","last_peered":"2023-11-16T02:30:19.884630+0000","last_clean":"2023-11-16T02:30:19.884630+0000","last_became_active":"2023-11-16T02:30:19.484403+0000","last_became_peered":"2023-11-16T02:30:19.484403+0000","last_unstale":"2023-11-16T02:30:19.884630+0000","last_undegraded":"2023-11-16T02:30:19.884630+0000","last_fullsized":"2023-11-16T02:30:19.884630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:30:11.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.891352+0000","last_change":"2023-11-16T02:30:19.886424+0000","last_active":"2023-11-16T02:30:19.891352+0000","last_peered":"2023-11-16T02:30:19.891352+0000","last_clean":"2023-11-16T02:30:19.891352+0000","last_became_active":"2023-11-16T02:30:19.885778+0000","last_became_peered":"2023-11-16T02:30:19.885778+0000","last_unstale":"2023-11-16T02:30:19.891352+0000","last_undegraded":"2023-11-16T02:30:19.891352+0000","last_fullsized":"2023-11-16T02:30:19.891352+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:26:16.324058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.875204+0000","last_change":"2023-11-16T02:30:19.467799+0000","last_active":"2023-11-16T02:30:19.875204+0000","last_peered":"2023-11-16T02:30:19.875204+0000","last_clean":"2023-11-16T02:30:19.875204+0000","last_became_active":"2023-11-16T02:30:19.467517+0000","last_became_peered":"2023-11-16T02:30:19.467517+0000","last_unstale":"2023-11-16T02:30:19.875204+0000","last_undegraded":"2023-11-16T02:30:19.875204+0000","last_fullsized":"2023-11-16T02:30:19.875204+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:53:29.543335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.884546+0000","last_change":"2023-11-16T02:30:19.865354+0000","last_active":"2023-11-16T02:30:19.884546+0000","last_peered":"2023-11-16T02:30:19.884546+0000","last_clean":"2023-11-16T02:30:19.884546+0000","last_became_active":"2023-11-16T02:30:19.864635+0000","last_became_peered":"2023-11-16T02:30:19.864635+0000","last_unstale":"2023-11-16T02:30:19.884546+0000","last_undegraded":"2023-11-16T02:30:19.884546+0000","last_fullsized":"2023-11-16T02:30:19.884546+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T09:30:55.572569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.857320+0000","last_change":"2023-11-16T02:30:19.463569+0000","last_active":"2023-11-16T02:30:19.857320+0000","last_peered":"2023-11-16T02:30:19.857320+0000","last_clean":"2023-11-16T02:30:19.857320+0000","last_became_active":"2023-11-16T02:30:19.463298+0000","last_became_peered":"2023-11-16T02:30:19.463298+0000","last_unstale":"2023-11-16T02:30:19.857320+0000","last_undegraded":"2023-11-16T02:30:19.857320+0000","last_fullsized":"2023-11-16T02:30:19.857320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:26:15.319244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878131+0000","last_change":"2023-11-16T02:30:19.876755+0000","last_active":"2023-11-16T02:30:19.878131+0000","last_peered":"2023-11-16T02:30:19.878131+0000","last_clean":"2023-11-16T02:30:19.878131+0000","last_became_active":"2023-11-16T02:30:19.876454+0000","last_became_peered":"2023-11-16T02:30:19.876454+0000","last_unstale":"2023-11-16T02:30:19.878131+0000","last_undegraded":"2023-11-16T02:30:19.878131+0000","last_fullsized":"2023-11-16T02:30:19.878131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T09:30:55.572569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-16T02:30:18.431898+0000","last_change":"2023-11-16T02:30:18.431898+0000","last_active":"2023-11-16T02:30:18.421000+0000","last_peered":"2023-11-16T02:30:18.421000+0000","last_clean":"2023-11-16T02:30:18.421000+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:18.431898+0000","last_undegraded":"2023-11-16T02:30:18.431898+0000","last_fullsized":"2023-11-16T02:30:18.431898+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:15:52.039420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893400+0000","last_change":"2023-11-16T02:30:19.887577+0000","last_active":"2023-11-16T02:30:19.893400+0000","last_peered":"2023-11-16T02:30:19.893400+0000","last_clean":"2023-11-16T02:30:19.893400+0000","last_became_active":"2023-11-16T02:30:19.886948+0000","last_became_peered":"2023-11-16T02:30:19.886948+0000","last_unstale":"2023-11-16T02:30:19.893400+0000","last_undegraded":"2023-11-16T02:30:19.893400+0000","last_fullsized":"2023-11-16T02:30:19.893400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:11:01.176911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.877547+0000","last_change":"2023-11-16T02:30:19.461227+0000","last_active":"2023-11-16T02:30:19.877547+0000","last_peered":"2023-11-16T02:30:19.877547+0000","last_clean":"2023-11-16T02:30:19.877547+0000","last_became_active":"2023-11-16T02:30:19.460450+0000","last_became_peered":"2023-11-16T02:30:19.460450+0000","last_unstale":"2023-11-16T02:30:19.877547+0000","last_undegraded":"2023-11-16T02:30:19.877547+0000","last_fullsized":"2023-11-16T02:30:19.877547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:07:18.071597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878430+0000","last_change":"2023-11-16T02:30:19.868426+0000","last_active":"2023-11-16T02:30:19.878430+0000","last_peered":"2023-11-16T02:30:19.878430+0000","last_clean":"2023-11-16T02:30:19.878430+0000","last_became_active":"2023-11-16T02:30:19.866177+0000","last_became_peered":"2023-11-16T02:30:19.866177+0000","last_unstale":"2023-11-16T02:30:19.878430+0000","last_undegraded":"2023-11-16T02:30:19.878430+0000","last_fullsized":"2023-11-16T02:30:19.878430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:14:02.468285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.876474+0000","last_change":"2023-11-16T02:30:19.461149+0000","last_active":"2023-11-16T02:30:19.876474+0000","last_peered":"2023-11-16T02:30:19.876474+0000","last_clean":"2023-11-16T02:30:19.876474+0000","last_became_active":"2023-11-16T02:30:19.460646+0000","last_became_peered":"2023-11-16T02:30:19.460646+0000","last_unstale":"2023-11-16T02:30:19.876474+0000","last_undegraded":"2023-11-16T02:30:19.876474+0000","last_fullsized":"2023-11-16T02:30:19.876474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:08:35.892877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.890191+0000","last_change":"2023-11-16T02:30:19.878750+0000","last_active":"2023-11-16T02:30:19.890191+0000","last_peered":"2023-11-16T02:30:19.890191+0000","last_clean":"2023-11-16T02:30:19.890191+0000","last_became_active":"2023-11-16T02:30:19.878234+0000","last_became_peered":"2023-11-16T02:30:19.878234+0000","last_unstale":"2023-11-16T02:30:19.890191+0000","last_undegraded":"2023-11-16T02:30:19.890191+0000","last_fullsized":"2023-11-16T02:30:19.890191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:11:46.387664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.835183+0000","last_change":"2023-11-16T02:30:19.469556+0000","last_active":"2023-11-16T02:30:19.835183+0000","last_peered":"2023-11-16T02:30:19.835183+0000","last_clean":"2023-11-16T02:30:19.835183+0000","last_became_active":"2023-11-16T02:30:19.468872+0000","last_became_peered":"2023-11-16T02:30:19.468872+0000","last_unstale":"2023-11-16T02:30:19.835183+0000","last_undegraded":"2023-11-16T02:30:19.835183+0000","last_fullsized":"2023-11-16T02:30:19.835183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:11:45.382850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.871173+0000","last_change":"2023-11-16T02:30:19.869582+0000","last_active":"2023-11-16T02:30:19.871173+0000","last_peered":"2023-11-16T02:30:19.871173+0000","last_clean":"2023-11-16T02:30:19.871173+0000","last_became_active":"2023-11-16T02:30:19.869254+0000","last_became_peered":"2023-11-16T02:30:19.869254+0000","last_unstale":"2023-11-16T02:30:19.871173+0000","last_undegraded":"2023-11-16T02:30:19.871173+0000","last_fullsized":"2023-11-16T02:30:19.871173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:26:35.043805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.834349+0000","last_change":"2023-11-16T02:30:19.466145+0000","last_active":"2023-11-16T02:30:19.834349+0000","last_peered":"2023-11-16T02:30:19.834349+0000","last_clean":"2023-11-16T02:30:19.834349+0000","last_became_active":"2023-11-16T02:30:19.465726+0000","last_became_peered":"2023-11-16T02:30:19.465726+0000","last_unstale":"2023-11-16T02:30:19.834349+0000","last_undegraded":"2023-11-16T02:30:19.834349+0000","last_fullsized":"2023-11-16T02:30:19.834349+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:23:32.728712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878486+0000","last_change":"2023-11-16T02:30:19.867919+0000","last_active":"2023-11-16T02:30:19.878486+0000","last_peered":"2023-11-16T02:30:19.878486+0000","last_clean":"2023-11-16T02:30:19.878486+0000","last_became_active":"2023-11-16T02:30:19.867061+0000","last_became_peered":"2023-11-16T02:30:19.867061+0000","last_unstale":"2023-11-16T02:30:19.878486+0000","last_undegraded":"2023-11-16T02:30:19.878486+0000","last_fullsized":"2023-11-16T02:30:19.878486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:30:57.683829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.836643+0000","last_change":"2023-11-16T02:30:19.472891+0000","last_active":"2023-11-16T02:30:19.836643+0000","last_peered":"2023-11-16T02:30:19.836643+0000","last_clean":"2023-11-16T02:30:19.836643+0000","last_became_active":"2023-11-16T02:30:19.472450+0000","last_became_peered":"2023-11-16T02:30:19.472450+0000","last_unstale":"2023-11-16T02:30:19.836643+0000","last_undegraded":"2023-11-16T02:30:19.836643+0000","last_fullsized":"2023-11-16T02:30:19.836643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:34:32.414746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.848452+0000","last_change":"2023-11-16T02:30:19.840186+0000","last_active":"2023-11-16T02:30:19.848452+0000","last_peered":"2023-11-16T02:30:19.848452+0000","last_clean":"2023-11-16T02:30:19.848452+0000","last_became_active":"2023-11-16T02:30:19.839901+0000","last_became_peered":"2023-11-16T02:30:19.839901+0000","last_unstale":"2023-11-16T02:30:19.848452+0000","last_undegraded":"2023-11-16T02:30:19.848452+0000","last_fullsized":"2023-11-16T02:30:19.848452+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:00:28.306611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.829875+0000","last_change":"2023-11-16T02:30:19.467692+0000","last_active":"2023-11-16T02:30:19.829875+0000","last_peered":"2023-11-16T02:30:19.829875+0000","last_clean":"2023-11-16T02:30:19.829875+0000","last_became_active":"2023-11-16T02:30:19.467180+0000","last_became_peered":"2023-11-16T02:30:19.467180+0000","last_unstale":"2023-11-16T02:30:19.829875+0000","last_undegraded":"2023-11-16T02:30:19.829875+0000","last_fullsized":"2023-11-16T02:30:19.829875+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:02:05.395662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878009+0000","last_change":"2023-11-16T02:30:19.877297+0000","last_active":"2023-11-16T02:30:19.878009+0000","last_peered":"2023-11-16T02:30:19.878009+0000","last_clean":"2023-11-16T02:30:19.878009+0000","last_became_active":"2023-11-16T02:30:19.876717+0000","last_became_peered":"2023-11-16T02:30:19.876717+0000","last_unstale":"2023-11-16T02:30:19.878009+0000","last_undegraded":"2023-11-16T02:30:19.878009+0000","last_fullsized":"2023-11-16T02:30:19.878009+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:00:21.607056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.888776+0000","last_change":"2023-11-16T02:30:19.482605+0000","last_active":"2023-11-16T02:30:19.888776+0000","last_peered":"2023-11-16T02:30:19.888776+0000","last_clean":"2023-11-16T02:30:19.888776+0000","last_became_active":"2023-11-16T02:30:19.481717+0000","last_became_peered":"2023-11-16T02:30:19.481717+0000","last_unstale":"2023-11-16T02:30:19.888776+0000","last_undegraded":"2023-11-16T02:30:19.888776+0000","last_fullsized":"2023-11-16T02:30:19.888776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:27:42.254533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878420+0000","last_change":"2023-11-16T02:30:19.868734+0000","last_active":"2023-11-16T02:30:19.878420+0000","last_peered":"2023-11-16T02:30:19.878420+0000","last_clean":"2023-11-16T02:30:19.878420+0000","last_became_active":"2023-11-16T02:30:19.868028+0000","last_became_peered":"2023-11-16T02:30:19.868028+0000","last_unstale":"2023-11-16T02:30:19.878420+0000","last_undegraded":"2023-11-16T02:30:19.878420+0000","last_fullsized":"2023-11-16T02:30:19.878420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:29:41.914615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.880000+0000","last_change":"2023-11-16T02:30:19.465379+0000","last_active":"2023-11-16T02:30:19.880000+0000","last_peered":"2023-11-16T02:30:19.880000+0000","last_clean":"2023-11-16T02:30:19.880000+0000","last_became_active":"2023-11-16T02:30:19.464674+0000","last_became_peered":"2023-11-16T02:30:19.464674+0000","last_unstale":"2023-11-16T02:30:19.880000+0000","last_undegraded":"2023-11-16T02:30:19.880000+0000","last_fullsized":"2023-11-16T02:30:19.880000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:33:12.505379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.883395+0000","last_change":"2023-11-16T02:30:19.882010+0000","last_active":"2023-11-16T02:30:19.883395+0000","last_peered":"2023-11-16T02:30:19.883395+0000","last_clean":"2023-11-16T02:30:19.883395+0000","last_became_active":"2023-11-16T02:30:19.881685+0000","last_became_peered":"2023-11-16T02:30:19.881685+0000","last_unstale":"2023-11-16T02:30:19.883395+0000","last_undegraded":"2023-11-16T02:30:19.883395+0000","last_fullsized":"2023-11-16T02:30:19.883395+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:11:01.176911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.885297+0000","last_change":"2023-11-16T02:30:19.467910+0000","last_active":"2023-11-16T02:30:19.885297+0000","last_peered":"2023-11-16T02:30:19.885297+0000","last_clean":"2023-11-16T02:30:19.885297+0000","last_became_active":"2023-11-16T02:30:19.467432+0000","last_became_peered":"2023-11-16T02:30:19.467432+0000","last_unstale":"2023-11-16T02:30:19.885297+0000","last_undegraded":"2023-11-16T02:30:19.885297+0000","last_fullsized":"2023-11-16T02:30:19.885297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:59:51.546762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.850327+0000","last_change":"2023-11-16T02:30:19.840706+0000","last_active":"2023-11-16T02:30:19.850327+0000","last_peered":"2023-11-16T02:30:19.850327+0000","last_clean":"2023-11-16T02:30:19.850327+0000","last_became_active":"2023-11-16T02:30:19.840310+0000","last_became_peered":"2023-11-16T02:30:19.840310+0000","last_unstale":"2023-11-16T02:30:19.850327+0000","last_undegraded":"2023-11-16T02:30:19.850327+0000","last_fullsized":"2023-11-16T02:30:19.850327+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:01:25.904236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.835925+0000","last_change":"2023-11-16T02:30:19.467641+0000","last_active":"2023-11-16T02:30:19.835925+0000","last_peered":"2023-11-16T02:30:19.835925+0000","last_clean":"2023-11-16T02:30:19.835925+0000","last_became_active":"2023-11-16T02:30:19.467184+0000","last_became_peered":"2023-11-16T02:30:19.467184+0000","last_unstale":"2023-11-16T02:30:19.835925+0000","last_undegraded":"2023-11-16T02:30:19.835925+0000","last_fullsized":"2023-11-16T02:30:19.835925+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:40:26.674869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893121+0000","last_change":"2023-11-16T02:30:19.881218+0000","last_active":"2023-11-16T02:30:19.893121+0000","last_peered":"2023-11-16T02:30:19.893121+0000","last_clean":"2023-11-16T02:30:19.893121+0000","last_became_active":"2023-11-16T02:30:19.879762+0000","last_became_peered":"2023-11-16T02:30:19.879762+0000","last_unstale":"2023-11-16T02:30:19.893121+0000","last_undegraded":"2023-11-16T02:30:19.893121+0000","last_fullsized":"2023-11-16T02:30:19.893121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:01:25.904236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.835106+0000","last_change":"2023-11-16T02:30:19.472885+0000","last_active":"2023-11-16T02:30:19.835106+0000","last_peered":"2023-11-16T02:30:19.835106+0000","last_clean":"2023-11-16T02:30:19.835106+0000","last_became_active":"2023-11-16T02:30:19.472418+0000","last_became_peered":"2023-11-16T02:30:19.472418+0000","last_unstale":"2023-11-16T02:30:19.835106+0000","last_undegraded":"2023-11-16T02:30:19.835106+0000","last_fullsized":"2023-11-16T02:30:19.835106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:05:24.207641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.891248+0000","last_change":"2023-11-16T02:30:19.880084+0000","last_active":"2023-11-16T02:30:19.891248+0000","last_peered":"2023-11-16T02:30:19.891248+0000","last_clean":"2023-11-16T02:30:19.891248+0000","last_became_active":"2023-11-16T02:30:19.879577+0000","last_became_peered":"2023-11-16T02:30:19.879577+0000","last_unstale":"2023-11-16T02:30:19.891248+0000","last_undegraded":"2023-11-16T02:30:19.891248+0000","last_fullsized":"2023-11-16T02:30:19.891248+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:05:25.212455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.858621+0000","last_change":"2023-11-16T02:30:19.459454+0000","last_active":"2023-11-16T02:30:19.858621+0000","last_peered":"2023-11-16T02:30:19.858621+0000","last_clean":"2023-11-16T02:30:19.858621+0000","last_became_active":"2023-11-16T02:30:19.458959+0000","last_became_peered":"2023-11-16T02:30:19.458959+0000","last_unstale":"2023-11-16T02:30:19.858621+0000","last_undegraded":"2023-11-16T02:30:19.858621+0000","last_fullsized":"2023-11-16T02:30:19.858621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:27:42.254533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.890110+0000","last_change":"2023-11-16T02:30:19.877024+0000","last_active":"2023-11-16T02:30:19.890110+0000","last_peered":"2023-11-16T02:30:19.890110+0000","last_clean":"2023-11-16T02:30:19.890110+0000","last_became_active":"2023-11-16T02:30:19.876487+0000","last_became_peered":"2023-11-16T02:30:19.876487+0000","last_unstale":"2023-11-16T02:30:19.890110+0000","last_undegraded":"2023-11-16T02:30:19.890110+0000","last_fullsized":"2023-11-16T02:30:19.890110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:30:57.683829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.852631+0000","last_change":"2023-11-16T02:30:19.461811+0000","last_active":"2023-11-16T02:30:19.852631+0000","last_peered":"2023-11-16T02:30:19.852631+0000","last_clean":"2023-11-16T02:30:19.852631+0000","last_became_active":"2023-11-16T02:30:19.460313+0000","last_became_peered":"2023-11-16T02:30:19.460313+0000","last_unstale":"2023-11-16T02:30:19.852631+0000","last_undegraded":"2023-11-16T02:30:19.852631+0000","last_fullsized":"2023-11-16T02:30:19.852631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:02:05.395662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.887669+0000","last_change":"2023-11-16T02:30:19.885693+0000","last_active":"2023-11-16T02:30:19.887669+0000","last_peered":"2023-11-16T02:30:19.887669+0000","last_clean":"2023-11-16T02:30:19.887669+0000","last_became_active":"2023-11-16T02:30:19.885102+0000","last_became_peered":"2023-11-16T02:30:19.885102+0000","last_unstale":"2023-11-16T02:30:19.887669+0000","last_undegraded":"2023-11-16T02:30:19.887669+0000","last_fullsized":"2023-11-16T02:30:19.887669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:59:15.040356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.877415+0000","last_change":"2023-11-16T02:30:19.477174+0000","last_active":"2023-11-16T02:30:19.877415+0000","last_peered":"2023-11-16T02:30:19.877415+0000","last_clean":"2023-11-16T02:30:19.877415+0000","last_became_active":"2023-11-16T02:30:19.475945+0000","last_became_peered":"2023-11-16T02:30:19.475945+0000","last_unstale":"2023-11-16T02:30:19.877415+0000","last_undegraded":"2023-11-16T02:30:19.877415+0000","last_fullsized":"2023-11-16T02:30:19.877415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:29:26.977995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.883430+0000","last_change":"2023-11-16T02:30:19.882218+0000","last_active":"2023-11-16T02:30:19.883430+0000","last_peered":"2023-11-16T02:30:19.883430+0000","last_clean":"2023-11-16T02:30:19.883430+0000","last_became_active":"2023-11-16T02:30:19.881908+0000","last_became_peered":"2023-11-16T02:30:19.881908+0000","last_unstale":"2023-11-16T02:30:19.883430+0000","last_undegraded":"2023-11-16T02:30:19.883430+0000","last_fullsized":"2023-11-16T02:30:19.883430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:24:43.125348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.876969+0000","last_change":"2023-11-16T02:30:19.470192+0000","last_active":"2023-11-16T02:30:19.876969+0000","last_peered":"2023-11-16T02:30:19.876969+0000","last_clean":"2023-11-16T02:30:19.876969+0000","last_became_active":"2023-11-16T02:30:19.469472+0000","last_became_peered":"2023-11-16T02:30:19.469472+0000","last_unstale":"2023-11-16T02:30:19.876969+0000","last_undegraded":"2023-11-16T02:30:19.876969+0000","last_fullsized":"2023-11-16T02:30:19.876969+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:17:41.856951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.836885+0000","last_change":"2023-11-16T02:30:19.468369+0000","last_active":"2023-11-16T02:30:19.836885+0000","last_peered":"2023-11-16T02:30:19.836885+0000","last_clean":"2023-11-16T02:30:19.836885+0000","last_became_active":"2023-11-16T02:30:19.467924+0000","last_became_peered":"2023-11-16T02:30:19.467924+0000","last_unstale":"2023-11-16T02:30:19.836885+0000","last_undegraded":"2023-11-16T02:30:19.836885+0000","last_fullsized":"2023-11-16T02:30:19.836885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:30:11.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.853040+0000","last_change":"2023-11-16T02:30:19.467061+0000","last_active":"2023-11-16T02:30:19.853040+0000","last_peered":"2023-11-16T02:30:19.853040+0000","last_clean":"2023-11-16T02:30:19.853040+0000","last_became_active":"2023-11-16T02:30:19.466792+0000","last_became_peered":"2023-11-16T02:30:19.466792+0000","last_unstale":"2023-11-16T02:30:19.853040+0000","last_undegraded":"2023-11-16T02:30:19.853040+0000","last_fullsized":"2023-11-16T02:30:19.853040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T02:52:12.747285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.836867+0000","last_change":"2023-11-16T02:30:19.465478+0000","last_active":"2023-11-16T02:30:19.836867+0000","last_peered":"2023-11-16T02:30:19.836867+0000","last_clean":"2023-11-16T02:30:19.836867+0000","last_became_active":"2023-11-16T02:30:19.464658+0000","last_became_peered":"2023-11-16T02:30:19.464658+0000","last_unstale":"2023-11-16T02:30:19.836867+0000","last_undegraded":"2023-11-16T02:30:19.836867+0000","last_fullsized":"2023-11-16T02:30:19.836867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:23:32.728712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.834793+0000","last_change":"2023-11-16T02:30:19.485044+0000","last_active":"2023-11-16T02:30:19.834793+0000","last_peered":"2023-11-16T02:30:19.834793+0000","last_clean":"2023-11-16T02:30:19.834793+0000","last_became_active":"2023-11-16T02:30:19.484575+0000","last_became_peered":"2023-11-16T02:30:19.484575+0000","last_unstale":"2023-11-16T02:30:19.834793+0000","last_undegraded":"2023-11-16T02:30:19.834793+0000","last_fullsized":"2023-11-16T02:30:19.834793+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:48:59.158704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893198+0000","last_change":"2023-11-16T02:30:19.881226+0000","last_active":"2023-11-16T02:30:19.893198+0000","last_peered":"2023-11-16T02:30:19.893198+0000","last_clean":"2023-11-16T02:30:19.893198+0000","last_became_active":"2023-11-16T02:30:19.880563+0000","last_became_peered":"2023-11-16T02:30:19.880563+0000","last_unstale":"2023-11-16T02:30:19.893198+0000","last_undegraded":"2023-11-16T02:30:19.893198+0000","last_fullsized":"2023-11-16T02:30:19.893198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:04:02.319109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.842049+0000","last_change":"2023-11-16T02:30:19.482268+0000","last_active":"2023-11-16T02:30:19.842049+0000","last_peered":"2023-11-16T02:30:19.842049+0000","last_clean":"2023-11-16T02:30:19.842049+0000","last_became_active":"2023-11-16T02:30:19.481547+0000","last_became_peered":"2023-11-16T02:30:19.481547+0000","last_unstale":"2023-11-16T02:30:19.842049+0000","last_undegraded":"2023-11-16T02:30:19.842049+0000","last_fullsized":"2023-11-16T02:30:19.842049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:53:29.543335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-16T02:30:19.425814+0000","last_change":"2023-11-16T02:30:19.425814+0000","last_active":"2023-11-16T02:30:19.425814+0000","last_peered":"2023-11-16T02:30:19.425814+0000","last_clean":"2023-11-16T02:30:19.425814+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-16T02:30:19.425814+0000","last_undegraded":"2023-11-16T02:30:19.425814+0000","last_fullsized":"2023-11-16T02:30:19.425814+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.881681+0000","last_change":"2023-11-16T02:30:19.486403+0000","last_active":"2023-11-16T02:30:19.881681+0000","last_peered":"2023-11-16T02:30:19.881681+0000","last_clean":"2023-11-16T02:30:19.881681+0000","last_became_active":"2023-11-16T02:30:19.485982+0000","last_became_peered":"2023-11-16T02:30:19.485982+0000","last_unstale":"2023-11-16T02:30:19.881681+0000","last_undegraded":"2023-11-16T02:30:19.881681+0000","last_fullsized":"2023-11-16T02:30:19.881681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T02:52:12.747285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.878779+0000","last_change":"2023-11-16T02:30:19.868154+0000","last_active":"2023-11-16T02:30:19.878779+0000","last_peered":"2023-11-16T02:30:19.878779+0000","last_clean":"2023-11-16T02:30:19.878779+0000","last_became_active":"2023-11-16T02:30:19.867219+0000","last_became_peered":"2023-11-16T02:30:19.867219+0000","last_unstale":"2023-11-16T02:30:19.878779+0000","last_undegraded":"2023-11-16T02:30:19.878779+0000","last_fullsized":"2023-11-16T02:30:19.878779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:04:02.319109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.829792+0000","last_change":"2023-11-16T02:30:19.467493+0000","last_active":"2023-11-16T02:30:19.829792+0000","last_peered":"2023-11-16T02:30:19.829792+0000","last_clean":"2023-11-16T02:30:19.829792+0000","last_became_active":"2023-11-16T02:30:19.466854+0000","last_became_peered":"2023-11-16T02:30:19.466854+0000","last_unstale":"2023-11-16T02:30:19.829792+0000","last_undegraded":"2023-11-16T02:30:19.829792+0000","last_fullsized":"2023-11-16T02:30:19.829792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:40:26.674869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.843656+0000","last_change":"2023-11-16T02:30:19.839272+0000","last_active":"2023-11-16T02:30:19.843656+0000","last_peered":"2023-11-16T02:30:19.843656+0000","last_clean":"2023-11-16T02:30:19.843656+0000","last_became_active":"2023-11-16T02:30:19.838628+0000","last_became_peered":"2023-11-16T02:30:19.838628+0000","last_unstale":"2023-11-16T02:30:19.843656+0000","last_undegraded":"2023-11-16T02:30:19.843656+0000","last_fullsized":"2023-11-16T02:30:19.843656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:34:33.419560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.835792+0000","last_change":"2023-11-16T02:30:19.468928+0000","last_active":"2023-11-16T02:30:19.835792+0000","last_peered":"2023-11-16T02:30:19.835792+0000","last_clean":"2023-11-16T02:30:19.835792+0000","last_became_active":"2023-11-16T02:30:19.468602+0000","last_became_peered":"2023-11-16T02:30:19.468602+0000","last_unstale":"2023-11-16T02:30:19.835792+0000","last_undegraded":"2023-11-16T02:30:19.835792+0000","last_fullsized":"2023-11-16T02:30:19.835792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:30:11.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.871844+0000","last_change":"2023-11-16T02:30:19.859362+0000","last_active":"2023-11-16T02:30:19.871844+0000","last_peered":"2023-11-16T02:30:19.871844+0000","last_clean":"2023-11-16T02:30:19.871844+0000","last_became_active":"2023-11-16T02:30:19.858630+0000","last_became_peered":"2023-11-16T02:30:19.858630+0000","last_unstale":"2023-11-16T02:30:19.871844+0000","last_undegraded":"2023-11-16T02:30:19.871844+0000","last_fullsized":"2023-11-16T02:30:19.871844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:11:46.387664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.829236+0000","last_change":"2023-11-16T02:30:19.482379+0000","last_active":"2023-11-16T02:30:19.829236+0000","last_peered":"2023-11-16T02:30:19.829236+0000","last_clean":"2023-11-16T02:30:19.829236+0000","last_became_active":"2023-11-16T02:30:19.481905+0000","last_became_peered":"2023-11-16T02:30:19.481905+0000","last_unstale":"2023-11-16T02:30:19.829236+0000","last_undegraded":"2023-11-16T02:30:19.829236+0000","last_fullsized":"2023-11-16T02:30:19.829236+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:30:11.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.860430+0000","last_change":"2023-11-16T02:30:19.859522+0000","last_active":"2023-11-16T02:30:19.860430+0000","last_peered":"2023-11-16T02:30:19.860430+0000","last_clean":"2023-11-16T02:30:19.860430+0000","last_became_active":"2023-11-16T02:30:19.859274+0000","last_became_peered":"2023-11-16T02:30:19.859274+0000","last_unstale":"2023-11-16T02:30:19.860430+0000","last_undegraded":"2023-11-16T02:30:19.860430+0000","last_fullsized":"2023-11-16T02:30:19.860430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:17:17.336842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.836027+0000","last_change":"2023-11-16T02:30:19.481967+0000","last_active":"2023-11-16T02:30:19.836027+0000","last_peered":"2023-11-16T02:30:19.836027+0000","last_clean":"2023-11-16T02:30:19.836027+0000","last_became_active":"2023-11-16T02:30:19.481503+0000","last_became_peered":"2023-11-16T02:30:19.481503+0000","last_unstale":"2023-11-16T02:30:19.836027+0000","last_undegraded":"2023-11-16T02:30:19.836027+0000","last_fullsized":"2023-11-16T02:30:19.836027+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:55:12.932877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.852314+0000","last_change":"2023-11-16T02:30:19.840571+0000","last_active":"2023-11-16T02:30:19.852314+0000","last_peered":"2023-11-16T02:30:19.852314+0000","last_clean":"2023-11-16T02:30:19.852314+0000","last_became_active":"2023-11-16T02:30:19.840277+0000","last_became_peered":"2023-11-16T02:30:19.840277+0000","last_unstale":"2023-11-16T02:30:19.852314+0000","last_undegraded":"2023-11-16T02:30:19.852314+0000","last_fullsized":"2023-11-16T02:30:19.852314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:59:15.040356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.835041+0000","last_change":"2023-11-16T02:30:19.485297+0000","last_active":"2023-11-16T02:30:19.835041+0000","last_peered":"2023-11-16T02:30:19.835041+0000","last_clean":"2023-11-16T02:30:19.835041+0000","last_became_active":"2023-11-16T02:30:19.484515+0000","last_became_peered":"2023-11-16T02:30:19.484515+0000","last_unstale":"2023-11-16T02:30:19.835041+0000","last_undegraded":"2023-11-16T02:30:19.835041+0000","last_fullsized":"2023-11-16T02:30:19.835041+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:52:21.172818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.884462+0000","last_change":"2023-11-16T02:30:19.864997+0000","last_active":"2023-11-16T02:30:19.884462+0000","last_peered":"2023-11-16T02:30:19.884462+0000","last_clean":"2023-11-16T02:30:19.884462+0000","last_became_active":"2023-11-16T02:30:19.864281+0000","last_became_peered":"2023-11-16T02:30:19.864281+0000","last_unstale":"2023-11-16T02:30:19.884462+0000","last_undegraded":"2023-11-16T02:30:19.884462+0000","last_fullsized":"2023-11-16T02:30:19.884462+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:05:48.808451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.832593+0000","last_change":"2023-11-16T02:30:19.480325+0000","last_active":"2023-11-16T02:30:19.832593+0000","last_peered":"2023-11-16T02:30:19.832593+0000","last_clean":"2023-11-16T02:30:19.832593+0000","last_became_active":"2023-11-16T02:30:19.480062+0000","last_became_peered":"2023-11-16T02:30:19.480062+0000","last_unstale":"2023-11-16T02:30:19.832593+0000","last_undegraded":"2023-11-16T02:30:19.832593+0000","last_fullsized":"2023-11-16T02:30:19.832593+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:17:16.332028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.893192+0000","last_change":"2023-11-16T02:30:19.884211+0000","last_active":"2023-11-16T02:30:19.893192+0000","last_peered":"2023-11-16T02:30:19.893192+0000","last_clean":"2023-11-16T02:30:19.893192+0000","last_became_active":"2023-11-16T02:30:19.880825+0000","last_became_peered":"2023-11-16T02:30:19.880825+0000","last_unstale":"2023-11-16T02:30:19.893192+0000","last_undegraded":"2023-11-16T02:30:19.893192+0000","last_fullsized":"2023-11-16T02:30:19.893192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:00:28.306611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.834224+0000","last_change":"2023-11-16T02:30:19.479112+0000","last_active":"2023-11-16T02:30:19.834224+0000","last_peered":"2023-11-16T02:30:19.834224+0000","last_clean":"2023-11-16T02:30:19.834224+0000","last_became_active":"2023-11-16T02:30:19.478459+0000","last_became_peered":"2023-11-16T02:30:19.478459+0000","last_unstale":"2023-11-16T02:30:19.834224+0000","last_undegraded":"2023-11-16T02:30:19.834224+0000","last_fullsized":"2023-11-16T02:30:19.834224+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:55:12.932877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":171,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.466612+0000","last_change":"2023-11-16T02:29:27.538359+0000","last_active":"2023-11-16T02:30:19.466612+0000","last_peered":"2023-11-16T02:30:19.466612+0000","last_clean":"2023-11-16T02:30:19.466612+0000","last_became_active":"2023-11-16T02:29:27.536606+0000","last_became_peered":"2023-11-16T02:29:27.536606+0000","last_unstale":"2023-11-16T02:30:19.466612+0000","last_undegraded":"2023-11-16T02:30:19.466612+0000","last_fullsized":"2023-11-16T02:30:19.466612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:26.491990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:26.491990+0000","last_clean_scrub_stamp":"2023-11-16T02:29:26.491990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:29:40.434297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":112,"acting":112,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":933888,"data_stored":716897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":360448,"data_stored":133920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":339968,"data_stored":126529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]}]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":339968,"data_stored":126529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":368640,"data_stored":134890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":339968,"data_stored":126529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":946176,"data_stored":723672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":320,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":327680,"data_stored":120262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-16T02:30:27.267 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-16T02:30:27.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.403+0000 7f1eb09d1640 1 Processor -- start 2023-11-16T02:30:27.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.403+0000 7f1eb09d1640 1 -- start start 2023-11-16T02:30:27.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.403+0000 7f1eb09d1640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1eac145020 0x7f1eac09bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:27.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.403+0000 7f1eb09d1640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1eac06fe20 0x7f1eac0b8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:27.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.403+0000 7f1eb09d1640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eac0b36d0 con 0x7f1eac070a70 2023-11-16T02:30:27.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.403+0000 7f1eb09d1640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eac06d0f0 con 0x7f1eac145020 2023-11-16T02:30:27.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.403+0000 7f1eb09d1640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac0b2e30 con 0x7f1eac06fe20 2023-11-16T02:30:27.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.403+0000 7f1ea3fff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1eac06fe20 0x7f1eac0b8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:27.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.403+0000 7f1eaa59c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f1eac145020 0x7f1eac09bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:27.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.403+0000 7f1ea3fff640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1eac06fe20 0x7f1eac0b8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3301/0 says I am v2:172.21.15.28:55026/0 (socket says 172.21.15.28:55026) 2023-11-16T02:30:27.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.403+0000 7f1eaad9d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f1eac070a70 0x7f1eac06c9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.28:45732/0 (socket says 172.21.15.28:45732) 2023-11-16T02:30:27.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.403+0000 7f1ea3fff640 1 -- 172.21.15.28:0/4012981632 learned_addr learned my addr 172.21.15.28:0/4012981632 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:27.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.403+0000 7f1ea3fff640 1 -- 172.21.15.28:0/4012981632 >> v2:172.21.15.70:3300/0 conn(0x7f1eac145020 msgr2=0x7f1eac09bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:27.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.403+0000 7f1ea3fff640 1 --2- 172.21.15.28:0/4012981632 >> v2:172.21.15.70:3300/0 conn(0x7f1eac145020 0x7f1eac09bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:27.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.403+0000 7f1ea3fff640 1 -- 172.21.15.28:0/4012981632 >> v1:172.21.15.70:6789/0 conn(0x7f1eac070a70 legacy=0x7f1eac06c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:27.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.403+0000 7f1ea3fff640 1 -- 172.21.15.28:0/4012981632 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac0b3110 con 0x7f1eac06fe20 2023-11-16T02:30:27.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.403+0000 7f1eaa59c640 1 --2- 172.21.15.28:0/4012981632 >> v2:172.21.15.70:3300/0 conn(0x7f1eac145020 0x7f1eac09bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-16T02:30:27.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.407+0000 7f1ea3fff640 1 --2- 172.21.15.28:0/4012981632 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1eac06fe20 0x7f1eac0b8600 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1e9400bb10 tx=0x7f1e9401ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c640e3e38362a61c server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:27.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.407+0000 7f1ea9d9b640 1 -- 172.21.15.28:0/4012981632 <== mon.2 v2:172.21.15.70:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e940a7b90 con 0x7f1eac06fe20 2023-11-16T02:30:27.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.407+0000 7f1ea9d9b640 1 -- 172.21.15.28:0/4012981632 <== mon.2 v2:172.21.15.70:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e940a7cf0 con 0x7f1eac06fe20 2023-11-16T02:30:27.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.407+0000 7f1ea9d9b640 1 -- 172.21.15.28:0/4012981632 <== mon.2 v2:172.21.15.70:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e940af660 con 0x7f1eac06fe20 2023-11-16T02:30:27.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.407+0000 7f1eb09d1640 1 -- 172.21.15.28:0/4012981632 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1eac06fe20 msgr2=0x7f1eac0b8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:27.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.407+0000 7f1eb09d1640 1 --2- 172.21.15.28:0/4012981632 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1eac06fe20 0x7f1eac0b8600 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1e9400bb10 tx=0x7f1e9401ebe0 comp rx=0 tx=0).stop 2023-11-16T02:30:27.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.407+0000 7f1eb09d1640 1 -- 172.21.15.28:0/4012981632 shutdown_connections 2023-11-16T02:30:27.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.407+0000 7f1eb09d1640 1 --2- 172.21.15.28:0/4012981632 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1eac06fe20 0x7f1eac0b8600 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:27.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.407+0000 7f1eb09d1640 1 --2- 172.21.15.28:0/4012981632 >> v2:172.21.15.70:3300/0 conn(0x7f1eac145020 0x7f1eac09bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:27.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.407+0000 7f1eb09d1640 1 -- 172.21.15.28:0/4012981632 >> 172.21.15.28:0/4012981632 conn(0x7f1eac06bec0 msgr2=0x7f1eac06c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:27.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.407+0000 7f1eb09d1640 1 -- 172.21.15.28:0/4012981632 shutdown_connections 2023-11-16T02:30:27.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.407+0000 7f1eb09d1640 1 -- 172.21.15.28:0/4012981632 wait complete. 2023-11-16T02:30:27.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.407+0000 7f1eb09d1640 1 Processor -- start 2023-11-16T02:30:27.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.407+0000 7f1eb09d1640 1 -- start start 2023-11-16T02:30:27.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.407+0000 7f1eb09d1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1eac06fe20 0x7f1eac13d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:27.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.407+0000 7f1eb09d1640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1eac070a70 0x7f1eac147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:27.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.407+0000 7f1eb09d1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1eac145020 0x7f1eac1e2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:27.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.407+0000 7f1eb09d1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac13da80 con 0x7f1eac06fe20 2023-11-16T02:30:27.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.407+0000 7f1eb09d1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac0b6310 con 0x7f1eac145020 2023-11-16T02:30:27.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.407+0000 7f1eb09d1640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac1480c0 con 0x7f1eac070a70 2023-11-16T02:30:27.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.407+0000 7f1eaa59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1eac06fe20 0x7f1eac13d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:27.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.411+0000 7f1eaa59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1eac06fe20 0x7f1eac13d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54288/0 (socket says 172.21.15.28:54288) 2023-11-16T02:30:27.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.411+0000 7f1eaa59c640 1 -- 172.21.15.28:0/12839139 learned_addr learned my addr 172.21.15.28:0/12839139 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:27.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.411+0000 7f1eaad9d640 1 --2- 172.21.15.28:0/12839139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1eac145020 0x7f1eac1e2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:27.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.411+0000 7f1ea3fff640 1 --2- 172.21.15.28:0/12839139 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1eac070a70 0x7f1eac147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:27.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.411+0000 7f1eaa59c640 1 -- 172.21.15.28:0/12839139 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1eac070a70 msgr2=0x7f1eac147b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:27.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.411+0000 7f1eaa59c640 1 --2- 172.21.15.28:0/12839139 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1eac070a70 0x7f1eac147b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:27.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.411+0000 7f1eaa59c640 1 -- 172.21.15.28:0/12839139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1eac145020 msgr2=0x7f1eac1e2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:27.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.411+0000 7f1eaa59c640 1 --2- 172.21.15.28:0/12839139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1eac145020 0x7f1eac1e2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:27.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.411+0000 7f1eaa59c640 1 -- 172.21.15.28:0/12839139 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9c009420 con 0x7f1eac06fe20 2023-11-16T02:30:27.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.411+0000 7f1eaa59c640 1 --2- 172.21.15.28:0/12839139 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1eac06fe20 0x7f1eac13d540 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00e980 tx=0x7f1e9c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:27.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.411+0000 7f1ea2ffd640 1 -- 172.21.15.28:0/12839139 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c00ca00 con 0x7f1eac06fe20 2023-11-16T02:30:27.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.411+0000 7f1ea2ffd640 1 -- 172.21.15.28:0/12839139 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9c00cb60 con 0x7f1eac06fe20 2023-11-16T02:30:27.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.411+0000 7f1eb09d1640 1 -- 172.21.15.28:0/12839139 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e9400b770 con 0x7f1eac06fe20 2023-11-16T02:30:27.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.411+0000 7f1ea2ffd640 1 -- 172.21.15.28:0/12839139 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c013470 con 0x7f1eac06fe20 2023-11-16T02:30:27.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.411+0000 7f1eb09d1640 1 -- 172.21.15.28:0/12839139 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eac0b6660 con 0x7f1eac06fe20 2023-11-16T02:30:27.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.411+0000 7f1eb09d1640 1 -- 172.21.15.28:0/12839139 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eac04e8a0 con 0x7f1eac06fe20 2023-11-16T02:30:27.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.411+0000 7f1ea2ffd640 1 -- 172.21.15.28:0/12839139 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1e9c0135d0 con 0x7f1eac06fe20 2023-11-16T02:30:27.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.411+0000 7f1ea2ffd640 1 --2- 172.21.15.28:0/12839139 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1e8c065a90 0x7f1e8c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:27.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.411+0000 7f1ea2ffd640 1 -- 172.21.15.28:0/12839139 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e9c083430 con 0x7f1eac06fe20 2023-11-16T02:30:27.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.411+0000 7f1ea3fff640 1 --2- 172.21.15.28:0/12839139 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1e8c065a90 0x7f1e8c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:27.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.411+0000 7f1ea3fff640 1 --2- 172.21.15.28:0/12839139 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1e8c065a90 0x7f1e8c067f50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1e940b1000 tx=0x7f1e940a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:27.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.415+0000 7f1ea2ffd640 1 -- 172.21.15.28:0/12839139 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f1e9c050e00 con 0x7f1eac06fe20 2023-11-16T02:30:27.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.575+0000 7f1eb09d1640 1 -- 172.21.15.28:0/12839139 --> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1eac0702d0 con 0x7f1e8c065a90 2023-11-16T02:30:27.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.579+0000 7f1ea2ffd640 1 -- 172.21.15.28:0/12839139 <== mgr.4104 v2:172.21.15.28:6832/38651 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264636 (secure 0 0 0) 0x7f1e940ad340 con 0x7f1e8c065a90 2023-11-16T02:30:27.585 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:30:27.588 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-11-16T02:30:27.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.587+0000 7f1eb09d1640 1 -- 172.21.15.28:0/12839139 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1e8c065a90 msgr2=0x7f1e8c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:27.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.587+0000 7f1eb09d1640 1 --2- 172.21.15.28:0/12839139 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1e8c065a90 0x7f1e8c067f50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1e940b1000 tx=0x7f1e940a9070 comp rx=0 tx=0).stop 2023-11-16T02:30:27.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.587+0000 7f1eb09d1640 1 -- 172.21.15.28:0/12839139 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1eac06fe20 msgr2=0x7f1eac13d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:27.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.587+0000 7f1eb09d1640 1 --2- 172.21.15.28:0/12839139 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1eac06fe20 0x7f1eac13d540 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c00e980 tx=0x7f1e9c00ee40 comp rx=0 tx=0).stop 2023-11-16T02:30:27.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.587+0000 7f1eb09d1640 1 -- 172.21.15.28:0/12839139 shutdown_connections 2023-11-16T02:30:27.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.587+0000 7f1eb09d1640 1 --2- 172.21.15.28:0/12839139 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f1e8c065a90 0x7f1e8c067f50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:27.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.587+0000 7f1eb09d1640 1 --2- 172.21.15.28:0/12839139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1eac145020 0x7f1eac1e2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:27.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.587+0000 7f1eb09d1640 1 --2- 172.21.15.28:0/12839139 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f1eac070a70 0x7f1eac147b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:27.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.587+0000 7f1eb09d1640 1 --2- 172.21.15.28:0/12839139 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1eac06fe20 0x7f1eac13d540 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:27.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.587+0000 7f1eb09d1640 1 -- 172.21.15.28:0/12839139 >> 172.21.15.28:0/12839139 conn(0x7f1eac06bec0 msgr2=0x7f1eac0ba700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:27.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.587+0000 7f1eb09d1640 1 -- 172.21.15.28:0/12839139 shutdown_connections 2023-11-16T02:30:27.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.587+0000 7f1eb09d1640 1 -- 172.21.15.28:0/12839139 wait complete. 2023-11-16T02:30:27.606 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2023-11-16T02:30:26.429531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252456,"kb_used_data":4072,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754722264,"statfs":{"total":773094113280,"available":772835598336,"internally_reserved":0,"allocated":4169728,"data_stored":2302292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.989689"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.453679+0000","last_change":"2023-11-16T02:30:19.870271+0000","last_active":"2023-11-16T02:30:20.453679+0000","last_peered":"2023-11-16T02:30:20.453679+0000","last_clean":"2023-11-16T02:30:20.453679+0000","last_became_active":"2023-11-16T02:30:19.869530+0000","last_became_peered":"2023-11-16T02:30:19.869530+0000","last_unstale":"2023-11-16T02:30:20.453679+0000","last_undegraded":"2023-11-16T02:30:20.453679+0000","last_fullsized":"2023-11-16T02:30:20.453679+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:34:33.419560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.449643+0000","last_change":"2023-11-16T02:30:19.847500+0000","last_active":"2023-11-16T02:30:20.449643+0000","last_peered":"2023-11-16T02:30:20.449643+0000","last_clean":"2023-11-16T02:30:20.449643+0000","last_became_active":"2023-11-16T02:30:19.847125+0000","last_became_peered":"2023-11-16T02:30:19.847125+0000","last_unstale":"2023-11-16T02:30:20.449643+0000","last_undegraded":"2023-11-16T02:30:20.449643+0000","last_fullsized":"2023-11-16T02:30:20.449643+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:04:02.319109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452499+0000","last_change":"2023-11-16T02:30:19.866614+0000","last_active":"2023-11-16T02:30:20.452499+0000","last_peered":"2023-11-16T02:30:20.452499+0000","last_clean":"2023-11-16T02:30:20.452499+0000","last_became_active":"2023-11-16T02:30:19.865850+0000","last_became_peered":"2023-11-16T02:30:19.865850+0000","last_unstale":"2023-11-16T02:30:20.452499+0000","last_undegraded":"2023-11-16T02:30:20.452499+0000","last_fullsized":"2023-11-16T02:30:20.452499+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:26:35.043805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.446144+0000","last_change":"2023-11-16T02:30:19.882299+0000","last_active":"2023-11-16T02:30:20.446144+0000","last_peered":"2023-11-16T02:30:20.446144+0000","last_clean":"2023-11-16T02:30:20.446144+0000","last_became_active":"2023-11-16T02:30:19.882012+0000","last_became_peered":"2023-11-16T02:30:19.882012+0000","last_unstale":"2023-11-16T02:30:20.446144+0000","last_undegraded":"2023-11-16T02:30:20.446144+0000","last_fullsized":"2023-11-16T02:30:20.446144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:05:48.808451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-16T02:30:21.337615+0000","last_change":"2023-11-16T02:30:19.842189+0000","last_active":"2023-11-16T02:30:21.337615+0000","last_peered":"2023-11-16T02:30:21.337615+0000","last_clean":"2023-11-16T02:30:21.337615+0000","last_became_active":"2023-11-16T02:30:19.841869+0000","last_became_peered":"2023-11-16T02:30:19.841869+0000","last_unstale":"2023-11-16T02:30:21.337615+0000","last_undegraded":"2023-11-16T02:30:21.337615+0000","last_fullsized":"2023-11-16T02:30:21.337615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:27:05.151415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.449304+0000","last_change":"2023-11-16T02:30:19.873025+0000","last_active":"2023-11-16T02:30:20.449304+0000","last_peered":"2023-11-16T02:30:20.449304+0000","last_clean":"2023-11-16T02:30:20.449304+0000","last_became_active":"2023-11-16T02:30:19.872781+0000","last_became_peered":"2023-11-16T02:30:19.872781+0000","last_unstale":"2023-11-16T02:30:20.449304+0000","last_undegraded":"2023-11-16T02:30:20.449304+0000","last_fullsized":"2023-11-16T02:30:20.449304+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:19:10.953087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.457393+0000","last_change":"2023-11-16T02:30:19.886324+0000","last_active":"2023-11-16T02:30:20.457393+0000","last_peered":"2023-11-16T02:30:20.457393+0000","last_clean":"2023-11-16T02:30:20.457393+0000","last_became_active":"2023-11-16T02:30:19.885725+0000","last_became_peered":"2023-11-16T02:30:19.885725+0000","last_unstale":"2023-11-16T02:30:20.457393+0000","last_undegraded":"2023-11-16T02:30:20.457393+0000","last_fullsized":"2023-11-16T02:30:20.457393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:29:41.914615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.457238+0000","last_change":"2023-11-16T02:30:19.874493+0000","last_active":"2023-11-16T02:30:20.457238+0000","last_peered":"2023-11-16T02:30:20.457238+0000","last_clean":"2023-11-16T02:30:20.457238+0000","last_became_active":"2023-11-16T02:30:19.872914+0000","last_became_peered":"2023-11-16T02:30:19.872914+0000","last_unstale":"2023-11-16T02:30:20.457238+0000","last_undegraded":"2023-11-16T02:30:20.457238+0000","last_fullsized":"2023-11-16T02:30:20.457238+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:58:23.597351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452940+0000","last_change":"2023-11-16T02:30:19.846299+0000","last_active":"2023-11-16T02:30:20.452940+0000","last_peered":"2023-11-16T02:30:20.452940+0000","last_clean":"2023-11-16T02:30:20.452940+0000","last_became_active":"2023-11-16T02:30:19.845561+0000","last_became_peered":"2023-11-16T02:30:19.845561+0000","last_unstale":"2023-11-16T02:30:20.452940+0000","last_undegraded":"2023-11-16T02:30:20.452940+0000","last_fullsized":"2023-11-16T02:30:20.452940+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:24:43.125348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.446380+0000","last_change":"2023-11-16T02:30:19.843307+0000","last_active":"2023-11-16T02:30:20.446380+0000","last_peered":"2023-11-16T02:30:20.446380+0000","last_clean":"2023-11-16T02:30:20.446380+0000","last_became_active":"2023-11-16T02:30:19.842948+0000","last_became_peered":"2023-11-16T02:30:19.842948+0000","last_unstale":"2023-11-16T02:30:20.446380+0000","last_undegraded":"2023-11-16T02:30:20.446380+0000","last_fullsized":"2023-11-16T02:30:20.446380+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:51:01.130415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.457490+0000","last_change":"2023-11-16T02:30:19.884857+0000","last_active":"2023-11-16T02:30:20.457490+0000","last_peered":"2023-11-16T02:30:20.457490+0000","last_clean":"2023-11-16T02:30:20.457490+0000","last_became_active":"2023-11-16T02:30:19.884211+0000","last_became_peered":"2023-11-16T02:30:19.884211+0000","last_unstale":"2023-11-16T02:30:20.457490+0000","last_undegraded":"2023-11-16T02:30:20.457490+0000","last_fullsized":"2023-11-16T02:30:20.457490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:26:35.043805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452364+0000","last_change":"2023-11-16T02:30:19.873333+0000","last_active":"2023-11-16T02:30:20.452364+0000","last_peered":"2023-11-16T02:30:20.452364+0000","last_clean":"2023-11-16T02:30:20.452364+0000","last_became_active":"2023-11-16T02:30:19.872312+0000","last_became_peered":"2023-11-16T02:30:19.872312+0000","last_unstale":"2023-11-16T02:30:20.452364+0000","last_undegraded":"2023-11-16T02:30:20.452364+0000","last_fullsized":"2023-11-16T02:30:20.452364+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:01:25.904236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-16T02:30:21.337810+0000","last_change":"2023-11-16T02:30:19.844667+0000","last_active":"2023-11-16T02:30:21.337810+0000","last_peered":"2023-11-16T02:30:21.337810+0000","last_clean":"2023-11-16T02:30:21.337810+0000","last_became_active":"2023-11-16T02:30:19.843822+0000","last_became_peered":"2023-11-16T02:30:19.843822+0000","last_unstale":"2023-11-16T02:30:21.337810+0000","last_undegraded":"2023-11-16T02:30:21.337810+0000","last_fullsized":"2023-11-16T02:30:21.337810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:40:31.862771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.449347+0000","last_change":"2023-11-16T02:30:19.847259+0000","last_active":"2023-11-16T02:30:20.449347+0000","last_peered":"2023-11-16T02:30:20.449347+0000","last_clean":"2023-11-16T02:30:20.449347+0000","last_became_active":"2023-11-16T02:30:19.846960+0000","last_became_peered":"2023-11-16T02:30:19.846960+0000","last_unstale":"2023-11-16T02:30:20.449347+0000","last_undegraded":"2023-11-16T02:30:20.449347+0000","last_fullsized":"2023-11-16T02:30:20.449347+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T09:23:18.109208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452316+0000","last_change":"2023-11-16T02:30:19.866095+0000","last_active":"2023-11-16T02:30:20.452316+0000","last_peered":"2023-11-16T02:30:20.452316+0000","last_clean":"2023-11-16T02:30:20.452316+0000","last_became_active":"2023-11-16T02:30:19.865309+0000","last_became_peered":"2023-11-16T02:30:19.865309+0000","last_unstale":"2023-11-16T02:30:20.452316+0000","last_undegraded":"2023-11-16T02:30:20.452316+0000","last_fullsized":"2023-11-16T02:30:20.452316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:05:48.808451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.457326+0000","last_change":"2023-11-16T02:30:19.874960+0000","last_active":"2023-11-16T02:30:20.457326+0000","last_peered":"2023-11-16T02:30:20.457326+0000","last_clean":"2023-11-16T02:30:20.457326+0000","last_became_active":"2023-11-16T02:30:19.873799+0000","last_became_peered":"2023-11-16T02:30:19.873799+0000","last_unstale":"2023-11-16T02:30:20.457326+0000","last_undegraded":"2023-11-16T02:30:20.457326+0000","last_fullsized":"2023-11-16T02:30:20.457326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:25:44.847232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.457513+0000","last_change":"2023-11-16T02:30:19.885005+0000","last_active":"2023-11-16T02:30:20.457513+0000","last_peered":"2023-11-16T02:30:20.457513+0000","last_clean":"2023-11-16T02:30:20.457513+0000","last_became_active":"2023-11-16T02:30:19.884513+0000","last_became_peered":"2023-11-16T02:30:19.884513+0000","last_unstale":"2023-11-16T02:30:20.457513+0000","last_undegraded":"2023-11-16T02:30:20.457513+0000","last_fullsized":"2023-11-16T02:30:20.457513+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:23:28.656034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.449692+0000","last_change":"2023-11-16T02:30:19.840626+0000","last_active":"2023-11-16T02:30:20.449692+0000","last_peered":"2023-11-16T02:30:20.449692+0000","last_clean":"2023-11-16T02:30:20.449692+0000","last_became_active":"2023-11-16T02:30:19.840345+0000","last_became_peered":"2023-11-16T02:30:19.840345+0000","last_unstale":"2023-11-16T02:30:20.449692+0000","last_undegraded":"2023-11-16T02:30:20.449692+0000","last_fullsized":"2023-11-16T02:30:20.449692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:23:28.656034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.449543+0000","last_change":"2023-11-16T02:30:19.845327+0000","last_active":"2023-11-16T02:30:20.449543+0000","last_peered":"2023-11-16T02:30:20.449543+0000","last_clean":"2023-11-16T02:30:20.449543+0000","last_became_active":"2023-11-16T02:30:19.845068+0000","last_became_peered":"2023-11-16T02:30:19.845068+0000","last_unstale":"2023-11-16T02:30:20.449543+0000","last_undegraded":"2023-11-16T02:30:20.449543+0000","last_fullsized":"2023-11-16T02:30:20.449543+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:58:23.597351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-16T02:30:21.337875+0000","last_change":"2023-11-16T02:30:19.874388+0000","last_active":"2023-11-16T02:30:21.337875+0000","last_peered":"2023-11-16T02:30:21.337875+0000","last_clean":"2023-11-16T02:30:21.337875+0000","last_became_active":"2023-11-16T02:30:19.874116+0000","last_became_peered":"2023-11-16T02:30:19.874116+0000","last_unstale":"2023-11-16T02:30:21.337875+0000","last_undegraded":"2023-11-16T02:30:21.337875+0000","last_fullsized":"2023-11-16T02:30:21.337875+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:12:11.102522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452596+0000","last_change":"2023-11-16T02:30:19.879907+0000","last_active":"2023-11-16T02:30:20.452596+0000","last_peered":"2023-11-16T02:30:20.452596+0000","last_clean":"2023-11-16T02:30:20.452596+0000","last_became_active":"2023-11-16T02:30:19.878794+0000","last_became_peered":"2023-11-16T02:30:19.878794+0000","last_unstale":"2023-11-16T02:30:20.452596+0000","last_undegraded":"2023-11-16T02:30:20.452596+0000","last_fullsized":"2023-11-16T02:30:20.452596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:05:25.212455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452495+0000","last_change":"2023-11-16T02:30:19.867043+0000","last_active":"2023-11-16T02:30:20.452495+0000","last_peered":"2023-11-16T02:30:20.452495+0000","last_clean":"2023-11-16T02:30:20.452495+0000","last_became_active":"2023-11-16T02:30:19.866232+0000","last_became_peered":"2023-11-16T02:30:19.866232+0000","last_unstale":"2023-11-16T02:30:20.452495+0000","last_undegraded":"2023-11-16T02:30:20.452495+0000","last_fullsized":"2023-11-16T02:30:20.452495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:51:01.130415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.448306+0000","last_change":"2023-11-16T02:30:19.875797+0000","last_active":"2023-11-16T02:30:20.448306+0000","last_peered":"2023-11-16T02:30:20.448306+0000","last_clean":"2023-11-16T02:30:20.448306+0000","last_became_active":"2023-11-16T02:30:19.875422+0000","last_became_peered":"2023-11-16T02:30:19.875422+0000","last_unstale":"2023-11-16T02:30:20.448306+0000","last_undegraded":"2023-11-16T02:30:20.448306+0000","last_fullsized":"2023-11-16T02:30:20.448306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:51:01.130415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452259+0000","last_change":"2023-11-16T02:30:19.867144+0000","last_active":"2023-11-16T02:30:20.452259+0000","last_peered":"2023-11-16T02:30:20.452259+0000","last_clean":"2023-11-16T02:30:20.452259+0000","last_became_active":"2023-11-16T02:30:19.865272+0000","last_became_peered":"2023-11-16T02:30:19.865272+0000","last_unstale":"2023-11-16T02:30:20.452259+0000","last_undegraded":"2023-11-16T02:30:20.452259+0000","last_fullsized":"2023-11-16T02:30:20.452259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:53:26.356470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.446428+0000","last_change":"2023-11-16T02:30:19.872380+0000","last_active":"2023-11-16T02:30:20.446428+0000","last_peered":"2023-11-16T02:30:20.446428+0000","last_clean":"2023-11-16T02:30:20.446428+0000","last_became_active":"2023-11-16T02:30:19.872131+0000","last_became_peered":"2023-11-16T02:30:19.872131+0000","last_unstale":"2023-11-16T02:30:20.446428+0000","last_undegraded":"2023-11-16T02:30:20.446428+0000","last_fullsized":"2023-11-16T02:30:20.446428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:14:02.468285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.449737+0000","last_change":"2023-11-16T02:30:19.873009+0000","last_active":"2023-11-16T02:30:20.449737+0000","last_peered":"2023-11-16T02:30:20.449737+0000","last_clean":"2023-11-16T02:30:20.449737+0000","last_became_active":"2023-11-16T02:30:19.872718+0000","last_became_peered":"2023-11-16T02:30:19.872718+0000","last_unstale":"2023-11-16T02:30:20.449737+0000","last_undegraded":"2023-11-16T02:30:20.449737+0000","last_fullsized":"2023-11-16T02:30:20.449737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:57:16.626801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.446286+0000","last_change":"2023-11-16T02:30:19.877492+0000","last_active":"2023-11-16T02:30:20.446286+0000","last_peered":"2023-11-16T02:30:20.446286+0000","last_clean":"2023-11-16T02:30:20.446286+0000","last_became_active":"2023-11-16T02:30:19.877055+0000","last_became_peered":"2023-11-16T02:30:19.877055+0000","last_unstale":"2023-11-16T02:30:20.446286+0000","last_undegraded":"2023-11-16T02:30:20.446286+0000","last_fullsized":"2023-11-16T02:30:20.446286+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:30:57.683829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452385+0000","last_change":"2023-11-16T02:30:19.873823+0000","last_active":"2023-11-16T02:30:20.452385+0000","last_peered":"2023-11-16T02:30:20.452385+0000","last_clean":"2023-11-16T02:30:20.452385+0000","last_became_active":"2023-11-16T02:30:19.873097+0000","last_became_peered":"2023-11-16T02:30:19.873097+0000","last_unstale":"2023-11-16T02:30:20.452385+0000","last_undegraded":"2023-11-16T02:30:20.452385+0000","last_fullsized":"2023-11-16T02:30:20.452385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:11:01.176911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452645+0000","last_change":"2023-11-16T02:30:19.879438+0000","last_active":"2023-11-16T02:30:20.452645+0000","last_peered":"2023-11-16T02:30:20.452645+0000","last_clean":"2023-11-16T02:30:20.452645+0000","last_became_active":"2023-11-16T02:30:19.878067+0000","last_became_peered":"2023-11-16T02:30:19.878067+0000","last_unstale":"2023-11-16T02:30:20.452645+0000","last_undegraded":"2023-11-16T02:30:20.452645+0000","last_fullsized":"2023-11-16T02:30:20.452645+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:53:26.356470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.457413+0000","last_change":"2023-11-16T02:30:19.885674+0000","last_active":"2023-11-16T02:30:20.457413+0000","last_peered":"2023-11-16T02:30:20.457413+0000","last_clean":"2023-11-16T02:30:20.457413+0000","last_became_active":"2023-11-16T02:30:19.884062+0000","last_became_peered":"2023-11-16T02:30:19.884062+0000","last_unstale":"2023-11-16T02:30:20.457413+0000","last_undegraded":"2023-11-16T02:30:20.457413+0000","last_fullsized":"2023-11-16T02:30:20.457413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:59:15.040356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.453545+0000","last_change":"2023-11-16T02:30:19.859781+0000","last_active":"2023-11-16T02:30:20.453545+0000","last_peered":"2023-11-16T02:30:20.453545+0000","last_clean":"2023-11-16T02:30:20.453545+0000","last_became_active":"2023-11-16T02:30:19.857455+0000","last_became_peered":"2023-11-16T02:30:19.857455+0000","last_unstale":"2023-11-16T02:30:20.453545+0000","last_undegraded":"2023-11-16T02:30:20.453545+0000","last_fullsized":"2023-11-16T02:30:20.453545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:17:17.336842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.457277+0000","last_change":"2023-11-16T02:30:19.880769+0000","last_active":"2023-11-16T02:30:20.457277+0000","last_peered":"2023-11-16T02:30:20.457277+0000","last_clean":"2023-11-16T02:30:20.457277+0000","last_became_active":"2023-11-16T02:30:19.878925+0000","last_became_peered":"2023-11-16T02:30:19.878925+0000","last_unstale":"2023-11-16T02:30:20.457277+0000","last_undegraded":"2023-11-16T02:30:20.457277+0000","last_fullsized":"2023-11-16T02:30:20.457277+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:57:16.626801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.448427+0000","last_change":"2023-11-16T02:30:19.875765+0000","last_active":"2023-11-16T02:30:20.448427+0000","last_peered":"2023-11-16T02:30:20.448427+0000","last_clean":"2023-11-16T02:30:20.448427+0000","last_became_active":"2023-11-16T02:30:19.875438+0000","last_became_peered":"2023-11-16T02:30:19.875438+0000","last_unstale":"2023-11-16T02:30:20.448427+0000","last_undegraded":"2023-11-16T02:30:20.448427+0000","last_fullsized":"2023-11-16T02:30:20.448427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:53:26.356470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.453727+0000","last_change":"2023-11-16T02:30:19.484973+0000","last_active":"2023-11-16T02:30:20.453727+0000","last_peered":"2023-11-16T02:30:20.453727+0000","last_clean":"2023-11-16T02:30:20.453727+0000","last_became_active":"2023-11-16T02:30:19.484403+0000","last_became_peered":"2023-11-16T02:30:19.484403+0000","last_unstale":"2023-11-16T02:30:20.453727+0000","last_undegraded":"2023-11-16T02:30:20.453727+0000","last_fullsized":"2023-11-16T02:30:20.453727+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:30:11.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.453703+0000","last_change":"2023-11-16T02:30:19.886424+0000","last_active":"2023-11-16T02:30:20.453703+0000","last_peered":"2023-11-16T02:30:20.453703+0000","last_clean":"2023-11-16T02:30:20.453703+0000","last_became_active":"2023-11-16T02:30:19.885778+0000","last_became_peered":"2023-11-16T02:30:19.885778+0000","last_unstale":"2023-11-16T02:30:20.453703+0000","last_undegraded":"2023-11-16T02:30:20.453703+0000","last_fullsized":"2023-11-16T02:30:20.453703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:26:16.324058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.448448+0000","last_change":"2023-11-16T02:30:19.467799+0000","last_active":"2023-11-16T02:30:20.448448+0000","last_peered":"2023-11-16T02:30:20.448448+0000","last_clean":"2023-11-16T02:30:20.448448+0000","last_became_active":"2023-11-16T02:30:19.467517+0000","last_became_peered":"2023-11-16T02:30:19.467517+0000","last_unstale":"2023-11-16T02:30:20.448448+0000","last_undegraded":"2023-11-16T02:30:20.448448+0000","last_fullsized":"2023-11-16T02:30:20.448448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:53:29.543335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452767+0000","last_change":"2023-11-16T02:30:19.865354+0000","last_active":"2023-11-16T02:30:20.452767+0000","last_peered":"2023-11-16T02:30:20.452767+0000","last_clean":"2023-11-16T02:30:20.452767+0000","last_became_active":"2023-11-16T02:30:19.864635+0000","last_became_peered":"2023-11-16T02:30:19.864635+0000","last_unstale":"2023-11-16T02:30:20.452767+0000","last_undegraded":"2023-11-16T02:30:20.452767+0000","last_fullsized":"2023-11-16T02:30:20.452767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T09:30:55.572569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.449591+0000","last_change":"2023-11-16T02:30:19.463569+0000","last_active":"2023-11-16T02:30:20.449591+0000","last_peered":"2023-11-16T02:30:20.449591+0000","last_clean":"2023-11-16T02:30:20.449591+0000","last_became_active":"2023-11-16T02:30:19.463298+0000","last_became_peered":"2023-11-16T02:30:19.463298+0000","last_unstale":"2023-11-16T02:30:20.449591+0000","last_undegraded":"2023-11-16T02:30:20.449591+0000","last_fullsized":"2023-11-16T02:30:20.449591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:26:15.319244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.446332+0000","last_change":"2023-11-16T02:30:19.876755+0000","last_active":"2023-11-16T02:30:20.446332+0000","last_peered":"2023-11-16T02:30:20.446332+0000","last_clean":"2023-11-16T02:30:20.446332+0000","last_became_active":"2023-11-16T02:30:19.876454+0000","last_became_peered":"2023-11-16T02:30:19.876454+0000","last_unstale":"2023-11-16T02:30:20.446332+0000","last_undegraded":"2023-11-16T02:30:20.446332+0000","last_fullsized":"2023-11-16T02:30:20.446332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T09:30:55.572569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.852735+0000","last_change":"2023-11-16T02:30:19.470489+0000","last_active":"2023-11-16T02:30:19.852735+0000","last_peered":"2023-11-16T02:30:19.852735+0000","last_clean":"2023-11-16T02:30:19.852735+0000","last_became_active":"2023-11-16T02:30:19.470139+0000","last_became_peered":"2023-11-16T02:30:19.470139+0000","last_unstale":"2023-11-16T02:30:19.852735+0000","last_undegraded":"2023-11-16T02:30:19.852735+0000","last_fullsized":"2023-11-16T02:30:19.852735+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:15:52.039420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.457440+0000","last_change":"2023-11-16T02:30:19.887577+0000","last_active":"2023-11-16T02:30:20.457440+0000","last_peered":"2023-11-16T02:30:20.457440+0000","last_clean":"2023-11-16T02:30:20.457440+0000","last_became_active":"2023-11-16T02:30:19.886948+0000","last_became_peered":"2023-11-16T02:30:19.886948+0000","last_unstale":"2023-11-16T02:30:20.457440+0000","last_undegraded":"2023-11-16T02:30:20.457440+0000","last_fullsized":"2023-11-16T02:30:20.457440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:11:01.176911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452713+0000","last_change":"2023-11-16T02:30:19.461227+0000","last_active":"2023-11-16T02:30:20.452713+0000","last_peered":"2023-11-16T02:30:20.452713+0000","last_clean":"2023-11-16T02:30:20.452713+0000","last_became_active":"2023-11-16T02:30:19.460450+0000","last_became_peered":"2023-11-16T02:30:19.460450+0000","last_unstale":"2023-11-16T02:30:20.452713+0000","last_undegraded":"2023-11-16T02:30:20.452713+0000","last_fullsized":"2023-11-16T02:30:20.452713+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:07:18.071597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452339+0000","last_change":"2023-11-16T02:30:19.868426+0000","last_active":"2023-11-16T02:30:20.452339+0000","last_peered":"2023-11-16T02:30:20.452339+0000","last_clean":"2023-11-16T02:30:20.452339+0000","last_became_active":"2023-11-16T02:30:19.866177+0000","last_became_peered":"2023-11-16T02:30:19.866177+0000","last_unstale":"2023-11-16T02:30:20.452339+0000","last_undegraded":"2023-11-16T02:30:20.452339+0000","last_fullsized":"2023-11-16T02:30:20.452339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:14:02.468285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452543+0000","last_change":"2023-11-16T02:30:19.461149+0000","last_active":"2023-11-16T02:30:20.452543+0000","last_peered":"2023-11-16T02:30:20.452543+0000","last_clean":"2023-11-16T02:30:20.452543+0000","last_became_active":"2023-11-16T02:30:19.460646+0000","last_became_peered":"2023-11-16T02:30:19.460646+0000","last_unstale":"2023-11-16T02:30:20.452543+0000","last_undegraded":"2023-11-16T02:30:20.452543+0000","last_fullsized":"2023-11-16T02:30:20.452543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:08:35.892877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452324+0000","last_change":"2023-11-16T02:30:19.878750+0000","last_active":"2023-11-16T02:30:20.452324+0000","last_peered":"2023-11-16T02:30:20.452324+0000","last_clean":"2023-11-16T02:30:20.452324+0000","last_became_active":"2023-11-16T02:30:19.878234+0000","last_became_peered":"2023-11-16T02:30:19.878234+0000","last_unstale":"2023-11-16T02:30:20.452324+0000","last_undegraded":"2023-11-16T02:30:20.452324+0000","last_fullsized":"2023-11-16T02:30:20.452324+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:11:46.387664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.449258+0000","last_change":"2023-11-16T02:30:19.469556+0000","last_active":"2023-11-16T02:30:20.449258+0000","last_peered":"2023-11-16T02:30:20.449258+0000","last_clean":"2023-11-16T02:30:20.449258+0000","last_became_active":"2023-11-16T02:30:19.468872+0000","last_became_peered":"2023-11-16T02:30:19.468872+0000","last_unstale":"2023-11-16T02:30:20.449258+0000","last_undegraded":"2023-11-16T02:30:20.449258+0000","last_fullsized":"2023-11-16T02:30:20.449258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:11:45.382850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.445949+0000","last_change":"2023-11-16T02:30:19.869582+0000","last_active":"2023-11-16T02:30:20.445949+0000","last_peered":"2023-11-16T02:30:20.445949+0000","last_clean":"2023-11-16T02:30:20.445949+0000","last_became_active":"2023-11-16T02:30:19.869254+0000","last_became_peered":"2023-11-16T02:30:19.869254+0000","last_unstale":"2023-11-16T02:30:20.445949+0000","last_undegraded":"2023-11-16T02:30:20.445949+0000","last_fullsized":"2023-11-16T02:30:20.445949+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:26:35.043805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452378+0000","last_change":"2023-11-16T02:30:19.466145+0000","last_active":"2023-11-16T02:30:20.452378+0000","last_peered":"2023-11-16T02:30:20.452378+0000","last_clean":"2023-11-16T02:30:20.452378+0000","last_became_active":"2023-11-16T02:30:19.465726+0000","last_became_peered":"2023-11-16T02:30:19.465726+0000","last_unstale":"2023-11-16T02:30:20.452378+0000","last_undegraded":"2023-11-16T02:30:20.452378+0000","last_fullsized":"2023-11-16T02:30:20.452378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:23:32.728712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452549+0000","last_change":"2023-11-16T02:30:19.867919+0000","last_active":"2023-11-16T02:30:20.452549+0000","last_peered":"2023-11-16T02:30:20.452549+0000","last_clean":"2023-11-16T02:30:20.452549+0000","last_became_active":"2023-11-16T02:30:19.867061+0000","last_became_peered":"2023-11-16T02:30:19.867061+0000","last_unstale":"2023-11-16T02:30:20.452549+0000","last_undegraded":"2023-11-16T02:30:20.452549+0000","last_fullsized":"2023-11-16T02:30:20.452549+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:30:57.683829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.449825+0000","last_change":"2023-11-16T02:30:19.472891+0000","last_active":"2023-11-16T02:30:20.449825+0000","last_peered":"2023-11-16T02:30:20.449825+0000","last_clean":"2023-11-16T02:30:20.449825+0000","last_became_active":"2023-11-16T02:30:19.472450+0000","last_became_peered":"2023-11-16T02:30:19.472450+0000","last_unstale":"2023-11-16T02:30:20.449825+0000","last_undegraded":"2023-11-16T02:30:20.449825+0000","last_fullsized":"2023-11-16T02:30:20.449825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:34:32.414746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.449780+0000","last_change":"2023-11-16T02:30:19.840186+0000","last_active":"2023-11-16T02:30:20.449780+0000","last_peered":"2023-11-16T02:30:20.449780+0000","last_clean":"2023-11-16T02:30:20.449780+0000","last_became_active":"2023-11-16T02:30:19.839901+0000","last_became_peered":"2023-11-16T02:30:19.839901+0000","last_unstale":"2023-11-16T02:30:20.449780+0000","last_undegraded":"2023-11-16T02:30:20.449780+0000","last_fullsized":"2023-11-16T02:30:20.449780+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:00:28.306611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.448522+0000","last_change":"2023-11-16T02:30:19.467692+0000","last_active":"2023-11-16T02:30:20.448522+0000","last_peered":"2023-11-16T02:30:20.448522+0000","last_clean":"2023-11-16T02:30:20.448522+0000","last_became_active":"2023-11-16T02:30:19.467180+0000","last_became_peered":"2023-11-16T02:30:19.467180+0000","last_unstale":"2023-11-16T02:30:20.448522+0000","last_undegraded":"2023-11-16T02:30:20.448522+0000","last_fullsized":"2023-11-16T02:30:20.448522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:02:05.395662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.449444+0000","last_change":"2023-11-16T02:30:19.877297+0000","last_active":"2023-11-16T02:30:20.449444+0000","last_peered":"2023-11-16T02:30:20.449444+0000","last_clean":"2023-11-16T02:30:20.449444+0000","last_became_active":"2023-11-16T02:30:19.876717+0000","last_became_peered":"2023-11-16T02:30:19.876717+0000","last_unstale":"2023-11-16T02:30:20.449444+0000","last_undegraded":"2023-11-16T02:30:20.449444+0000","last_fullsized":"2023-11-16T02:30:20.449444+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:00:21.607056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452523+0000","last_change":"2023-11-16T02:30:19.482605+0000","last_active":"2023-11-16T02:30:20.452523+0000","last_peered":"2023-11-16T02:30:20.452523+0000","last_clean":"2023-11-16T02:30:20.452523+0000","last_became_active":"2023-11-16T02:30:19.481717+0000","last_became_peered":"2023-11-16T02:30:19.481717+0000","last_unstale":"2023-11-16T02:30:20.452523+0000","last_undegraded":"2023-11-16T02:30:20.452523+0000","last_fullsized":"2023-11-16T02:30:20.452523+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:27:42.254533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452467+0000","last_change":"2023-11-16T02:30:19.868734+0000","last_active":"2023-11-16T02:30:20.452467+0000","last_peered":"2023-11-16T02:30:20.452467+0000","last_clean":"2023-11-16T02:30:20.452467+0000","last_became_active":"2023-11-16T02:30:19.868028+0000","last_became_peered":"2023-11-16T02:30:19.868028+0000","last_unstale":"2023-11-16T02:30:20.452467+0000","last_undegraded":"2023-11-16T02:30:20.452467+0000","last_fullsized":"2023-11-16T02:30:20.452467+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:29:41.914615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.449493+0000","last_change":"2023-11-16T02:30:19.465379+0000","last_active":"2023-11-16T02:30:20.449493+0000","last_peered":"2023-11-16T02:30:20.449493+0000","last_clean":"2023-11-16T02:30:20.449493+0000","last_became_active":"2023-11-16T02:30:19.464674+0000","last_became_peered":"2023-11-16T02:30:19.464674+0000","last_unstale":"2023-11-16T02:30:20.449493+0000","last_undegraded":"2023-11-16T02:30:20.449493+0000","last_fullsized":"2023-11-16T02:30:20.449493+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:33:12.505379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.446004+0000","last_change":"2023-11-16T02:30:19.882010+0000","last_active":"2023-11-16T02:30:20.446004+0000","last_peered":"2023-11-16T02:30:20.446004+0000","last_clean":"2023-11-16T02:30:20.446004+0000","last_became_active":"2023-11-16T02:30:19.881685+0000","last_became_peered":"2023-11-16T02:30:19.881685+0000","last_unstale":"2023-11-16T02:30:20.446004+0000","last_undegraded":"2023-11-16T02:30:20.446004+0000","last_fullsized":"2023-11-16T02:30:20.446004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:11:01.176911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452739+0000","last_change":"2023-11-16T02:30:19.467910+0000","last_active":"2023-11-16T02:30:20.452739+0000","last_peered":"2023-11-16T02:30:20.452739+0000","last_clean":"2023-11-16T02:30:20.452739+0000","last_became_active":"2023-11-16T02:30:19.467432+0000","last_became_peered":"2023-11-16T02:30:19.467432+0000","last_unstale":"2023-11-16T02:30:20.452739+0000","last_undegraded":"2023-11-16T02:30:20.452739+0000","last_fullsized":"2023-11-16T02:30:20.452739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:59:51.546762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.449395+0000","last_change":"2023-11-16T02:30:19.840706+0000","last_active":"2023-11-16T02:30:20.449395+0000","last_peered":"2023-11-16T02:30:20.449395+0000","last_clean":"2023-11-16T02:30:20.449395+0000","last_became_active":"2023-11-16T02:30:19.840310+0000","last_became_peered":"2023-11-16T02:30:19.840310+0000","last_unstale":"2023-11-16T02:30:20.449395+0000","last_undegraded":"2023-11-16T02:30:20.449395+0000","last_fullsized":"2023-11-16T02:30:20.449395+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:01:25.904236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.446054+0000","last_change":"2023-11-16T02:30:19.467641+0000","last_active":"2023-11-16T02:30:20.446054+0000","last_peered":"2023-11-16T02:30:20.446054+0000","last_clean":"2023-11-16T02:30:20.446054+0000","last_became_active":"2023-11-16T02:30:19.467184+0000","last_became_peered":"2023-11-16T02:30:19.467184+0000","last_unstale":"2023-11-16T02:30:20.446054+0000","last_undegraded":"2023-11-16T02:30:20.446054+0000","last_fullsized":"2023-11-16T02:30:20.446054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:40:26.674869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.457300+0000","last_change":"2023-11-16T02:30:19.881218+0000","last_active":"2023-11-16T02:30:20.457300+0000","last_peered":"2023-11-16T02:30:20.457300+0000","last_clean":"2023-11-16T02:30:20.457300+0000","last_became_active":"2023-11-16T02:30:19.879762+0000","last_became_peered":"2023-11-16T02:30:19.879762+0000","last_unstale":"2023-11-16T02:30:20.457300+0000","last_undegraded":"2023-11-16T02:30:20.457300+0000","last_fullsized":"2023-11-16T02:30:20.457300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:01:25.904236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.449215+0000","last_change":"2023-11-16T02:30:19.472885+0000","last_active":"2023-11-16T02:30:20.449215+0000","last_peered":"2023-11-16T02:30:20.449215+0000","last_clean":"2023-11-16T02:30:20.449215+0000","last_became_active":"2023-11-16T02:30:19.472418+0000","last_became_peered":"2023-11-16T02:30:19.472418+0000","last_unstale":"2023-11-16T02:30:20.449215+0000","last_undegraded":"2023-11-16T02:30:20.449215+0000","last_fullsized":"2023-11-16T02:30:20.449215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:05:24.207641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.453580+0000","last_change":"2023-11-16T02:30:19.880084+0000","last_active":"2023-11-16T02:30:20.453580+0000","last_peered":"2023-11-16T02:30:20.453580+0000","last_clean":"2023-11-16T02:30:20.453580+0000","last_became_active":"2023-11-16T02:30:19.879577+0000","last_became_peered":"2023-11-16T02:30:19.879577+0000","last_unstale":"2023-11-16T02:30:20.453580+0000","last_undegraded":"2023-11-16T02:30:20.453580+0000","last_fullsized":"2023-11-16T02:30:20.453580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T07:05:25.212455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.449144+0000","last_change":"2023-11-16T02:30:19.459454+0000","last_active":"2023-11-16T02:30:20.449144+0000","last_peered":"2023-11-16T02:30:20.449144+0000","last_clean":"2023-11-16T02:30:20.449144+0000","last_became_active":"2023-11-16T02:30:19.458959+0000","last_became_peered":"2023-11-16T02:30:19.458959+0000","last_unstale":"2023-11-16T02:30:20.449144+0000","last_undegraded":"2023-11-16T02:30:20.449144+0000","last_fullsized":"2023-11-16T02:30:20.449144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:27:42.254533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452890+0000","last_change":"2023-11-16T02:30:19.877024+0000","last_active":"2023-11-16T02:30:20.452890+0000","last_peered":"2023-11-16T02:30:20.452890+0000","last_clean":"2023-11-16T02:30:20.452890+0000","last_became_active":"2023-11-16T02:30:19.876487+0000","last_became_peered":"2023-11-16T02:30:19.876487+0000","last_unstale":"2023-11-16T02:30:20.452890+0000","last_undegraded":"2023-11-16T02:30:20.452890+0000","last_fullsized":"2023-11-16T02:30:20.452890+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T05:30:57.683829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.446477+0000","last_change":"2023-11-16T02:30:19.461811+0000","last_active":"2023-11-16T02:30:20.446477+0000","last_peered":"2023-11-16T02:30:20.446477+0000","last_clean":"2023-11-16T02:30:20.446477+0000","last_became_active":"2023-11-16T02:30:19.460313+0000","last_became_peered":"2023-11-16T02:30:19.460313+0000","last_unstale":"2023-11-16T02:30:20.446477+0000","last_undegraded":"2023-11-16T02:30:20.446477+0000","last_fullsized":"2023-11-16T02:30:20.446477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:02:05.395662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452571+0000","last_change":"2023-11-16T02:30:19.885693+0000","last_active":"2023-11-16T02:30:20.452571+0000","last_peered":"2023-11-16T02:30:20.452571+0000","last_clean":"2023-11-16T02:30:20.452571+0000","last_became_active":"2023-11-16T02:30:19.885102+0000","last_became_peered":"2023-11-16T02:30:19.885102+0000","last_unstale":"2023-11-16T02:30:20.452571+0000","last_undegraded":"2023-11-16T02:30:20.452571+0000","last_fullsized":"2023-11-16T02:30:20.452571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:59:15.040356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452912+0000","last_change":"2023-11-16T02:30:19.477174+0000","last_active":"2023-11-16T02:30:20.452912+0000","last_peered":"2023-11-16T02:30:20.452912+0000","last_clean":"2023-11-16T02:30:20.452912+0000","last_became_active":"2023-11-16T02:30:19.475945+0000","last_became_peered":"2023-11-16T02:30:19.475945+0000","last_unstale":"2023-11-16T02:30:20.452912+0000","last_undegraded":"2023-11-16T02:30:20.452912+0000","last_fullsized":"2023-11-16T02:30:20.452912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:29:26.977995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.446196+0000","last_change":"2023-11-16T02:30:19.882218+0000","last_active":"2023-11-16T02:30:20.446196+0000","last_peered":"2023-11-16T02:30:20.446196+0000","last_clean":"2023-11-16T02:30:20.446196+0000","last_became_active":"2023-11-16T02:30:19.881908+0000","last_became_peered":"2023-11-16T02:30:19.881908+0000","last_unstale":"2023-11-16T02:30:20.446196+0000","last_undegraded":"2023-11-16T02:30:20.446196+0000","last_fullsized":"2023-11-16T02:30:20.446196+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:24:43.125348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452864+0000","last_change":"2023-11-16T02:30:19.470192+0000","last_active":"2023-11-16T02:30:20.452864+0000","last_peered":"2023-11-16T02:30:20.452864+0000","last_clean":"2023-11-16T02:30:20.452864+0000","last_became_active":"2023-11-16T02:30:19.469472+0000","last_became_peered":"2023-11-16T02:30:19.469472+0000","last_unstale":"2023-11-16T02:30:20.452864+0000","last_undegraded":"2023-11-16T02:30:20.452864+0000","last_fullsized":"2023-11-16T02:30:20.452864+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T12:17:41.856951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-16T02:30:21.337849+0000","last_change":"2023-11-16T02:30:19.875605+0000","last_active":"2023-11-16T02:30:21.337849+0000","last_peered":"2023-11-16T02:30:21.337849+0000","last_clean":"2023-11-16T02:30:21.337849+0000","last_became_active":"2023-11-16T02:30:19.875288+0000","last_became_peered":"2023-11-16T02:30:19.875288+0000","last_unstale":"2023-11-16T02:30:21.337849+0000","last_undegraded":"2023-11-16T02:30:21.337849+0000","last_fullsized":"2023-11-16T02:30:21.337849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:59:25.544152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452795+0000","last_change":"2023-11-16T02:30:19.468369+0000","last_active":"2023-11-16T02:30:20.452795+0000","last_peered":"2023-11-16T02:30:20.452795+0000","last_clean":"2023-11-16T02:30:20.452795+0000","last_became_active":"2023-11-16T02:30:19.467924+0000","last_became_peered":"2023-11-16T02:30:19.467924+0000","last_unstale":"2023-11-16T02:30:20.452795+0000","last_undegraded":"2023-11-16T02:30:20.452795+0000","last_fullsized":"2023-11-16T02:30:20.452795+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:30:11.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-16T02:30:21.338117+0000","last_change":"2023-11-16T02:30:19.876612+0000","last_active":"2023-11-16T02:30:21.338117+0000","last_peered":"2023-11-16T02:30:21.338117+0000","last_clean":"2023-11-16T02:30:21.338117+0000","last_became_active":"2023-11-16T02:30:19.876241+0000","last_became_peered":"2023-11-16T02:30:19.876241+0000","last_unstale":"2023-11-16T02:30:21.338117+0000","last_undegraded":"2023-11-16T02:30:21.338117+0000","last_fullsized":"2023-11-16T02:30:21.338117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T09:10:10.441362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.448359+0000","last_change":"2023-11-16T02:30:19.467061+0000","last_active":"2023-11-16T02:30:20.448359+0000","last_peered":"2023-11-16T02:30:20.448359+0000","last_clean":"2023-11-16T02:30:20.448359+0000","last_became_active":"2023-11-16T02:30:19.466792+0000","last_became_peered":"2023-11-16T02:30:19.466792+0000","last_unstale":"2023-11-16T02:30:20.448359+0000","last_undegraded":"2023-11-16T02:30:20.448359+0000","last_fullsized":"2023-11-16T02:30:20.448359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T02:52:12.747285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-16T02:30:21.337876+0000","last_change":"2023-11-16T02:30:19.844678+0000","last_active":"2023-11-16T02:30:21.337876+0000","last_peered":"2023-11-16T02:30:21.337876+0000","last_clean":"2023-11-16T02:30:21.337876+0000","last_became_active":"2023-11-16T02:30:19.844425+0000","last_became_peered":"2023-11-16T02:30:19.844425+0000","last_unstale":"2023-11-16T02:30:21.337876+0000","last_undegraded":"2023-11-16T02:30:21.337876+0000","last_fullsized":"2023-11-16T02:30:21.337876+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:09:17.275241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.453632+0000","last_change":"2023-11-16T02:30:19.465478+0000","last_active":"2023-11-16T02:30:20.453632+0000","last_peered":"2023-11-16T02:30:20.453632+0000","last_clean":"2023-11-16T02:30:20.453632+0000","last_became_active":"2023-11-16T02:30:19.464658+0000","last_became_peered":"2023-11-16T02:30:19.464658+0000","last_unstale":"2023-11-16T02:30:20.453632+0000","last_undegraded":"2023-11-16T02:30:20.453632+0000","last_fullsized":"2023-11-16T02:30:20.453632+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T14:23:32.728712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-16T02:30:21.337743+0000","last_change":"2023-11-16T02:30:19.845531+0000","last_active":"2023-11-16T02:30:21.337743+0000","last_peered":"2023-11-16T02:30:21.337743+0000","last_clean":"2023-11-16T02:30:21.337743+0000","last_became_active":"2023-11-16T02:30:19.844822+0000","last_became_peered":"2023-11-16T02:30:19.844822+0000","last_unstale":"2023-11-16T02:30:21.337743+0000","last_undegraded":"2023-11-16T02:30:21.337743+0000","last_fullsized":"2023-11-16T02:30:21.337743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T06:44:21.627838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452432+0000","last_change":"2023-11-16T02:30:19.485044+0000","last_active":"2023-11-16T02:30:20.452432+0000","last_peered":"2023-11-16T02:30:20.452432+0000","last_clean":"2023-11-16T02:30:20.452432+0000","last_became_active":"2023-11-16T02:30:19.484575+0000","last_became_peered":"2023-11-16T02:30:19.484575+0000","last_unstale":"2023-11-16T02:30:20.452432+0000","last_undegraded":"2023-11-16T02:30:20.452432+0000","last_fullsized":"2023-11-16T02:30:20.452432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:48:59.158704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.457371+0000","last_change":"2023-11-16T02:30:19.881226+0000","last_active":"2023-11-16T02:30:20.457371+0000","last_peered":"2023-11-16T02:30:20.457371+0000","last_clean":"2023-11-16T02:30:20.457371+0000","last_became_active":"2023-11-16T02:30:19.880563+0000","last_became_peered":"2023-11-16T02:30:19.880563+0000","last_unstale":"2023-11-16T02:30:20.457371+0000","last_undegraded":"2023-11-16T02:30:20.457371+0000","last_fullsized":"2023-11-16T02:30:20.457371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:04:02.319109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452293+0000","last_change":"2023-11-16T02:30:19.482268+0000","last_active":"2023-11-16T02:30:20.452293+0000","last_peered":"2023-11-16T02:30:20.452293+0000","last_clean":"2023-11-16T02:30:20.452293+0000","last_became_active":"2023-11-16T02:30:19.481547+0000","last_became_peered":"2023-11-16T02:30:19.481547+0000","last_unstale":"2023-11-16T02:30:20.452293+0000","last_undegraded":"2023-11-16T02:30:20.452293+0000","last_fullsized":"2023-11-16T02:30:20.452293+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:53:29.543335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-16T02:30:21.337828+0000","last_change":"2023-11-16T02:30:19.868254+0000","last_active":"2023-11-16T02:30:21.337828+0000","last_peered":"2023-11-16T02:30:21.337828+0000","last_clean":"2023-11-16T02:30:21.337828+0000","last_became_active":"2023-11-16T02:30:19.867981+0000","last_became_peered":"2023-11-16T02:30:19.867981+0000","last_unstale":"2023-11-16T02:30:21.337828+0000","last_undegraded":"2023-11-16T02:30:21.337828+0000","last_fullsized":"2023-11-16T02:30:21.337828+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T11:01:43.349801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.446530+0000","last_change":"2023-11-16T02:30:19.486403+0000","last_active":"2023-11-16T02:30:20.446530+0000","last_peered":"2023-11-16T02:30:20.446530+0000","last_clean":"2023-11-16T02:30:20.446530+0000","last_became_active":"2023-11-16T02:30:19.485982+0000","last_became_peered":"2023-11-16T02:30:19.485982+0000","last_unstale":"2023-11-16T02:30:20.446530+0000","last_undegraded":"2023-11-16T02:30:20.446530+0000","last_fullsized":"2023-11-16T02:30:20.446530+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T02:52:12.747285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452593+0000","last_change":"2023-11-16T02:30:19.868154+0000","last_active":"2023-11-16T02:30:20.452593+0000","last_peered":"2023-11-16T02:30:20.452593+0000","last_clean":"2023-11-16T02:30:20.452593+0000","last_became_active":"2023-11-16T02:30:19.867219+0000","last_became_peered":"2023-11-16T02:30:19.867219+0000","last_unstale":"2023-11-16T02:30:20.452593+0000","last_undegraded":"2023-11-16T02:30:20.452593+0000","last_fullsized":"2023-11-16T02:30:20.452593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:04:02.319109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-16T02:30:21.761124+0000","last_change":"2023-11-16T02:30:19.467493+0000","last_active":"2023-11-16T02:30:21.761124+0000","last_peered":"2023-11-16T02:30:21.761124+0000","last_clean":"2023-11-16T02:30:21.761124+0000","last_became_active":"2023-11-16T02:30:19.466854+0000","last_became_peered":"2023-11-16T02:30:19.466854+0000","last_unstale":"2023-11-16T02:30:21.761124+0000","last_undegraded":"2023-11-16T02:30:21.761124+0000","last_fullsized":"2023-11-16T02:30:21.761124+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:40:26.674869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.448407+0000","last_change":"2023-11-16T02:30:19.839272+0000","last_active":"2023-11-16T02:30:20.448407+0000","last_peered":"2023-11-16T02:30:20.448407+0000","last_clean":"2023-11-16T02:30:20.448407+0000","last_became_active":"2023-11-16T02:30:19.838628+0000","last_became_peered":"2023-11-16T02:30:19.838628+0000","last_unstale":"2023-11-16T02:30:20.448407+0000","last_undegraded":"2023-11-16T02:30:20.448407+0000","last_fullsized":"2023-11-16T02:30:20.448407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T13:34:33.419560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.446242+0000","last_change":"2023-11-16T02:30:19.468928+0000","last_active":"2023-11-16T02:30:20.446242+0000","last_peered":"2023-11-16T02:30:20.446242+0000","last_clean":"2023-11-16T02:30:20.446242+0000","last_became_active":"2023-11-16T02:30:19.468602+0000","last_became_peered":"2023-11-16T02:30:19.468602+0000","last_unstale":"2023-11-16T02:30:20.446242+0000","last_undegraded":"2023-11-16T02:30:20.446242+0000","last_fullsized":"2023-11-16T02:30:20.446242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:30:11.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.453609+0000","last_change":"2023-11-16T02:30:19.859362+0000","last_active":"2023-11-16T02:30:20.453609+0000","last_peered":"2023-11-16T02:30:20.453609+0000","last_clean":"2023-11-16T02:30:20.453609+0000","last_became_active":"2023-11-16T02:30:19.858630+0000","last_became_peered":"2023-11-16T02:30:19.858630+0000","last_unstale":"2023-11-16T02:30:20.453609+0000","last_undegraded":"2023-11-16T02:30:20.453609+0000","last_fullsized":"2023-11-16T02:30:20.453609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:11:46.387664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.448386+0000","last_change":"2023-11-16T02:30:19.482379+0000","last_active":"2023-11-16T02:30:20.448386+0000","last_peered":"2023-11-16T02:30:20.448386+0000","last_clean":"2023-11-16T02:30:20.448386+0000","last_became_active":"2023-11-16T02:30:19.481905+0000","last_became_peered":"2023-11-16T02:30:19.481905+0000","last_unstale":"2023-11-16T02:30:20.448386+0000","last_undegraded":"2023-11-16T02:30:20.448386+0000","last_fullsized":"2023-11-16T02:30:20.448386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:30:11.721466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.448335+0000","last_change":"2023-11-16T02:30:19.859522+0000","last_active":"2023-11-16T02:30:20.448335+0000","last_peered":"2023-11-16T02:30:20.448335+0000","last_clean":"2023-11-16T02:30:20.448335+0000","last_became_active":"2023-11-16T02:30:19.859274+0000","last_became_peered":"2023-11-16T02:30:19.859274+0000","last_unstale":"2023-11-16T02:30:20.448335+0000","last_undegraded":"2023-11-16T02:30:20.448335+0000","last_fullsized":"2023-11-16T02:30:20.448335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:17:17.336842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.446101+0000","last_change":"2023-11-16T02:30:19.481967+0000","last_active":"2023-11-16T02:30:20.446101+0000","last_peered":"2023-11-16T02:30:20.446101+0000","last_clean":"2023-11-16T02:30:20.446101+0000","last_became_active":"2023-11-16T02:30:19.481503+0000","last_became_peered":"2023-11-16T02:30:19.481503+0000","last_unstale":"2023-11-16T02:30:20.446101+0000","last_undegraded":"2023-11-16T02:30:20.446101+0000","last_fullsized":"2023-11-16T02:30:20.446101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:55:12.932877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.449034+0000","last_change":"2023-11-16T02:30:19.840571+0000","last_active":"2023-11-16T02:30:20.449034+0000","last_peered":"2023-11-16T02:30:20.449034+0000","last_clean":"2023-11-16T02:30:20.449034+0000","last_became_active":"2023-11-16T02:30:19.840277+0000","last_became_peered":"2023-11-16T02:30:19.840277+0000","last_unstale":"2023-11-16T02:30:20.449034+0000","last_undegraded":"2023-11-16T02:30:20.449034+0000","last_fullsized":"2023-11-16T02:30:20.449034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:59:15.040356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452457+0000","last_change":"2023-11-16T02:30:19.485297+0000","last_active":"2023-11-16T02:30:20.452457+0000","last_peered":"2023-11-16T02:30:20.452457+0000","last_clean":"2023-11-16T02:30:20.452457+0000","last_became_active":"2023-11-16T02:30:19.484515+0000","last_became_peered":"2023-11-16T02:30:19.484515+0000","last_unstale":"2023-11-16T02:30:20.452457+0000","last_undegraded":"2023-11-16T02:30:20.452457+0000","last_fullsized":"2023-11-16T02:30:20.452457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:52:21.172818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.452404+0000","last_change":"2023-11-16T02:30:19.864997+0000","last_active":"2023-11-16T02:30:20.452404+0000","last_peered":"2023-11-16T02:30:20.452404+0000","last_clean":"2023-11-16T02:30:20.452404+0000","last_became_active":"2023-11-16T02:30:19.864281+0000","last_became_peered":"2023-11-16T02:30:19.864281+0000","last_unstale":"2023-11-16T02:30:20.452404+0000","last_undegraded":"2023-11-16T02:30:20.452404+0000","last_fullsized":"2023-11-16T02:30:20.452404+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T03:05:48.808451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.449091+0000","last_change":"2023-11-16T02:30:19.480325+0000","last_active":"2023-11-16T02:30:20.449091+0000","last_peered":"2023-11-16T02:30:20.449091+0000","last_clean":"2023-11-16T02:30:20.449091+0000","last_became_active":"2023-11-16T02:30:19.480062+0000","last_became_peered":"2023-11-16T02:30:19.480062+0000","last_unstale":"2023-11-16T02:30:20.449091+0000","last_undegraded":"2023-11-16T02:30:20.449091+0000","last_fullsized":"2023-11-16T02:30:20.449091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:17:16.332028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.457467+0000","last_change":"2023-11-16T02:30:19.884211+0000","last_active":"2023-11-16T02:30:20.457467+0000","last_peered":"2023-11-16T02:30:20.457467+0000","last_clean":"2023-11-16T02:30:20.457467+0000","last_became_active":"2023-11-16T02:30:19.880825+0000","last_became_peered":"2023-11-16T02:30:19.880825+0000","last_unstale":"2023-11-16T02:30:20.457467+0000","last_undegraded":"2023-11-16T02:30:20.457467+0000","last_fullsized":"2023-11-16T02:30:20.457467+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:19.425814+0000","last_clean_scrub_stamp":"2023-11-16T02:30:19.425814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T08:00:28.306611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:20.453657+0000","last_change":"2023-11-16T02:30:19.479112+0000","last_active":"2023-11-16T02:30:20.453657+0000","last_peered":"2023-11-16T02:30:20.453657+0000","last_clean":"2023-11-16T02:30:20.453657+0000","last_became_active":"2023-11-16T02:30:19.478459+0000","last_became_peered":"2023-11-16T02:30:19.478459+0000","last_unstale":"2023-11-16T02:30:20.453657+0000","last_undegraded":"2023-11-16T02:30:20.453657+0000","last_fullsized":"2023-11-16T02:30:20.453657+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:30:18.421000+0000","last_clean_scrub_stamp":"2023-11-16T02:30:18.421000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T10:55:12.932877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":172,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-16T02:30:19.846759+0000","last_change":"2023-11-16T02:29:27.538359+0000","last_active":"2023-11-16T02:30:19.846759+0000","last_peered":"2023-11-16T02:30:19.846759+0000","last_clean":"2023-11-16T02:30:19.846759+0000","last_became_active":"2023-11-16T02:29:27.536606+0000","last_became_peered":"2023-11-16T02:29:27.536606+0000","last_unstale":"2023-11-16T02:30:19.846759+0000","last_undegraded":"2023-11-16T02:30:19.846759+0000","last_fullsized":"2023-11-16T02:30:19.846759+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-16T02:29:26.491990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-16T02:29:26.491990+0000","last_clean_scrub_stamp":"2023-11-16T02:29:26.491990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-17T04:29:40.434297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":962560,"data_stored":730062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]}]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":372736,"data_stored":140220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":372736,"data_stored":140276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4890000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":372736,"data_stored":139708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":380928,"data_stored":141190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":380928,"data_stored":141190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":958464,"data_stored":729972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":368640,"data_stored":139674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-16T02:30:27.631 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-16T02:30:27.632 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-16T02:30:27.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.787+0000 7f4d68741640 1 Processor -- start 2023-11-16T02:30:27.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.787+0000 7f4d68741640 1 -- start start 2023-11-16T02:30:27.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.787+0000 7f4d68741640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4d600b6ce0 0x7f4d600b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:27.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.787+0000 7f4d68741640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d600b4160 con 0x7f4d6014ec40 2023-11-16T02:30:27.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.787+0000 7f4d68741640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d6014e160 con 0x7f4d600b6900 2023-11-16T02:30:27.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.787+0000 7f4d68741640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6006ab90 con 0x7f4d600b6ce0 2023-11-16T02:30:27.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.787+0000 7f4d66cde640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f4d6014ec40 0x7f4d6006a480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54330/0 (socket says 172.21.15.28:54330) 2023-11-16T02:30:27.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.787+0000 7f4d66cde640 1 -- 172.21.15.28:0/1172587674 learned_addr learned my addr 172.21.15.28:0/1172587674 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:27.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.787+0000 7f4d65cdc640 1 --2- 172.21.15.28:0/1172587674 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4d600b6ce0 0x7f4d600b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:27.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.787+0000 7f4d654db640 1 -- 172.21.15.28:0/1172587674 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3317525322 0 0) 0x7f4d600b4160 con 0x7f4d6014ec40 2023-11-16T02:30:27.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.787+0000 7f4d654db640 1 -- 172.21.15.28:0/1172587674 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d4c003530 con 0x7f4d6014ec40 2023-11-16T02:30:27.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.787+0000 7f4d654db640 1 -- 172.21.15.28:0/1172587674 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2559799638 0 0) 0x7f4d4c003530 con 0x7f4d6014ec40 2023-11-16T02:30:27.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.787+0000 7f4d654db640 1 -- 172.21.15.28:0/1172587674 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4d600b6ce0 msgr2=0x7f4d600b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:27.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.787+0000 7f4d654db640 1 --2- 172.21.15.28:0/1172587674 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4d600b6ce0 0x7f4d600b3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:27.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.787+0000 7f4d654db640 1 -- 172.21.15.28:0/1172587674 >> v1:172.21.15.70:6789/0 conn(0x7f4d600b6900 legacy=0x7f4d60069d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:27.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.787+0000 7f4d654db640 1 -- 172.21.15.28:0/1172587674 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6014e440 con 0x7f4d6014ec40 2023-11-16T02:30:27.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.787+0000 7f4d654db640 1 -- 172.21.15.28:0/1172587674 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7f4d58001680 con 0x7f4d6014ec40 2023-11-16T02:30:27.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d654db640 1 -- 172.21.15.28:0/1172587674 >> v1:172.21.15.28:6789/0 conn(0x7f4d6014ec40 legacy=0x7f4d6006a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:27.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d654db640 1 --2- 172.21.15.28:0/1172587674 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4d600b6ce0 0x7f4d4c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:27.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d654db640 1 --2- 172.21.15.28:0/1172587674 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d4c003ef0 0x7f4d4c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:27.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d654db640 1 --2- 172.21.15.28:0/1172587674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d4c004d10 0x7f4d4c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:27.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d654db640 1 -- 172.21.15.28:0/1172587674 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6006ab90 con 0x7f4d4c003ef0 2023-11-16T02:30:27.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d654db640 1 -- 172.21.15.28:0/1172587674 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c00bb50 con 0x7f4d4c004d10 2023-11-16T02:30:27.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d654db640 1 -- 172.21.15.28:0/1172587674 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c00bd10 con 0x7f4d600b6ce0 2023-11-16T02:30:27.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d65cdc640 1 --2- 172.21.15.28:0/1172587674 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d4c003ef0 0x7f4d4c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:27.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d66cde640 1 --2- 172.21.15.28:0/1172587674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d4c004d10 0x7f4d4c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:27.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d65cdc640 1 -- 172.21.15.28:0/1172587674 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4d600b6ce0 msgr2=0x7f4d4c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:27.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d664dd640 1 --2- 172.21.15.28:0/1172587674 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4d600b6ce0 0x7f4d4c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:27.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d65cdc640 1 --2- 172.21.15.28:0/1172587674 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4d600b6ce0 0x7f4d4c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:27.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d65cdc640 1 -- 172.21.15.28:0/1172587674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d4c004d10 msgr2=0x7f4d4c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:27.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d65cdc640 1 --2- 172.21.15.28:0/1172587674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d4c004d10 0x7f4d4c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:27.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d65cdc640 1 -- 172.21.15.28:0/1172587674 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c003530 con 0x7f4d4c003ef0 2023-11-16T02:30:27.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d664dd640 1 --2- 172.21.15.28:0/1172587674 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4d600b6ce0 0x7f4d4c0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:30:27.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d65cdc640 1 --2- 172.21.15.28:0/1172587674 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d4c003ef0 0x7f4d4c0047d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4d54009ae0 tx=0x7f4d5401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c7c0e18b737e8e server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:27.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d654db640 1 -- 172.21.15.28:0/1172587674 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d540a5530 con 0x7f4d4c003ef0 2023-11-16T02:30:27.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d654db640 1 -- 172.21.15.28:0/1172587674 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d540a5690 con 0x7f4d4c003ef0 2023-11-16T02:30:27.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d654db640 1 -- 172.21.15.28:0/1172587674 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d540a5a40 con 0x7f4d4c003ef0 2023-11-16T02:30:27.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d68741640 1 -- 172.21.15.28:0/1172587674 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d4c003ef0 msgr2=0x7f4d4c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:27.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d68741640 1 --2- 172.21.15.28:0/1172587674 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d4c003ef0 0x7f4d4c0047d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4d54009ae0 tx=0x7f4d5401ca50 comp rx=0 tx=0).stop 2023-11-16T02:30:27.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d66cde640 1 -- 172.21.15.28:0/1172587674 reap_dead start 2023-11-16T02:30:27.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d68741640 1 -- 172.21.15.28:0/1172587674 shutdown_connections 2023-11-16T02:30:27.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d68741640 1 -- 172.21.15.28:0/1172587674 >> 172.21.15.28:0/1172587674 conn(0x7f4d600bd310 msgr2=0x7f4d600bd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:27.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d68741640 1 -- 172.21.15.28:0/1172587674 shutdown_connections 2023-11-16T02:30:27.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.791+0000 7f4d68741640 1 -- 172.21.15.28:0/1172587674 wait complete. 2023-11-16T02:30:27.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.795+0000 7f4d68741640 1 Processor -- start 2023-11-16T02:30:27.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.795+0000 7f4d68741640 1 -- start start 2023-11-16T02:30:27.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.795+0000 7f4d68741640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d4c003ef0 0x7f4d601e7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:27.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.795+0000 7f4d68741640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4d601e3140 0x7f4d600b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:27.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.795+0000 7f4d68741640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d60147c50 0x7f4d601480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:27.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.795+0000 7f4d68741640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6014df60 con 0x7f4d60147c50 2023-11-16T02:30:27.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.795+0000 7f4d68741640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d601e35c0 con 0x7f4d4c003ef0 2023-11-16T02:30:27.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.795+0000 7f4d68741640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6014d040 con 0x7f4d601e3140 2023-11-16T02:30:27.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.795+0000 7f4d66cde640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d60147c50 0x7f4d601480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:27.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.795+0000 7f4d66cde640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d60147c50 0x7f4d601480d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54310/0 (socket says 172.21.15.28:54310) 2023-11-16T02:30:27.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.795+0000 7f4d66cde640 1 -- 172.21.15.28:0/3513755858 learned_addr learned my addr 172.21.15.28:0/3513755858 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:27.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.795+0000 7f4d664dd640 1 --2- 172.21.15.28:0/3513755858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d4c003ef0 0x7f4d601e7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:27.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.795+0000 7f4d65cdc640 1 --2- 172.21.15.28:0/3513755858 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4d601e3140 0x7f4d600b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:27.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.795+0000 7f4d66cde640 1 -- 172.21.15.28:0/3513755858 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4d601e3140 msgr2=0x7f4d600b53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:27.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.795+0000 7f4d66cde640 1 --2- 172.21.15.28:0/3513755858 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4d601e3140 0x7f4d600b53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:27.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.795+0000 7f4d66cde640 1 -- 172.21.15.28:0/3513755858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d4c003ef0 msgr2=0x7f4d601e7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:27.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.795+0000 7f4d66cde640 1 --2- 172.21.15.28:0/3513755858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d4c003ef0 0x7f4d601e7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:27.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.795+0000 7f4d66cde640 1 -- 172.21.15.28:0/3513755858 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d601e6730 con 0x7f4d60147c50 2023-11-16T02:30:27.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.795+0000 7f4d66cde640 1 --2- 172.21.15.28:0/3513755858 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d60147c50 0x7f4d601480d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4d60071a20 tx=0x7f4d5800e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:27.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.795+0000 7f4d52ffd640 1 -- 172.21.15.28:0/3513755858 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d58010510 con 0x7f4d60147c50 2023-11-16T02:30:27.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.795+0000 7f4d52ffd640 1 -- 172.21.15.28:0/3513755858 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d58010690 con 0x7f4d60147c50 2023-11-16T02:30:27.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.795+0000 7f4d68741640 1 -- 172.21.15.28:0/3513755858 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d601e6a10 con 0x7f4d60147c50 2023-11-16T02:30:27.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.795+0000 7f4d52ffd640 1 -- 172.21.15.28:0/3513755858 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d58010a40 con 0x7f4d60147c50 2023-11-16T02:30:27.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.795+0000 7f4d68741640 1 -- 172.21.15.28:0/3513755858 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6014cc50 con 0x7f4d60147c50 2023-11-16T02:30:27.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.795+0000 7f4d68741640 1 -- 172.21.15.28:0/3513755858 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6004e8a0 con 0x7f4d60147c50 2023-11-16T02:30:27.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.795+0000 7f4d52ffd640 1 -- 172.21.15.28:0/3513755858 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4d58010ba0 con 0x7f4d60147c50 2023-11-16T02:30:27.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.799+0000 7f4d52ffd640 1 --2- 172.21.15.28:0/3513755858 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4d44065a60 0x7f4d44067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:27.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.799+0000 7f4d52ffd640 1 -- 172.21.15.28:0/3513755858 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d58082c90 con 0x7f4d60147c50 2023-11-16T02:30:27.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.799+0000 7f4d664dd640 1 --2- 172.21.15.28:0/3513755858 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4d44065a60 0x7f4d44067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:27.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.799+0000 7f4d664dd640 1 --2- 172.21.15.28:0/3513755858 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4d44065a60 0x7f4d44067f20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4d60145610 tx=0x7f4d5c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:27.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:27.799+0000 7f4d52ffd640 1 -- 172.21.15.28:0/3513755858 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f4d58054130 con 0x7f4d60147c50 2023-11-16T02:30:28.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.019+0000 7f4d68741640 1 -- 172.21.15.28:0/3513755858 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4d600bb9f0 con 0x7f4d60147c50 2023-11-16T02:30:28.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.027+0000 7f4d52ffd640 1 -- 172.21.15.28:0/3513755858 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4d58019030 con 0x7f4d60147c50 2023-11-16T02:30:28.031 INFO:teuthology.orchestra.run.smithi028.stderr:updated caps for client.0 2023-11-16T02:30:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.031+0000 7f4d68741640 1 -- 172.21.15.28:0/3513755858 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4d44065a60 msgr2=0x7f4d44067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.031+0000 7f4d68741640 1 --2- 172.21.15.28:0/3513755858 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4d44065a60 0x7f4d44067f20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4d60145610 tx=0x7f4d5c009040 comp rx=0 tx=0).stop 2023-11-16T02:30:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.031+0000 7f4d68741640 1 -- 172.21.15.28:0/3513755858 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d60147c50 msgr2=0x7f4d601480d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.031+0000 7f4d68741640 1 --2- 172.21.15.28:0/3513755858 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d60147c50 0x7f4d601480d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4d60071a20 tx=0x7f4d5800e960 comp rx=0 tx=0).stop 2023-11-16T02:30:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.031+0000 7f4d68741640 1 -- 172.21.15.28:0/3513755858 shutdown_connections 2023-11-16T02:30:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.031+0000 7f4d68741640 1 --2- 172.21.15.28:0/3513755858 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4d44065a60 0x7f4d44067f20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.031+0000 7f4d68741640 1 --2- 172.21.15.28:0/3513755858 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4d60147c50 0x7f4d601480d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.031+0000 7f4d68741640 1 --2- 172.21.15.28:0/3513755858 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4d601e3140 0x7f4d600b53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.031+0000 7f4d68741640 1 --2- 172.21.15.28:0/3513755858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d4c003ef0 0x7f4d601e7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.031+0000 7f4d68741640 1 -- 172.21.15.28:0/3513755858 >> 172.21.15.28:0/3513755858 conn(0x7f4d600bd310 msgr2=0x7f4d60071040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:28.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.031+0000 7f4d68741640 1 -- 172.21.15.28:0/3513755858 shutdown_connections 2023-11-16T02:30:28.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.031+0000 7f4d68741640 1 -- 172.21.15.28:0/3513755858 wait complete. 2023-11-16T02:30:28.050 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-16T02:30:28.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.171+0000 7f70ed50d640 1 Processor -- start 2023-11-16T02:30:28.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.171+0000 7f70ed50d640 1 -- start start 2023-11-16T02:30:28.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.171+0000 7f70ed50d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f70e80b3b60 0x7f70e81542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.171+0000 7f70ed50d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e80b52b0 con 0x7f70e8148960 2023-11-16T02:30:28.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.171+0000 7f70ed50d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e80bcdb0 con 0x7f70e80b8240 2023-11-16T02:30:28.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.171+0000 7f70ed50d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e80b6220 con 0x7f70e80b3b60 2023-11-16T02:30:28.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.171+0000 7f70e67fc640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f70e8148960 0x7f70e80b3450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54342/0 (socket says 172.21.15.28:54342) 2023-11-16T02:30:28.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.171+0000 7f70e67fc640 1 -- 172.21.15.28:0/2216610524 learned_addr learned my addr 172.21.15.28:0/2216610524 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:28.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.171+0000 7f70e77fe640 1 --2- 172.21.15.28:0/2216610524 >> v2:172.21.15.28:3300/0 conn(0x7f70e80b3b60 0x7f70e81542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:28.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.171+0000 7f70e77fe640 1 -- 172.21.15.28:0/2216610524 >> v1:172.21.15.70:6789/0 conn(0x7f70e80b8240 legacy=0x7f70e80bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:28.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.171+0000 7f70e77fe640 1 -- 172.21.15.28:0/2216610524 >> v1:172.21.15.28:6789/0 conn(0x7f70e8148960 legacy=0x7f70e80b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:28.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.171+0000 7f70e77fe640 1 -- 172.21.15.28:0/2216610524 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e80b4040 con 0x7f70e80b3b60 2023-11-16T02:30:28.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.175+0000 7f70e77fe640 1 --2- 172.21.15.28:0/2216610524 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70e80b3b60 0x7f70e81542b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009d90 tx=0x7f70e001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f7eaec56e15676 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:28.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.175+0000 7f70e5ffb640 1 -- 172.21.15.28:0/2216610524 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e00a58b0 con 0x7f70e80b3b60 2023-11-16T02:30:28.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.175+0000 7f70e5ffb640 1 -- 172.21.15.28:0/2216610524 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e00a5a10 con 0x7f70e80b3b60 2023-11-16T02:30:28.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.175+0000 7f70e5ffb640 1 -- 172.21.15.28:0/2216610524 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e00a5da0 con 0x7f70e80b3b60 2023-11-16T02:30:28.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.175+0000 7f70ed50d640 1 -- 172.21.15.28:0/2216610524 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70e80b3b60 msgr2=0x7f70e81542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:28.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.175+0000 7f70ed50d640 1 --2- 172.21.15.28:0/2216610524 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70e80b3b60 0x7f70e81542b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009d90 tx=0x7f70e001c8e0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.175+0000 7f70ed50d640 1 -- 172.21.15.28:0/2216610524 shutdown_connections 2023-11-16T02:30:28.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.175+0000 7f70ed50d640 1 --2- 172.21.15.28:0/2216610524 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70e80b3b60 0x7f70e81542b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.175+0000 7f70ed50d640 1 -- 172.21.15.28:0/2216610524 >> 172.21.15.28:0/2216610524 conn(0x7f70e80b9050 msgr2=0x7f70e80bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:28.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.175+0000 7f70ed50d640 1 -- 172.21.15.28:0/2216610524 shutdown_connections 2023-11-16T02:30:28.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.175+0000 7f70ed50d640 1 -- 172.21.15.28:0/2216610524 wait complete. 2023-11-16T02:30:28.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.175+0000 7f70ed50d640 1 Processor -- start 2023-11-16T02:30:28.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.175+0000 7f70ed50d640 1 -- start start 2023-11-16T02:30:28.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.175+0000 7f70ed50d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70e80b3b60 0x7f70e813ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.175+0000 7f70ed50d640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70e80b8240 0x7f70e813bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.175+0000 7f70ed50d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70e8148960 0x7f70e813c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.175+0000 7f70ed50d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e8070b10 con 0x7f70e8148960 2023-11-16T02:30:28.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.175+0000 7f70ed50d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e8070d60 con 0x7f70e80b3b60 2023-11-16T02:30:28.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.175+0000 7f70ed50d640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e81e8880 con 0x7f70e80b8240 2023-11-16T02:30:28.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.175+0000 7f70e77fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70e8148960 0x7f70e813c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:28.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.175+0000 7f70e77fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70e8148960 0x7f70e813c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54330/0 (socket says 172.21.15.28:54330) 2023-11-16T02:30:28.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.175+0000 7f70e77fe640 1 -- 172.21.15.28:0/482510254 learned_addr learned my addr 172.21.15.28:0/482510254 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:28.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.179+0000 7f70e6ffd640 1 --2- 172.21.15.28:0/482510254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70e80b3b60 0x7f70e813ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:28.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.179+0000 7f70e67fc640 1 --2- 172.21.15.28:0/482510254 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70e80b8240 0x7f70e813bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:28.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.179+0000 7f70e77fe640 1 -- 172.21.15.28:0/482510254 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70e80b8240 msgr2=0x7f70e813bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:28.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.179+0000 7f70e77fe640 1 --2- 172.21.15.28:0/482510254 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70e80b8240 0x7f70e813bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.179+0000 7f70e77fe640 1 -- 172.21.15.28:0/482510254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70e80b3b60 msgr2=0x7f70e813ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:28.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.179+0000 7f70e77fe640 1 --2- 172.21.15.28:0/482510254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70e80b3b60 0x7f70e813ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.179+0000 7f70e77fe640 1 -- 172.21.15.28:0/482510254 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e0009a70 con 0x7f70e8148960 2023-11-16T02:30:28.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.179+0000 7f70e77fe640 1 --2- 172.21.15.28:0/482510254 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70e8148960 0x7f70e813c470 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f70e00b0040 tx=0x7f70e0019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:28.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.179+0000 7f70cf7fe640 1 -- 172.21.15.28:0/482510254 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e00ad850 con 0x7f70e8148960 2023-11-16T02:30:28.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.179+0000 7f70cf7fe640 1 -- 172.21.15.28:0/482510254 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e00ad9d0 con 0x7f70e8148960 2023-11-16T02:30:28.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.179+0000 7f70ed50d640 1 -- 172.21.15.28:0/482510254 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e8140440 con 0x7f70e8148960 2023-11-16T02:30:28.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.179+0000 7f70cf7fe640 1 -- 172.21.15.28:0/482510254 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e00add80 con 0x7f70e8148960 2023-11-16T02:30:28.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.179+0000 7f70ed50d640 1 -- 172.21.15.28:0/482510254 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e81e8510 con 0x7f70e8148960 2023-11-16T02:30:28.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.179+0000 7f70ed50d640 1 -- 172.21.15.28:0/482510254 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e81e8a10 con 0x7f70e8148960 2023-11-16T02:30:28.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.179+0000 7f70cf7fe640 1 -- 172.21.15.28:0/482510254 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f70e00b4050 con 0x7f70e8148960 2023-11-16T02:30:28.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.179+0000 7f70cf7fe640 1 --2- 172.21.15.28:0/482510254 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f70d4065a90 0x7f70d4067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.179+0000 7f70cf7fe640 1 -- 172.21.15.28:0/482510254 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70e011de30 con 0x7f70e8148960 2023-11-16T02:30:28.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.179+0000 7f70e6ffd640 1 --2- 172.21.15.28:0/482510254 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f70d4065a90 0x7f70d4067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:28.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.179+0000 7f70e6ffd640 1 --2- 172.21.15.28:0/482510254 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f70d4065a90 0x7f70d4067f50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f70dc004e30 tx=0x7f70dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:28.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.183+0000 7f70cf7fe640 1 -- 172.21.15.28:0/482510254 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f70e00eb880 con 0x7f70e8148960 2023-11-16T02:30:28.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.371+0000 7f70ed50d640 1 -- 172.21.15.28:0/482510254 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70e804e8a0 con 0x7f70e8148960 2023-11-16T02:30:28.374 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.371+0000 7f70cf7fe640 1 -- 172.21.15.28:0/482510254 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3888 (secure 0 0 0) 0x7f70e00b2090 con 0x7f70e8148960 2023-11-16T02:30:28.375 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:30:28.375 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4726,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6833/1703038976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":1703038976},{"type":"v1","addr":"172.21.15.70:6833","nonce":1703038976}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4729,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6836/4215257772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":4215257772},{"type":"v1","addr":"172.21.15.28:6836","nonce":4215257772}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-16T02:30:19.823171+0000","modified":"2023-11-16T02:30:21.835244+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4950},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4950":{"gid":4950,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6837/885495356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6835","nonce":885495356},{"type":"v1","addr":"172.21.15.28:6837","nonce":885495356}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-16T02:30:28.375 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 13 2023-11-16T02:30:28.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.375+0000 7f70ed50d640 1 -- 172.21.15.28:0/482510254 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f70d4065a90 msgr2=0x7f70d4067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:28.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.375+0000 7f70ed50d640 1 --2- 172.21.15.28:0/482510254 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f70d4065a90 0x7f70d4067f50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f70dc004e30 tx=0x7f70dc009040 comp rx=0 tx=0).stop 2023-11-16T02:30:28.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.375+0000 7f70ed50d640 1 -- 172.21.15.28:0/482510254 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70e8148960 msgr2=0x7f70e813c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:28.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.375+0000 7f70ed50d640 1 --2- 172.21.15.28:0/482510254 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70e8148960 0x7f70e813c470 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f70e00b0040 tx=0x7f70e0019680 comp rx=0 tx=0).stop 2023-11-16T02:30:28.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.375+0000 7f70ed50d640 1 -- 172.21.15.28:0/482510254 shutdown_connections 2023-11-16T02:30:28.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.375+0000 7f70ed50d640 1 --2- 172.21.15.28:0/482510254 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f70d4065a90 0x7f70d4067f50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.375+0000 7f70ed50d640 1 --2- 172.21.15.28:0/482510254 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f70e8148960 0x7f70e813c470 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.375+0000 7f70ed50d640 1 --2- 172.21.15.28:0/482510254 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f70e80b8240 0x7f70e813bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.375+0000 7f70ed50d640 1 --2- 172.21.15.28:0/482510254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70e80b3b60 0x7f70e813ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.375+0000 7f70ed50d640 1 -- 172.21.15.28:0/482510254 >> 172.21.15.28:0/482510254 conn(0x7f70e80b9050 msgr2=0x7f70e813abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:28.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.375+0000 7f70ed50d640 1 -- 172.21.15.28:0/482510254 shutdown_connections 2023-11-16T02:30:28.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.375+0000 7f70ed50d640 1 -- 172.21.15.28:0/482510254 wait complete. 2023-11-16T02:30:28.697 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-16T02:30:19.823171+0000', 'modified': '2023-11-16T02:30:21.835244+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4950}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4950': {'gid': 4950, 'name': 'c', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.28:6837/885495356', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.28:6835', 'nonce': 885495356}, {'type': 'v1', 'addr': '172.21.15.28:6837', 'nonce': 885495356}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-16T02:30:28.697 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-16T02:30:28.697 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-16T02:30:28.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.827+0000 7f25bc12a640 1 Processor -- start 2023-11-16T02:30:28.830 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.827+0000 7f25bc12a640 1 -- start start 2023-11-16T02:30:28.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.827+0000 7f25bc12a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f25b40b38f0 0x7f25b406a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.827+0000 7f25bc12a640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f25b40b6020 0x7f25b41532f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.827+0000 7f25bc12a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b40b3e10 con 0x7f25b40b2a00 2023-11-16T02:30:28.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.827+0000 7f25bc12a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b40b5820 con 0x7f25b40b38f0 2023-11-16T02:30:28.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.827+0000 7f25bc12a640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b40b5b00 con 0x7f25b40b6020 2023-11-16T02:30:28.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.827+0000 7f25b9ec6640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f25b40b2a00 0x7f25b41489e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54350/0 (socket says 172.21.15.28:54350) 2023-11-16T02:30:28.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.827+0000 7f25b9ec6640 1 -- 172.21.15.28:0/1195571682 learned_addr learned my addr 172.21.15.28:0/1195571682 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:30:28.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.827+0000 7f25b96c5640 1 --2- 172.21.15.28:0/1195571682 >> v2:172.21.15.28:3300/0 conn(0x7f25b40b38f0 0x7f25b406a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:28.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.827+0000 7f25ba6c7640 1 --2- 172.21.15.28:0/1195571682 >> v2:172.21.15.70:3300/0 conn(0x7f25b40b6020 0x7f25b41532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:28.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.827+0000 7f25b96c5640 1 -- 172.21.15.28:0/1195571682 >> v2:172.21.15.70:3300/0 conn(0x7f25b40b6020 msgr2=0x7f25b41532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:28.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.827+0000 7f25b96c5640 1 --2- 172.21.15.28:0/1195571682 >> v2:172.21.15.70:3300/0 conn(0x7f25b40b6020 0x7f25b41532f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.827+0000 7f25b96c5640 1 -- 172.21.15.28:0/1195571682 >> v1:172.21.15.28:6789/0 conn(0x7f25b40b2a00 legacy=0x7f25b41489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:28.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.827+0000 7f25b96c5640 1 -- 172.21.15.28:0/1195571682 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b40b5040 con 0x7f25b40b38f0 2023-11-16T02:30:28.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.827+0000 7f25b8ec4640 1 -- 172.21.15.28:0/1195571682 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 695151896 0 0) 0x7f25b40b3e10 con 0x7f25b40b2a00 2023-11-16T02:30:28.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.831+0000 7f25b96c5640 1 --2- 172.21.15.28:0/1195571682 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25b40b38f0 0x7f25b406a170 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f25b40b82a0 tx=0x7f25a401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51f9344c3804c0c server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:28.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.831+0000 7f25b8ec4640 1 -- 172.21.15.28:0/1195571682 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a40a8950 con 0x7f25b40b38f0 2023-11-16T02:30:28.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.831+0000 7f25b8ec4640 1 -- 172.21.15.28:0/1195571682 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a40a8ab0 con 0x7f25b40b38f0 2023-11-16T02:30:28.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.831+0000 7f25b8ec4640 1 -- 172.21.15.28:0/1195571682 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a40a8e40 con 0x7f25b40b38f0 2023-11-16T02:30:28.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.831+0000 7f25bc12a640 1 -- 172.21.15.28:0/1195571682 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25b40b38f0 msgr2=0x7f25b406a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:28.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.831+0000 7f25bc12a640 1 --2- 172.21.15.28:0/1195571682 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25b40b38f0 0x7f25b406a170 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f25b40b82a0 tx=0x7f25a401ec50 comp rx=0 tx=0).stop 2023-11-16T02:30:28.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.831+0000 7f25bc12a640 1 -- 172.21.15.28:0/1195571682 shutdown_connections 2023-11-16T02:30:28.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.831+0000 7f25bc12a640 1 --2- 172.21.15.28:0/1195571682 >> v2:172.21.15.70:3300/0 conn(0x7f25b40b6020 0x7f25b41532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.831+0000 7f25bc12a640 1 --2- 172.21.15.28:0/1195571682 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25b40b38f0 0x7f25b406a170 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.831+0000 7f25bc12a640 1 -- 172.21.15.28:0/1195571682 >> 172.21.15.28:0/1195571682 conn(0x7f25b40bc3e0 msgr2=0x7f25b40bc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:28.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.831+0000 7f25bc12a640 1 -- 172.21.15.28:0/1195571682 shutdown_connections 2023-11-16T02:30:28.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.831+0000 7f25bc12a640 1 -- 172.21.15.28:0/1195571682 wait complete. 2023-11-16T02:30:28.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.831+0000 7f25bc12a640 1 Processor -- start 2023-11-16T02:30:28.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.831+0000 7f25bc12a640 1 -- start start 2023-11-16T02:30:28.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.831+0000 7f25bc12a640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f25b40b2a00 0x7f25b413b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.831+0000 7f25bc12a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25b40b38f0 0x7f25b413b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.831+0000 7f25bc12a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25b40b6020 0x7f25b41dde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.831+0000 7f25bc12a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b41dd950 con 0x7f25b40b38f0 2023-11-16T02:30:28.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.831+0000 7f25bc12a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b4139c50 con 0x7f25b40b6020 2023-11-16T02:30:28.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.831+0000 7f25bc12a640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b4139f30 con 0x7f25b40b2a00 2023-11-16T02:30:28.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.831+0000 7f25b96c5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25b40b38f0 0x7f25b413b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:28.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.831+0000 7f25b96c5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25b40b38f0 0x7f25b413b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54346/0 (socket says 172.21.15.28:54346) 2023-11-16T02:30:28.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.831+0000 7f25b96c5640 1 -- 172.21.15.28:0/492337445 learned_addr learned my addr 172.21.15.28:0/492337445 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:28.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.835+0000 7f25ba6c7640 1 --2- 172.21.15.28:0/492337445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25b40b6020 0x7f25b41dde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:28.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.835+0000 7f25b9ec6640 1 --2- 172.21.15.28:0/492337445 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f25b40b2a00 0x7f25b413b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:28.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.835+0000 7f25b96c5640 1 -- 172.21.15.28:0/492337445 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f25b40b2a00 msgr2=0x7f25b413b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:28.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.835+0000 7f25b96c5640 1 --2- 172.21.15.28:0/492337445 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f25b40b2a00 0x7f25b413b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.835+0000 7f25b96c5640 1 -- 172.21.15.28:0/492337445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25b40b6020 msgr2=0x7f25b41dde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:28.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.835+0000 7f25b96c5640 1 --2- 172.21.15.28:0/492337445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25b40b6020 0x7f25b41dde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.835+0000 7f25b96c5640 1 -- 172.21.15.28:0/492337445 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a4009420 con 0x7f25b40b38f0 2023-11-16T02:30:28.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.835+0000 7f25b96c5640 1 --2- 172.21.15.28:0/492337445 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25b40b38f0 0x7f25b413b6c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f25a40b3040 tx=0x7f25a401b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:28.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.835+0000 7f25aa7fc640 1 -- 172.21.15.28:0/492337445 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a40b9630 con 0x7f25b40b38f0 2023-11-16T02:30:28.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.835+0000 7f25aa7fc640 1 -- 172.21.15.28:0/492337445 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a40b97b0 con 0x7f25b40b38f0 2023-11-16T02:30:28.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.835+0000 7f25bc12a640 1 -- 172.21.15.28:0/492337445 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b414a680 con 0x7f25b40b38f0 2023-11-16T02:30:28.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.835+0000 7f25aa7fc640 1 -- 172.21.15.28:0/492337445 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a40b9b60 con 0x7f25b40b38f0 2023-11-16T02:30:28.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.835+0000 7f25bc12a640 1 -- 172.21.15.28:0/492337445 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b413a4e0 con 0x7f25b40b38f0 2023-11-16T02:30:28.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.835+0000 7f25aa7fc640 1 -- 172.21.15.28:0/492337445 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f25a40b7040 con 0x7f25b40b38f0 2023-11-16T02:30:28.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.835+0000 7f25aa7fc640 1 --2- 172.21.15.28:0/492337445 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2598065a90 0x7f2598067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.835+0000 7f25aa7fc640 1 -- 172.21.15.28:0/492337445 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25a41210e0 con 0x7f25b40b38f0 2023-11-16T02:30:28.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.835+0000 7f25b9ec6640 1 --2- 172.21.15.28:0/492337445 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2598065a90 0x7f2598067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:28.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.835+0000 7f25b9ec6640 1 --2- 172.21.15.28:0/492337445 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2598065a90 0x7f2598067f50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f25b0000f70 tx=0x7f25b0007b60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:28.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.835+0000 7f25bf252000 1 Processor -- start 2023-11-16T02:30:28.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.835+0000 7f25bf252000 1 -- start start 2023-11-16T02:30:28.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76b930 0x558a0e76bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x558a0e76c250 0x558a0e76c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a0e76cb70 0x558a0e7aabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0e633fc0 con 0x558a0e76b930 2023-11-16T02:30:28.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0e5c21a0 con 0x558a0e76cb70 2023-11-16T02:30:28.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a0e5bf770 con 0x558a0e76c250 2023-11-16T02:30:28.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25b9ec6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76b930 0x558a0e76bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:28.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25b9ec6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76b930 0x558a0e76bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54352/0 (socket says 172.21.15.28:54352) 2023-11-16T02:30:28.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25b9ec6640 1 -- 172.21.15.28:0/3632891658 learned_addr learned my addr 172.21.15.28:0/3632891658 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:28.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25b9ec6640 1 -- 172.21.15.28:0/3632891658 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x558a0e76c250 msgr2=0x558a0e76c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:28.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25b9ec6640 1 --2- 172.21.15.28:0/3632891658 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x558a0e76c250 0x558a0e76c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25b9ec6640 1 -- 172.21.15.28:0/3632891658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a0e76cb70 msgr2=0x558a0e7aabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:28.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25b9ec6640 1 --2- 172.21.15.28:0/3632891658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a0e76cb70 0x558a0e7aabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25b9ec6640 1 -- 172.21.15.28:0/3632891658 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a0e2b7890 con 0x558a0e76b930 2023-11-16T02:30:28.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25b9ec6640 1 --2- 172.21.15.28:0/3632891658 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76b930 0x558a0e76bd10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f25b0005d10 tx=0x7f25b0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e1f7f80939039e server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:28.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25977fe640 1 -- 172.21.15.28:0/3632891658 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b0015110 con 0x558a0e76b930 2023-11-16T02:30:28.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25977fe640 1 -- 172.21.15.28:0/3632891658 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b0015270 con 0x558a0e76b930 2023-11-16T02:30:28.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25977fe640 1 -- 172.21.15.28:0/3632891658 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b0015bc0 con 0x558a0e76b930 2023-11-16T02:30:28.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 1 -- 172.21.15.28:0/3632891658 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76b930 msgr2=0x558a0e76bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:28.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 1 --2- 172.21.15.28:0/3632891658 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76b930 0x558a0e76bd10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f25b0005d10 tx=0x7f25b0012000 comp rx=0 tx=0).stop 2023-11-16T02:30:28.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 1 -- 172.21.15.28:0/3632891658 shutdown_connections 2023-11-16T02:30:28.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 1 --2- 172.21.15.28:0/3632891658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a0e76cb70 0x558a0e7aabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 1 --2- 172.21.15.28:0/3632891658 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x558a0e76c250 0x558a0e76c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 1 --2- 172.21.15.28:0/3632891658 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76b930 0x558a0e76bd10 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 1 -- 172.21.15.28:0/3632891658 >> 172.21.15.28:0/3632891658 conn(0x558a0e767e20 msgr2=0x558a0e76a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:28.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 1 -- 172.21.15.28:0/3632891658 shutdown_connections 2023-11-16T02:30:28.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 1 -- 172.21.15.28:0/3632891658 wait complete. 2023-11-16T02:30:28.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 1 -- start start 2023-11-16T02:30:28.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 1 Processor -- start 2023-11-16T02:30:28.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76b930 0x558a0e7ab700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x558a0e76c250 0x558a0e7abc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a0e76cb70 0x558a0e7776f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0e5bb060 con 0x558a0e76b930 2023-11-16T02:30:28.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0e55a290 con 0x558a0e76cb70 2023-11-16T02:30:28.848 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a0e5786f0 con 0x558a0e76c250 2023-11-16T02:30:28.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 10 client.0 _ll_register_callbacks cb 0x558a0e7571d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-16T02:30:28.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25b9ec6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76b930 0x558a0e7ab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:28.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25b9ec6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76b930 0x558a0e7ab700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54368/0 (socket says 172.21.15.28:54368) 2023-11-16T02:30:28.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25b9ec6640 1 -- 172.21.15.28:0/1266876762 learned_addr learned my addr 172.21.15.28:0/1266876762 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:28.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25ba6c7640 1 --2- 172.21.15.28:0/1266876762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a0e76cb70 0x558a0e7776f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:28.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25b9ec6640 1 -- 172.21.15.28:0/1266876762 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x558a0e76c250 msgr2=0x558a0e7abc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:28.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25b96c5640 1 --2- 172.21.15.28:0/1266876762 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x558a0e76c250 0x558a0e7abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:28.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25b9ec6640 1 --2- 172.21.15.28:0/1266876762 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x558a0e76c250 0x558a0e7abc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25b9ec6640 1 -- 172.21.15.28:0/1266876762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a0e76cb70 msgr2=0x558a0e7776f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:28.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25b9ec6640 1 --2- 172.21.15.28:0/1266876762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a0e76cb70 0x558a0e7776f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25b9ec6640 1 -- 172.21.15.28:0/1266876762 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b000f040 con 0x558a0e76b930 2023-11-16T02:30:28.849 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25b9ec6640 1 --2- 172.21.15.28:0/1266876762 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76b930 0x558a0e7ab700 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f25b0015810 tx=0x7f25b0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2d7d18f85fb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:28.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f2594ff9640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2023-11-16T02:30:28.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f2594ff9640 1 -- 172.21.15.28:0/1266876762 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b0026070 con 0x558a0e76b930 2023-11-16T02:30:28.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 1 -- 172.21.15.28:0/1266876762 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a0e5b99b0 con 0x558a0e76b930 2023-11-16T02:30:28.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f2594ff9640 1 -- 172.21.15.28:0/1266876762 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25b0015d10 con 0x558a0e76b930 2023-11-16T02:30:28.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f2594ff9640 1 -- 172.21.15.28:0/1266876762 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25b0021450 con 0x558a0e76b930 2023-11-16T02:30:28.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 10 client.5136 fetch_fsmap learned FSMap version 13 2023-11-16T02:30:28.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.839+0000 7f25bf252000 1 -- 172.21.15.28:0/1266876762 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x558a0e5801e0 con 0x558a0e76b930 2023-11-16T02:30:28.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.843+0000 7f2594ff9640 1 -- 172.21.15.28:0/1266876762 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558a0e5b99b0 con 0x558a0e76b930 2023-11-16T02:30:28.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.843+0000 7f2594ff9640 1 -- 172.21.15.28:0/1266876762 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 13) v1 ==== 2561+0+0 (secure 0 0 0) 0x7f25b00215b0 con 0x558a0e76b930 2023-11-16T02:30:28.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.843+0000 7f25bf252000 10 client.5136 fetch_fsmap finished waiting for FSMap version 13 2023-11-16T02:30:28.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.843+0000 7f25bf252000 10 client.5136 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-16T02:30:28.850 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.843+0000 7f25bf252000 20 client.5136 populate_metadata read hostname 'smithi028' 2023-11-16T02:30:28.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.843+0000 7f25bf252000 1 --2- 172.21.15.28:0/1266876762 >> [v2:172.21.15.28:6835/885495356,v1:172.21.15.28:6837/885495356] conn(0x558a0e778460 0x558a0e778840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.843+0000 7f25bf252000 4 client.5136 mds_command: new command op to 4950 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-16T02:30:28.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.843+0000 7f25bf252000 1 -- 172.21.15.28:0/1266876762 --> [v2:172.21.15.28:6835/885495356,v1:172.21.15.28:6837/885495356] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558a0e5ea4d0 con 0x558a0e778460 2023-11-16T02:30:28.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.843+0000 7f25b96c5640 1 --2- 172.21.15.28:0/1266876762 >> [v2:172.21.15.28:6835/885495356,v1:172.21.15.28:6837/885495356] conn(0x558a0e778460 0x558a0e778840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:28.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.843+0000 7f2594ff9640 10 client.5136 ms_handle_connect on v2:172.21.15.28:6835/885495356 2023-11-16T02:30:28.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.843+0000 7f25b96c5640 1 --2- 172.21.15.28:0/1266876762 >> [v2:172.21.15.28:6835/885495356,v1:172.21.15.28:6837/885495356] conn(0x558a0e778460 0x558a0e778840 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e7e67c77fa67db1 server_cookie=fd8b4e2f934b0016 in_seq=0 out_seq=0 2023-11-16T02:30:28.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.843+0000 7f2594ff9640 1 -- 172.21.15.28:0/1266876762 <== mds.0 v2:172.21.15.28:6835/885495356 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x558a0e5ea4d0 con 0x558a0e778460 2023-11-16T02:30:28.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.843+0000 7f2594ff9640 10 client.5136 handle_command_reply: tid=0 2023-11-16T02:30:28.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.843+0000 7f25bf252000 1 client.5136 shutdown 2023-11-16T02:30:28.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.843+0000 7f25bf252000 1 -- 172.21.15.28:0/1266876762 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76b930 msgr2=0x558a0e7ab700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:28.851 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.843+0000 7f25bf252000 1 --2- 172.21.15.28:0/1266876762 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76b930 0x558a0e7ab700 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f25b0015810 tx=0x7f25b0000ee0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.843+0000 7f25bf252000 1 -- 172.21.15.28:0/1266876762 shutdown_connections 2023-11-16T02:30:28.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.843+0000 7f25bf252000 1 --2- 172.21.15.28:0/1266876762 >> [v2:172.21.15.28:6835/885495356,v1:172.21.15.28:6837/885495356] conn(0x558a0e778460 0x558a0e778840 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.843+0000 7f25bf252000 1 --2- 172.21.15.28:0/1266876762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a0e76cb70 0x558a0e7776f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.843+0000 7f25bf252000 1 --2- 172.21.15.28:0/1266876762 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x558a0e76c250 0x558a0e7abc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.843+0000 7f25bf252000 1 --2- 172.21.15.28:0/1266876762 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76b930 0x558a0e7ab700 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.843+0000 7f2594ff9640 0 client.5136 ms_handle_reset on v2:172.21.15.28:6835/885495356 2023-11-16T02:30:28.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.843+0000 7f25bf252000 1 -- 172.21.15.28:0/1266876762 >> 172.21.15.28:0/1266876762 conn(0x558a0e767e20 msgr2=0x558a0e76aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:28.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.843+0000 7f25bf252000 1 -- 172.21.15.28:0/1266876762 shutdown_connections 2023-11-16T02:30:28.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.843+0000 7f25bf252000 1 -- 172.21.15.28:0/1266876762 wait complete. 2023-11-16T02:30:28.852 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.843+0000 7f25bf252000 20 client.5136 trim_cache size 0 max 16384 2023-11-16T02:30:28.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25bf252000 1 Processor -- start 2023-11-16T02:30:28.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25bf252000 1 -- start start 2023-11-16T02:30:28.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25bf252000 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x558a0e76b930 0x558a0e7766a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25bf252000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76c250 0x558a0e7cd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25bf252000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a0e76cb70 0x558a0e7cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25bf252000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0e278940 con 0x558a0e76c250 2023-11-16T02:30:28.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25bf252000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0e5bc5f0 con 0x558a0e76cb70 2023-11-16T02:30:28.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25bf252000 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a0e76fcc0 con 0x558a0e76b930 2023-11-16T02:30:28.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25b96c5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76c250 0x558a0e7cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:28.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25b96c5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76c250 0x558a0e7cd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54378/0 (socket says 172.21.15.28:54378) 2023-11-16T02:30:28.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25b96c5640 1 -- 172.21.15.28:0/2907555250 learned_addr learned my addr 172.21.15.28:0/2907555250 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:28.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25b96c5640 1 -- 172.21.15.28:0/2907555250 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x558a0e76b930 msgr2=0x558a0e7766a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:28.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25b96c5640 1 --2- 172.21.15.28:0/2907555250 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x558a0e76b930 0x558a0e7766a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25b96c5640 1 -- 172.21.15.28:0/2907555250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a0e76cb70 msgr2=0x558a0e7cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:28.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25b96c5640 1 --2- 172.21.15.28:0/2907555250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a0e76cb70 0x558a0e7cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25b96c5640 1 -- 172.21.15.28:0/2907555250 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a0e566330 con 0x558a0e76c250 2023-11-16T02:30:28.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25b96c5640 1 --2- 172.21.15.28:0/2907555250 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76c250 0x558a0e7cd460 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f25a411f6c0 tx=0x7f25a4009170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb7692a95d55eefa server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:28.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f2597fff640 1 -- 172.21.15.28:0/2907555250 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a411d070 con 0x558a0e76c250 2023-11-16T02:30:28.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f2597fff640 1 -- 172.21.15.28:0/2907555250 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a40f27f0 con 0x558a0e76c250 2023-11-16T02:30:28.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f2597fff640 1 -- 172.21.15.28:0/2907555250 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a40f6620 con 0x558a0e76c250 2023-11-16T02:30:28.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25bf252000 1 -- 172.21.15.28:0/2907555250 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76c250 msgr2=0x558a0e7cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:28.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25bf252000 1 --2- 172.21.15.28:0/2907555250 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76c250 0x558a0e7cd460 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f25a411f6c0 tx=0x7f25a4009170 comp rx=0 tx=0).stop 2023-11-16T02:30:28.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25bf252000 1 -- 172.21.15.28:0/2907555250 shutdown_connections 2023-11-16T02:30:28.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25bf252000 1 --2- 172.21.15.28:0/2907555250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a0e76cb70 0x558a0e7cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25bf252000 1 --2- 172.21.15.28:0/2907555250 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76c250 0x558a0e7cd460 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25bf252000 1 --2- 172.21.15.28:0/2907555250 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x558a0e76b930 0x558a0e7766a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25bf252000 1 -- 172.21.15.28:0/2907555250 >> 172.21.15.28:0/2907555250 conn(0x558a0e767e20 msgr2=0x558a0e76a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:28.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25bf252000 1 -- 172.21.15.28:0/2907555250 shutdown_connections 2023-11-16T02:30:28.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25bf252000 1 -- 172.21.15.28:0/2907555250 wait complete. 2023-11-16T02:30:28.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25bf252000 1 -- start start 2023-11-16T02:30:28.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.859+0000 7f25bf252000 1 Processor -- start 2023-11-16T02:30:28.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a0e76b930 0x558a0e7fe560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76c250 0x558a0e7feaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x558a0e76cb70 0x558a0e7ff2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0e76f190 con 0x558a0e76c250 2023-11-16T02:30:28.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a0e5b5400 con 0x558a0e76b930 2023-11-16T02:30:28.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a0e5637e0 con 0x558a0e76cb70 2023-11-16T02:30:28.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 10 client.0 _ll_register_callbacks cb 0x558a0e55b1d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-16T02:30:28.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25b96c5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76c250 0x558a0e7feaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:28.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25b96c5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76c250 0x558a0e7feaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54390/0 (socket says 172.21.15.28:54390) 2023-11-16T02:30:28.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25b96c5640 1 -- 172.21.15.28:0/4123291359 learned_addr learned my addr 172.21.15.28:0/4123291359 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:28.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25ba6c7640 1 --2- 172.21.15.28:0/4123291359 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x558a0e76cb70 0x558a0e7ff2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:28.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25b9ec6640 1 --2- 172.21.15.28:0/4123291359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a0e76b930 0x558a0e7fe560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:28.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25b96c5640 1 -- 172.21.15.28:0/4123291359 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x558a0e76cb70 msgr2=0x558a0e7ff2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:28.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25b96c5640 1 --2- 172.21.15.28:0/4123291359 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x558a0e76cb70 0x558a0e7ff2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25b96c5640 1 -- 172.21.15.28:0/4123291359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a0e76b930 msgr2=0x558a0e7fe560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:28.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25b96c5640 1 --2- 172.21.15.28:0/4123291359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a0e76b930 0x558a0e7fe560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25b96c5640 1 -- 172.21.15.28:0/4123291359 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b413a4e0 con 0x558a0e76c250 2023-11-16T02:30:28.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25b96c5640 1 --2- 172.21.15.28:0/4123291359 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76c250 0x558a0e7feaa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f25a401c880 tx=0x7f25a4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7509bce9d21c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:28.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f2594ff9640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2023-11-16T02:30:28.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f2594ff9640 1 -- 172.21.15.28:0/4123291359 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a411d040 con 0x558a0e76c250 2023-11-16T02:30:28.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f2594ff9640 1 -- 172.21.15.28:0/4123291359 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25a40f6620 con 0x558a0e76c250 2023-11-16T02:30:28.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 1 -- 172.21.15.28:0/4123291359 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a0e7ab1a0 con 0x558a0e76c250 2023-11-16T02:30:28.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f2594ff9640 1 -- 172.21.15.28:0/4123291359 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25a411f2c0 con 0x558a0e76c250 2023-11-16T02:30:28.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 10 client.5142 fetch_fsmap learned FSMap version 13 2023-11-16T02:30:28.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 1 -- 172.21.15.28:0/4123291359 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x558a0e2b7cc0 con 0x558a0e76c250 2023-11-16T02:30:28.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f2594ff9640 1 -- 172.21.15.28:0/4123291359 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a4117080 con 0x558a0e76c250 2023-11-16T02:30:28.870 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f2594ff9640 1 -- 172.21.15.28:0/4123291359 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 13) v1 ==== 2561+0+0 (secure 0 0 0) 0x7f25a40eef00 con 0x558a0e76c250 2023-11-16T02:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 10 client.5142 fetch_fsmap finished waiting for FSMap version 13 2023-11-16T02:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 10 client.5142 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-16T02:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 20 client.5142 populate_metadata read hostname 'smithi028' 2023-11-16T02:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 1 --2- 172.21.15.28:0/4123291359 >> [v2:172.21.15.28:6835/885495356,v1:172.21.15.28:6837/885495356] conn(0x558a0e7ffb70 0x558a0e7fff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 4 client.5142 mds_command: new command op to 4950 tid=0[{"prefix": "status"}] 2023-11-16T02:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 1 -- 172.21.15.28:0/4123291359 --> [v2:172.21.15.28:6835/885495356,v1:172.21.15.28:6837/885495356] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558a0e58ab90 con 0x558a0e7ffb70 2023-11-16T02:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25b9ec6640 1 --2- 172.21.15.28:0/4123291359 >> [v2:172.21.15.28:6835/885495356,v1:172.21.15.28:6837/885495356] conn(0x558a0e7ffb70 0x558a0e7fff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25b9ec6640 1 --2- 172.21.15.28:0/4123291359 >> [v2:172.21.15.28:6835/885495356,v1:172.21.15.28:6837/885495356] conn(0x558a0e7ffb70 0x558a0e7fff50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32785387a98732bc server_cookie=bb740b889174fc6d in_seq=0 out_seq=0 2023-11-16T02:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f2594ff9640 10 client.5142 ms_handle_connect on v2:172.21.15.28:6835/885495356 2023-11-16T02:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f2594ff9640 1 -- 172.21.15.28:0/4123291359 <== mds.0 v2:172.21.15.28:6835/885495356 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x558a0e58ab90 con 0x558a0e7ffb70 2023-11-16T02:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f2594ff9640 10 client.5142 handle_command_reply: tid=0 2023-11-16T02:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 1 client.5142 shutdown 2023-11-16T02:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 1 -- 172.21.15.28:0/4123291359 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76c250 msgr2=0x558a0e7feaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:28.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 1 --2- 172.21.15.28:0/4123291359 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76c250 0x558a0e7feaa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f25a401c880 tx=0x7f25a4000bd0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 1 -- 172.21.15.28:0/4123291359 shutdown_connections 2023-11-16T02:30:28.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 1 --2- 172.21.15.28:0/4123291359 >> [v2:172.21.15.28:6835/885495356,v1:172.21.15.28:6837/885495356] conn(0x558a0e7ffb70 0x558a0e7fff50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 1 --2- 172.21.15.28:0/4123291359 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x558a0e76cb70 0x558a0e7ff2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f2594ff9640 0 client.5142 ms_handle_reset on v2:172.21.15.28:6835/885495356 2023-11-16T02:30:28.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 1 --2- 172.21.15.28:0/4123291359 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558a0e76c250 0x558a0e7feaa0 secure :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f25a401c880 tx=0x7f25a4000bd0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 1 --2- 172.21.15.28:0/4123291359 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a0e76b930 0x558a0e7fe560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 1 -- 172.21.15.28:0/4123291359 >> 172.21.15.28:0/4123291359 conn(0x558a0e767e20 msgr2=0x558a0e776f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:28.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 1 -- 172.21.15.28:0/4123291359 shutdown_connections 2023-11-16T02:30:28.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 1 -- 172.21.15.28:0/4123291359 wait complete. 2023-11-16T02:30:28.872 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bf252000 20 client.5142 trim_cache size 0 max 16384 2023-11-16T02:30:28.873 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2023-11-16T02:30:28.873 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "1325a234-ab9e-4632-9a6e-98afbef8ae76", 2023-11-16T02:30:28.873 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 0, 2023-11-16T02:30:28.873 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 4950, 2023-11-16T02:30:28.873 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2023-11-16T02:30:28.873 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2023-11-16T02:30:28.873 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2023-11-16T02:30:28.874 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 9.0406128549999991, 2023-11-16T02:30:28.874 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 13, 2023-11-16T02:30:28.874 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 33, 2023-11-16T02:30:28.874 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 33, 2023-11-16T02:30:28.874 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 16.091304771000001 2023-11-16T02:30:28.874 INFO:teuthology.orchestra.run.smithi028.stdout:} 2023-11-16T02:30:28.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bc12a640 1 -- 172.21.15.28:0/492337445 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2598065a90 msgr2=0x7f2598067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:28.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bc12a640 1 --2- 172.21.15.28:0/492337445 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2598065a90 0x7f2598067f50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f25b0000f70 tx=0x7f25b0007b60 comp rx=0 tx=0).stop 2023-11-16T02:30:28.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bc12a640 1 -- 172.21.15.28:0/492337445 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25b40b38f0 msgr2=0x7f25b413b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:28.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bc12a640 1 --2- 172.21.15.28:0/492337445 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25b40b38f0 0x7f25b413b6c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f25a40b3040 tx=0x7f25a401b9f0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.875 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bc12a640 1 -- 172.21.15.28:0/492337445 shutdown_connections 2023-11-16T02:30:28.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bc12a640 1 --2- 172.21.15.28:0/492337445 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f2598065a90 0x7f2598067f50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bc12a640 1 --2- 172.21.15.28:0/492337445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f25b40b6020 0x7f25b41dde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bc12a640 1 --2- 172.21.15.28:0/492337445 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25b40b38f0 0x7f25b413b6c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bc12a640 1 --2- 172.21.15.28:0/492337445 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f25b40b2a00 0x7f25b413b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bc12a640 1 -- 172.21.15.28:0/492337445 >> 172.21.15.28:0/492337445 conn(0x7f25b40bc3e0 msgr2=0x7f25b40ba200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:28.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bc12a640 1 -- 172.21.15.28:0/492337445 shutdown_connections 2023-11-16T02:30:28.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.863+0000 7f25bc12a640 1 -- 172.21.15.28:0/492337445 wait complete. 2023-11-16T02:30:28.883 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-16T02:30:28.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.995+0000 7f3f41b0c640 1 Processor -- start 2023-11-16T02:30:28.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.995+0000 7f3f41b0c640 1 -- start start 2023-11-16T02:30:28.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.995+0000 7f3f41b0c640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f3f3c0b7dd0 0x7f3f3c142850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.995+0000 7f3f41b0c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3f3c0bc830 0x7f3f3c142d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.995+0000 7f3f41b0c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3f3c0714c0 0x7f3f3c0b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:28.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.995+0000 7f3f41b0c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f3c0b88a0 con 0x7f3f3c0714c0 2023-11-16T02:30:28.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.995+0000 7f3f41b0c640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f3c0b3450 con 0x7f3f3c0b7dd0 2023-11-16T02:30:28.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.995+0000 7f3f41b0c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c0b3fd0 con 0x7f3f3c0bc830 2023-11-16T02:30:28.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.995+0000 7f3f3bfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3f3c0714c0 0x7f3f3c0b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:28.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.995+0000 7f3f3bfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3f3c0714c0 0x7f3f3c0b58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54400/0 (socket says 172.21.15.28:54400) 2023-11-16T02:30:28.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.995+0000 7f3f3bfff640 1 -- 172.21.15.28:0/2767726908 learned_addr learned my addr 172.21.15.28:0/2767726908 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:28.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.995+0000 7f3f33fff640 1 --2- 172.21.15.28:0/2767726908 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3f3c0bc830 0x7f3f3c142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:28.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.995+0000 7f3f3b7fe640 1 --2- 172.21.15.28:0/2767726908 >> v2:172.21.15.70:3300/0 conn(0x7f3f3c0b7dd0 0x7f3f3c142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:28.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.995+0000 7f3f3bfff640 1 -- 172.21.15.28:0/2767726908 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3f3c0bc830 msgr2=0x7f3f3c142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:28.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.995+0000 7f3f3bfff640 1 --2- 172.21.15.28:0/2767726908 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3f3c0bc830 0x7f3f3c142d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.995+0000 7f3f3bfff640 1 -- 172.21.15.28:0/2767726908 >> v2:172.21.15.70:3300/0 conn(0x7f3f3c0b7dd0 msgr2=0x7f3f3c142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:30:28.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.995+0000 7f3f3bfff640 1 --2- 172.21.15.28:0/2767726908 >> v2:172.21.15.70:3300/0 conn(0x7f3f3c0b7dd0 0x7f3f3c142850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:28.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.995+0000 7f3f3bfff640 1 -- 172.21.15.28:0/2767726908 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3c0b36a0 con 0x7f3f3c0714c0 2023-11-16T02:30:29.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f3bfff640 1 --2- 172.21.15.28:0/2767726908 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f3c0714c0 0x7f3f3c0b58d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0bc7c0 tx=0x7f3f3401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cdbc4332d1c0c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:29.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f3affd640 1 -- 172.21.15.28:0/2767726908 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f340a5730 con 0x7f3f3c0714c0 2023-11-16T02:30:29.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f3affd640 1 -- 172.21.15.28:0/2767726908 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f340a5890 con 0x7f3f3c0714c0 2023-11-16T02:30:29.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f3affd640 1 -- 172.21.15.28:0/2767726908 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f340a5c20 con 0x7f3f3c0714c0 2023-11-16T02:30:29.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f41b0c640 1 -- 172.21.15.28:0/2767726908 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f3c0714c0 msgr2=0x7f3f3c0b58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:29.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f41b0c640 1 --2- 172.21.15.28:0/2767726908 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f3c0714c0 0x7f3f3c0b58d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c0bc7c0 tx=0x7f3f3401c9a0 comp rx=0 tx=0).stop 2023-11-16T02:30:29.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f41b0c640 1 -- 172.21.15.28:0/2767726908 shutdown_connections 2023-11-16T02:30:29.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f41b0c640 1 --2- 172.21.15.28:0/2767726908 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f3c0714c0 0x7f3f3c0b58d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:29.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f41b0c640 1 --2- 172.21.15.28:0/2767726908 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3f3c0bc830 0x7f3f3c142d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:29.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f41b0c640 1 --2- 172.21.15.28:0/2767726908 >> v2:172.21.15.70:3300/0 conn(0x7f3f3c0b7dd0 0x7f3f3c142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:29.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f41b0c640 1 -- 172.21.15.28:0/2767726908 >> 172.21.15.28:0/2767726908 conn(0x7f3f3c0b9050 msgr2=0x7f3f3c0bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:29.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f41b0c640 1 -- 172.21.15.28:0/2767726908 shutdown_connections 2023-11-16T02:30:29.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f41b0c640 1 -- 172.21.15.28:0/2767726908 wait complete. 2023-11-16T02:30:29.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f41b0c640 1 Processor -- start 2023-11-16T02:30:29.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f41b0c640 1 -- start start 2023-11-16T02:30:29.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f41b0c640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3f3c0714c0 0x7f3f3c1440e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:29.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f41b0c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f3c0b7dd0 0x7f3f3c13b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:29.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f41b0c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f3c0bc830 0x7f3f3c13b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:29.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f41b0c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c143d10 con 0x7f3f3c0b7dd0 2023-11-16T02:30:29.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f41b0c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c1463c0 con 0x7f3f3c0bc830 2023-11-16T02:30:29.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f41b0c640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3c144620 con 0x7f3f3c0714c0 2023-11-16T02:30:29.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f33fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f3c0b7dd0 0x7f3f3c13b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:29.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f33fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f3c0b7dd0 0x7f3f3c13b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:54410/0 (socket says 172.21.15.28:54410) 2023-11-16T02:30:29.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f33fff640 1 -- 172.21.15.28:0/3197020274 learned_addr learned my addr 172.21.15.28:0/3197020274 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:30:29.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f3b7fe640 1 --2- 172.21.15.28:0/3197020274 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3f3c0714c0 0x7f3f3c1440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:29.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f3bfff640 1 --2- 172.21.15.28:0/3197020274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f3c0bc830 0x7f3f3c13b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:29.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f33fff640 1 -- 172.21.15.28:0/3197020274 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3f3c0714c0 msgr2=0x7f3f3c1440e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:29.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f33fff640 1 --2- 172.21.15.28:0/3197020274 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3f3c0714c0 0x7f3f3c1440e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:29.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f33fff640 1 -- 172.21.15.28:0/3197020274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f3c0bc830 msgr2=0x7f3f3c13b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:29.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f33fff640 1 --2- 172.21.15.28:0/3197020274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f3c0bc830 0x7f3f3c13b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:29.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f33fff640 1 -- 172.21.15.28:0/3197020274 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f34009b30 con 0x7f3f3c0b7dd0 2023-11-16T02:30:29.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f33fff640 1 --2- 172.21.15.28:0/3197020274 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f3c0b7dd0 0x7f3f3c13b370 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00d5f0 tx=0x7f3f2c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:29.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f38ff9640 1 -- 172.21.15.28:0/3197020274 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c0125f0 con 0x7f3f3c0b7dd0 2023-11-16T02:30:29.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f38ff9640 1 -- 172.21.15.28:0/3197020274 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2c012750 con 0x7f3f3c0b7dd0 2023-11-16T02:30:29.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f38ff9640 1 -- 172.21.15.28:0/3197020274 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2c012ae0 con 0x7f3f3c0b7dd0 2023-11-16T02:30:29.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f41b0c640 1 -- 172.21.15.28:0/3197020274 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f3c144ac0 con 0x7f3f3c0b7dd0 2023-11-16T02:30:29.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:28.999+0000 7f3f41b0c640 1 -- 172.21.15.28:0/3197020274 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f3c145f30 con 0x7f3f3c0b7dd0 2023-11-16T02:30:29.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:29.003+0000 7f3f41b0c640 1 -- 172.21.15.28:0/3197020274 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f3c1460c0 con 0x7f3f3c0b7dd0 2023-11-16T02:30:29.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:29.003+0000 7f3f38ff9640 1 -- 172.21.15.28:0/3197020274 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3f2c012c40 con 0x7f3f3c0b7dd0 2023-11-16T02:30:29.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:29.003+0000 7f3f38ff9640 1 --2- 172.21.15.28:0/3197020274 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3f1c065a90 0x7f3f1c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:30:29.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:29.003+0000 7f3f38ff9640 1 -- 172.21.15.28:0/3197020274 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f2c083490 con 0x7f3f3c0b7dd0 2023-11-16T02:30:29.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:29.003+0000 7f3f3b7fe640 1 --2- 172.21.15.28:0/3197020274 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3f1c065a90 0x7f3f1c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:30:29.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:29.003+0000 7f3f3b7fe640 1 --2- 172.21.15.28:0/3197020274 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3f1c065a90 0x7f3f1c067f50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400ba30 tx=0x7f3f24008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:30:29.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:29.007+0000 7f3f38ff9640 1 -- 172.21.15.28:0/3197020274 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f3f2c050e40 con 0x7f3f3c0b7dd0 2023-11-16T02:30:29.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:29.199+0000 7f3f41b0c640 1 -- 172.21.15.28:0/3197020274 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3f3c144ac0 con 0x7f3f3c0b7dd0 2023-11-16T02:30:29.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:29.199+0000 7f3f38ff9640 1 -- 172.21.15.28:0/3197020274 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3f3c144ac0 con 0x7f3f3c0b7dd0 2023-11-16T02:30:29.203 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-16T02:30:29.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:29.203+0000 7f3f41b0c640 1 -- 172.21.15.28:0/3197020274 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3f1c065a90 msgr2=0x7f3f1c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:29.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:29.203+0000 7f3f41b0c640 1 --2- 172.21.15.28:0/3197020274 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3f1c065a90 0x7f3f1c067f50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400ba30 tx=0x7f3f24008040 comp rx=0 tx=0).stop 2023-11-16T02:30:29.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:29.203+0000 7f3f41b0c640 1 -- 172.21.15.28:0/3197020274 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f3c0b7dd0 msgr2=0x7f3f3c13b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:30:29.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:29.203+0000 7f3f41b0c640 1 --2- 172.21.15.28:0/3197020274 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f3c0b7dd0 0x7f3f3c13b370 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00d5f0 tx=0x7f3f2c00dab0 comp rx=0 tx=0).stop 2023-11-16T02:30:29.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:29.203+0000 7f3f41b0c640 1 -- 172.21.15.28:0/3197020274 shutdown_connections 2023-11-16T02:30:29.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:29.203+0000 7f3f41b0c640 1 --2- 172.21.15.28:0/3197020274 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f3f1c065a90 0x7f3f1c067f50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:29.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:29.203+0000 7f3f41b0c640 1 --2- 172.21.15.28:0/3197020274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f3c0bc830 0x7f3f3c13b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:29.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:29.203+0000 7f3f41b0c640 1 --2- 172.21.15.28:0/3197020274 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3f3c0b7dd0 0x7f3f3c13b370 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:29.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:29.203+0000 7f3f41b0c640 1 --2- 172.21.15.28:0/3197020274 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f3f3c0714c0 0x7f3f3c1440e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:30:29.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:29.203+0000 7f3f41b0c640 1 -- 172.21.15.28:0/3197020274 >> 172.21.15.28:0/3197020274 conn(0x7f3f3c0b9050 msgr2=0x7f3f3c140fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:30:29.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:29.203+0000 7f3f41b0c640 1 -- 172.21.15.28:0/3197020274 shutdown_connections 2023-11-16T02:30:29.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:30:29.203+0000 7f3f41b0c640 1 -- 172.21.15.28:0/3197020274 wait complete. 2023-11-16T02:30:29.222 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-16T02:30:29.222 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-16T02:30:29.222 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi204.front.sepia.ceph.com 2023-11-16T02:30:29.222 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-16T02:30:29.222 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-16T02:30:29.222 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-16T02:30:29.222 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-16T02:30:29.222 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-16T02:30:29.222 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-16T02:30:29.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:30:29.223 DEBUG:teuthology.orchestra.run.smithi204:> ip addr 2023-11-16T02:30:29.233 INFO:teuthology.orchestra.run.smithi204.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-16T02:30:29.233 INFO:teuthology.orchestra.run.smithi204.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-16T02:30:29.233 INFO:teuthology.orchestra.run.smithi204.stdout: inet 127.0.0.1/8 scope host lo 2023-11-16T02:30:29.233 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-16T02:30:29.233 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 ::1/128 scope host 2023-11-16T02:30:29.233 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-16T02:30:29.233 INFO:teuthology.orchestra.run.smithi204.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-16T02:30:29.233 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:d9:36:2a brd ff:ff:ff:ff:ff:ff 2023-11-16T02:30:29.234 INFO:teuthology.orchestra.run.smithi204.stdout: altname enp7s0f0 2023-11-16T02:30:29.234 INFO:teuthology.orchestra.run.smithi204.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-16T02:30:29.234 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:d9:36:2b brd ff:ff:ff:ff:ff:ff 2023-11-16T02:30:29.234 INFO:teuthology.orchestra.run.smithi204.stdout: altname enp7s0f1 2023-11-16T02:30:29.234 INFO:teuthology.orchestra.run.smithi204.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-16T02:30:29.234 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:88:77:aa brd ff:ff:ff:ff:ff:ff 2023-11-16T02:30:29.234 INFO:teuthology.orchestra.run.smithi204.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-16T02:30:29.234 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0c:c4:7a:88:77:ab brd ff:ff:ff:ff:ff:ff 2023-11-16T02:30:29.234 INFO:teuthology.orchestra.run.smithi204.stdout: inet 172.21.15.204/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-16T02:30:29.234 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft 42335sec preferred_lft 42335sec 2023-11-16T02:30:29.234 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::ec4:7aff:fe88:77ab/64 scope link 2023-11-16T02:30:29.234 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-16T02:30:29.235 INFO:teuthology.orchestra.run.smithi204.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-16T02:30:29.235 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 02:42:cc:64:ac:d0 brd ff:ff:ff:ff:ff:ff 2023-11-16T02:30:29.235 INFO:teuthology.orchestra.run.smithi204.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-16T02:30:29.235 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-16T02:30:29.235 INFO:teuthology.orchestra.run.smithi204.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-16T02:30:29.235 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-16T02:30:29.235 INFO:teuthology.orchestra.run.smithi204.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-16T02:30:29.235 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-16T02:30:29.235 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-16T02:30:29.235 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-16T02:30:29.235 INFO:teuthology.orchestra.run.smithi204.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-16T02:30:29.235 INFO:teuthology.orchestra.run.smithi204.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-16T02:30:29.236 INFO:teuthology.orchestra.run.smithi204.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-16T02:30:29.236 INFO:teuthology.orchestra.run.smithi204.stdout: valid_lft forever preferred_lft forever 2023-11-16T02:30:29.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:30:29.237 DEBUG:teuthology.orchestra.run.smithi204:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-16T02:30:29.299 INFO:teuthology.orchestra.run.smithi204.stdout:1 2023-11-16T02:30:29.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:30:29.302 DEBUG:teuthology.orchestra.run.smithi204:> route 2023-11-16T02:30:29.355 INFO:teuthology.orchestra.run.smithi204.stdout:Kernel IP routing table 2023-11-16T02:30:29.355 INFO:teuthology.orchestra.run.smithi204.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-16T02:30:29.355 INFO:teuthology.orchestra.run.smithi204.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-16T02:30:29.355 INFO:teuthology.orchestra.run.smithi204.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-16T02:30:29.355 INFO:teuthology.orchestra.run.smithi204.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-16T02:30:29.356 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-16T02:30:29.356 INFO:teuthology.orchestra.run.smithi204.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-16T02:30:29.356 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-16T02:30:29.356 INFO:teuthology.orchestra.run.smithi204.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-16T02:30:29.356 INFO:teuthology.orchestra.run.smithi204.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-16T02:30:29.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:30:29.356 DEBUG:teuthology.orchestra.run.smithi204:> (cd / && exec bash -c ' 2023-11-16T02:30:29.356 DEBUG:teuthology.orchestra.run.smithi204:> set -e 2023-11-16T02:30:29.356 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-16T02:30:29.357 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-16T02:30:29.357 DEBUG:teuthology.orchestra.run.smithi204:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-16T02:30:29.357 DEBUG:teuthology.orchestra.run.smithi204:> ') 2023-11-16T02:30:29.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:30:29.454 DEBUG:teuthology.orchestra.run.smithi204:> ip netns list 2023-11-16T02:30:29.463 INFO:teuthology.orchestra.run.smithi204.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-16T02:30:29.464 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-16T02:30:29.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:30:29.464 DEBUG:teuthology.orchestra.run.smithi204:> sudo ip link set brx.0 up 2023-11-16T02:30:29.528 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-16T02:30:29.529 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-16T02:30:29.579 INFO:teuthology.orchestra.run.smithi204.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-16T02:30:29.580 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-16T02:30:29.580 DEBUG:teuthology.orchestra.run.smithi204:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-16T02:30:29.630 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-16T02:30:29.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:30:29.631 DEBUG:teuthology.orchestra.run.smithi204:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-16T02:30:29.727 INFO:teuthology.orchestra.run.smithi204.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-16T02:30:29.727 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-16T02:30:29.727 INFO:teuthology.orchestra.run.smithi204.stdout:invalid new device string format 2023-11-16T02:30:29.742 INFO:teuthology.orchestra.run.smithi204.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-16T02:30:29.743 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-16T02:30:29.743 INFO:teuthology.orchestra.run.smithi204.stdout:invalid new device string format 2023-11-16T02:30:29.743 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: resolved to: "172.21.15.28:3300,172.21.15.70:3300,172.21.15.70:3301" 2023-11-16T02:30:29.743 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-16T02:30:29.758 INFO:teuthology.orchestra.run.smithi204.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-16T02:30:29.758 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-16T02:30:29.758 INFO:teuthology.orchestra.run.smithi204.stdout:invalid new device string format 2023-11-16T02:30:29.758 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: resolved to: "172.21.15.28:3300,172.21.15.70:3300,172.21.15.70:3301" 2023-11-16T02:30:29.759 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-16T02:30:29.759 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: resolved to: "172.21.15.28:6789,172.21.15.70:6789,172.21.15.70:6790" 2023-11-16T02:30:29.759 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.28:6789,172.21.15.70:6789,172.21.15.70:6790:/ 2023-11-16T02:30:29.759 INFO:teuthology.orchestra.run.smithi204.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=1325a234-ab9e-4632-9a6e-98afbef8ae76" will pass to kernel 2023-11-16T02:30:29.763 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-16T02:30:29.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:30:29.763 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-16T02:30:29.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:30:29.785 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-16T02:30:29.859 INFO:teuthology.orchestra.run.smithi204.stdout:client5151 2023-11-16T02:30:29.859 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-16T02:30:29.860 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-16T02:30:29.911 DEBUG:teuthology.orchestra.run.smithi204:> mktemp -d --suffix=xfstests-dev 2023-11-16T02:30:29.962 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.aa1AheDDlixfstests-dev 2023-11-16T02:30:29.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:30:29.963 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.aa1AheDDlixfstests-dev) 2023-11-16T02:30:30.026 INFO:teuthology.orchestra.run.smithi204.stderr:Cloning into '/tmp/tmp.aa1AheDDlixfstests-dev'... 2023-11-16T02:30:30.956 DEBUG:teuthology.orchestra.run.smithi204:> mktemp -d --suffix=xfsprogs-dev 2023-11-16T02:30:31.006 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.ja3gF9tsUCxfsprogs-dev 2023-11-16T02:30:31.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:30:31.007 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfsprogs-dev.git --depth 1 /tmp/tmp.ja3gF9tsUCxfsprogs-dev) 2023-11-16T02:30:31.069 INFO:teuthology.orchestra.run.smithi204.stderr:Cloning into '/tmp/tmp.ja3gF9tsUCxfsprogs-dev'... 2023-11-16T02:30:31.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:30:31.724 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-11-16T02:30:31.794 DEBUG:teuthology.orchestra.run.smithi204:> mktemp -d --suffix=test 2023-11-16T02:30:31.843 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.EmIut5Gdirtest 2023-11-16T02:30:31.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-16T02:30:31.844 DEBUG:teuthology.orchestra.run.smithi204:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-11-16T02:30:31.900 DEBUG:teuthology.orchestra.run.smithi204:> mktemp -d --suffix=scratch 2023-11-16T02:30:31.955 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.IyzH09SmRgscratch 2023-11-16T02:30:31.955 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "22.04". 2023-11-16T02:30:31.955 DEBUG:teuthology.orchestra.run.smithi204:> sudo apt-get install -y xfslibs-dev uuid-dev libtool-bin e2fsprogs automake gcc libuuid1 quota attr libattr1-dev make libacl1-dev libaio-dev xfsprogs libgdbm-dev gawk fio dbench uuid-runtime python2 sqlite3 libinih-dev liburcu-dev libblkid-dev gettext libedit-dev libattr1-dev libdevmapper-dev libicu-dev pkg-config 2023-11-16T02:30:32.077 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2023-11-16T02:30:32.252 INFO:teuthology.orchestra.run.smithi204.stdout:Building dependency tree... 2023-11-16T02:30:32.253 INFO:teuthology.orchestra.run.smithi204.stdout:Reading state information... 2023-11-16T02:30:32.408 INFO:teuthology.orchestra.run.smithi204.stdout:attr is already the newest version (1:2.5.1-1build1). 2023-11-16T02:30:32.408 INFO:teuthology.orchestra.run.smithi204.stdout:automake is already the newest version (1:1.16.5-1.3). 2023-11-16T02:30:32.408 INFO:teuthology.orchestra.run.smithi204.stdout:gcc is already the newest version (4:11.2.0-1ubuntu1). 2023-11-16T02:30:32.408 INFO:teuthology.orchestra.run.smithi204.stdout:gcc set to manually installed. 2023-11-16T02:30:32.408 INFO:teuthology.orchestra.run.smithi204.stdout:gettext is already the newest version (0.21-4ubuntu4). 2023-11-16T02:30:32.409 INFO:teuthology.orchestra.run.smithi204.stdout:libacl1-dev is already the newest version (2.3.1-1). 2023-11-16T02:30:32.409 INFO:teuthology.orchestra.run.smithi204.stdout:libaio-dev is already the newest version (0.3.112-13build1). 2023-11-16T02:30:32.409 INFO:teuthology.orchestra.run.smithi204.stdout:libattr1-dev is already the newest version (1:2.5.1-1build1). 2023-11-16T02:30:32.409 INFO:teuthology.orchestra.run.smithi204.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-16T02:30:32.409 INFO:teuthology.orchestra.run.smithi204.stdout:libuuid1 is already the newest version (2.37.2-4ubuntu3). 2023-11-16T02:30:32.409 INFO:teuthology.orchestra.run.smithi204.stdout:make is already the newest version (4.3-4.1build1). 2023-11-16T02:30:32.409 INFO:teuthology.orchestra.run.smithi204.stdout:make set to manually installed. 2023-11-16T02:30:32.409 INFO:teuthology.orchestra.run.smithi204.stdout:quota is already the newest version (4.06-1build2). 2023-11-16T02:30:32.409 INFO:teuthology.orchestra.run.smithi204.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-16T02:30:32.409 INFO:teuthology.orchestra.run.smithi204.stdout:uuid-runtime is already the newest version (2.37.2-4ubuntu3). 2023-11-16T02:30:32.409 INFO:teuthology.orchestra.run.smithi204.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-16T02:30:32.410 INFO:teuthology.orchestra.run.smithi204.stdout:xfsprogs is already the newest version (5.13.0-1ubuntu2). 2023-11-16T02:30:32.410 INFO:teuthology.orchestra.run.smithi204.stdout:dbench is already the newest version (4.0-2build1). 2023-11-16T02:30:32.410 INFO:teuthology.orchestra.run.smithi204.stdout:python2 is already the newest version (2.7.18-3). 2023-11-16T02:30:32.410 INFO:teuthology.orchestra.run.smithi204.stdout:python2 set to manually installed. 2023-11-16T02:30:32.410 INFO:teuthology.orchestra.run.smithi204.stdout:e2fsprogs is already the newest version (1.46.5-2ubuntu1.1). 2023-11-16T02:30:32.410 INFO:teuthology.orchestra.run.smithi204.stdout:The following packages were automatically installed and are no longer required: 2023-11-16T02:30:32.410 INFO:teuthology.orchestra.run.smithi204.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libiscsi7 libpmemobj1 2023-11-16T02:30:32.410 INFO:teuthology.orchestra.run.smithi204.stdout: libpython2-dev libpython2.7 libpython2.7-dev linux-image-5.4.0-135-generic 2023-11-16T02:30:32.411 INFO:teuthology.orchestra.run.smithi204.stdout: linux-modules-5.4.0-135-generic python2-dev python2.7-dev 2023-11-16T02:30:32.411 INFO:teuthology.orchestra.run.smithi204.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-16T02:30:32.411 INFO:teuthology.orchestra.run.smithi204.stdout:Suggested packages: 2023-11-16T02:30:32.411 INFO:teuthology.orchestra.run.smithi204.stdout: gnuplot gfio python-scipy gawk-doc icu-doc sqlite3-doc systemd-container 2023-11-16T02:30:32.411 INFO:teuthology.orchestra.run.smithi204.stdout: libtss2-esys-3.0.2-0 libtss2-mu0 libtss2-rc0 2023-11-16T02:30:32.457 INFO:teuthology.orchestra.run.smithi204.stdout:The following NEW packages will be installed: 2023-11-16T02:30:32.457 INFO:teuthology.orchestra.run.smithi204.stdout: fio icu-devtools libblkid-dev libbsd-dev libdevmapper-dev libedit-dev 2023-11-16T02:30:32.458 INFO:teuthology.orchestra.run.smithi204.stdout: libgdbm-dev libicu-dev libinih-dev libinireader0 libmd-dev libpcre2-32-0 2023-11-16T02:30:32.458 INFO:teuthology.orchestra.run.smithi204.stdout: libpcre2-dev libpcre2-posix3 libpmemblk1 libselinux1-dev libsepol-dev 2023-11-16T02:30:32.458 INFO:teuthology.orchestra.run.smithi204.stdout: libudev-dev liburcu-dev pkg-config sqlite3 2023-11-16T02:30:32.458 INFO:teuthology.orchestra.run.smithi204.stdout:The following packages will be upgraded: 2023-11-16T02:30:32.460 INFO:teuthology.orchestra.run.smithi204.stdout: gawk libnss-systemd libpam-systemd libsystemd0 libudev1 systemd systemd-sysv 2023-11-16T02:30:32.460 INFO:teuthology.orchestra.run.smithi204.stdout: udev 2023-11-16T02:30:32.519 INFO:teuthology.orchestra.run.smithi204.stdout:8 upgraded, 21 newly installed, 0 to remove and 254 not upgraded. 2023-11-16T02:30:32.520 INFO:teuthology.orchestra.run.smithi204.stdout:Need to get 26.4 MB of archives. 2023-11-16T02:30:32.520 INFO:teuthology.orchestra.run.smithi204.stdout:After this operation, 67.5 MB of additional disk space will be used. 2023-11-16T02:30:32.520 INFO:teuthology.orchestra.run.smithi204.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libsystemd0 amd64 249.11-0ubuntu3.11 [318 kB] 2023-11-16T02:30:32.639 INFO:teuthology.orchestra.run.smithi204.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 systemd-sysv amd64 249.11-0ubuntu3.11 [10.5 kB] 2023-11-16T02:30:32.639 INFO:teuthology.orchestra.run.smithi204.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnss-systemd amd64 249.11-0ubuntu3.11 [133 kB] 2023-11-16T02:30:32.645 INFO:teuthology.orchestra.run.smithi204.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpam-systemd amd64 249.11-0ubuntu3.11 [203 kB] 2023-11-16T02:30:32.658 INFO:teuthology.orchestra.run.smithi204.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 systemd amd64 249.11-0ubuntu3.11 [4,581 kB] 2023-11-16T02:30:32.732 INFO:teuthology.orchestra.run.smithi204.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 udev amd64 249.11-0ubuntu3.11 [1,557 kB] 2023-11-16T02:30:32.747 INFO:teuthology.orchestra.run.smithi204.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libudev1 amd64 249.11-0ubuntu3.11 [78.0 kB] 2023-11-16T02:30:32.748 INFO:teuthology.orchestra.run.smithi204.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 gawk amd64 1:5.1.0-1ubuntu0.1 [447 kB] 2023-11-16T02:30:32.752 INFO:teuthology.orchestra.run.smithi204.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libpmemblk1 amd64 1.11.1-3build1 [65.6 kB] 2023-11-16T02:30:32.753 INFO:teuthology.orchestra.run.smithi204.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 fio amd64 3.28-1 [4,047 kB] 2023-11-16T02:30:32.789 INFO:teuthology.orchestra.run.smithi204.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 icu-devtools amd64 70.1-2 [197 kB] 2023-11-16T02:30:32.791 INFO:teuthology.orchestra.run.smithi204.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libmd-dev amd64 1.0.4-1build1 [40.0 kB] 2023-11-16T02:30:32.792 INFO:teuthology.orchestra.run.smithi204.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbsd-dev amd64 0.11.5-1 [168 kB] 2023-11-16T02:30:32.794 INFO:teuthology.orchestra.run.smithi204.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libudev-dev amd64 249.11-0ubuntu3.11 [20.7 kB] 2023-11-16T02:30:32.794 INFO:teuthology.orchestra.run.smithi204.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libsepol-dev amd64 3.3-1build1 [378 kB] 2023-11-16T02:30:32.798 INFO:teuthology.orchestra.run.smithi204.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-32-0 amd64 10.39-3ubuntu0.1 [194 kB] 2023-11-16T02:30:32.800 INFO:teuthology.orchestra.run.smithi204.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-posix3 amd64 10.39-3ubuntu0.1 [6,130 B] 2023-11-16T02:30:32.800 INFO:teuthology.orchestra.run.smithi204.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-dev amd64 10.39-3ubuntu0.1 [730 kB] 2023-11-16T02:30:32.807 INFO:teuthology.orchestra.run.smithi204.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 libselinux1-dev amd64 3.3-1build2 [158 kB] 2023-11-16T02:30:32.813 INFO:teuthology.orchestra.run.smithi204.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libdevmapper-dev amd64 2:1.02.175-2.1ubuntu4 [36.6 kB] 2023-11-16T02:30:32.813 INFO:teuthology.orchestra.run.smithi204.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 libedit-dev amd64 3.1-20210910-1build1 [118 kB] 2023-11-16T02:30:32.832 INFO:teuthology.orchestra.run.smithi204.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgdbm-dev amd64 1.23-1 [117 kB] 2023-11-16T02:30:32.834 INFO:teuthology.orchestra.run.smithi204.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libicu-dev amd64 70.1-2 [11.6 MB] 2023-11-16T02:30:32.942 INFO:teuthology.orchestra.run.smithi204.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 libinireader0 amd64 53-1ubuntu3 [9,636 B] 2023-11-16T02:30:32.942 INFO:teuthology.orchestra.run.smithi204.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libinih-dev amd64 53-1ubuntu3 [20.6 kB] 2023-11-16T02:30:32.942 INFO:teuthology.orchestra.run.smithi204.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-11-16T02:30:32.943 INFO:teuthology.orchestra.run.smithi204.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.1 [768 kB] 2023-11-16T02:30:32.950 INFO:teuthology.orchestra.run.smithi204.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 libblkid-dev amd64 2.37.2-4ubuntu3 [185 kB] 2023-11-16T02:30:32.952 INFO:teuthology.orchestra.run.smithi204.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 liburcu-dev amd64 0.13.1-1 [125 kB] 2023-11-16T02:30:33.203 INFO:teuthology.orchestra.run.smithi204.stderr:debconf: unable to initialize frontend: Dialog 2023-11-16T02:30:33.203 INFO:teuthology.orchestra.run.smithi204.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-11-16T02:30:33.203 INFO:teuthology.orchestra.run.smithi204.stderr:debconf: falling back to frontend: Readline 2023-11-16T02:30:33.224 INFO:teuthology.orchestra.run.smithi204.stderr:debconf: unable to initialize frontend: Readline 2023-11-16T02:30:33.224 INFO:teuthology.orchestra.run.smithi204.stderr:debconf: (This frontend requires a controlling tty.) 2023-11-16T02:30:33.224 INFO:teuthology.orchestra.run.smithi204.stderr:debconf: falling back to frontend: Teletype 2023-11-16T02:30:33.231 INFO:teuthology.orchestra.run.smithi204.stderr:dpkg-preconfigure: unable to re-open stdin: 2023-11-16T02:30:33.268 INFO:teuthology.orchestra.run.smithi204.stdout:Fetched 26.4 MB in 0s (54.2 MB/s) 2023-11-16T02:30:33.519 INFO:teuthology.orchestra.run.smithi204.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 142648 files and directories currently installed.) 2023-11-16T02:30:33.523 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../libsystemd0_249.11-0ubuntu3.11_amd64.deb ... 2023-11-16T02:30:33.694 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libsystemd0:amd64 (249.11-0ubuntu3.11) over (249.11-0ubuntu3.6) ... 2023-11-16T02:30:34.067 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libsystemd0:amd64 (249.11-0ubuntu3.11) ... 2023-11-16T02:30:34.501 INFO:teuthology.orchestra.run.smithi204.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 142648 files and directories currently installed.) 2023-11-16T02:30:34.505 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../0-systemd-sysv_249.11-0ubuntu3.11_amd64.deb ... 2023-11-16T02:30:34.726 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking systemd-sysv (249.11-0ubuntu3.11) over (249.11-0ubuntu3.6) ... 2023-11-16T02:30:34.736 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:30:34.741 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:30:34.744 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:30:35.265 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../1-libnss-systemd_249.11-0ubuntu3.11_amd64.deb ... 2023-11-16T02:30:35.408 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libnss-systemd:amd64 (249.11-0ubuntu3.11) over (249.11-0ubuntu3.6) ... 2023-11-16T02:30:35.828 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../2-libpam-systemd_249.11-0ubuntu3.11_amd64.deb ... 2023-11-16T02:30:35.955 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libpam-systemd:amd64 (249.11-0ubuntu3.11) over (249.11-0ubuntu3.6) ... 2023-11-16T02:30:36.425 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../3-systemd_249.11-0ubuntu3.11_amd64.deb ... 2023-11-16T02:30:36.608 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking systemd (249.11-0ubuntu3.11) over (249.11-0ubuntu3.6) ... 2023-11-16T02:30:37.748 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../4-udev_249.11-0ubuntu3.11_amd64.deb ... 2023-11-16T02:30:37.927 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking udev (249.11-0ubuntu3.11) over (249.11-0ubuntu3.6) ... 2023-11-16T02:30:38.510 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../5-libudev1_249.11-0ubuntu3.11_amd64.deb ... 2023-11-16T02:30:38.670 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libudev1:amd64 (249.11-0ubuntu3.11) over (249.11-0ubuntu3.6) ... 2023-11-16T02:30:38.995 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libudev1:amd64 (249.11-0ubuntu3.11) ... 2023-11-16T02:30:39.475 INFO:teuthology.orchestra.run.smithi204.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 142648 files and directories currently installed.) 2023-11-16T02:30:39.479 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../00-gawk_1%3a5.1.0-1ubuntu0.1_amd64.deb ... 2023-11-16T02:30:39.661 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking gawk (1:5.1.0-1ubuntu0.1) over (1:5.1.0-1build3) ... 2023-11-16T02:30:40.147 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libpmemblk1:amd64. 2023-11-16T02:30:40.163 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../01-libpmemblk1_1.11.1-3build1_amd64.deb ... 2023-11-16T02:30:40.206 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libpmemblk1:amd64 (1.11.1-3build1) ... 2023-11-16T02:30:40.484 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package fio. 2023-11-16T02:30:40.500 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../02-fio_3.28-1_amd64.deb ... 2023-11-16T02:30:40.567 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking fio (3.28-1) ... 2023-11-16T02:30:41.006 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package icu-devtools. 2023-11-16T02:30:41.020 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../03-icu-devtools_70.1-2_amd64.deb ... 2023-11-16T02:30:41.081 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking icu-devtools (70.1-2) ... 2023-11-16T02:30:41.343 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libmd-dev:amd64. 2023-11-16T02:30:41.358 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../04-libmd-dev_1.0.4-1build1_amd64.deb ... 2023-11-16T02:30:41.393 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libmd-dev:amd64 (1.0.4-1build1) ... 2023-11-16T02:30:41.691 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libbsd-dev:amd64. 2023-11-16T02:30:41.706 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../05-libbsd-dev_0.11.5-1_amd64.deb ... 2023-11-16T02:30:41.749 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libbsd-dev:amd64 (0.11.5-1) ... 2023-11-16T02:30:42.080 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libudev-dev:amd64. 2023-11-16T02:30:42.095 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../06-libudev-dev_249.11-0ubuntu3.11_amd64.deb ... 2023-11-16T02:30:42.130 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libudev-dev:amd64 (249.11-0ubuntu3.11) ... 2023-11-16T02:30:42.393 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libsepol-dev:amd64. 2023-11-16T02:30:42.408 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../07-libsepol-dev_3.3-1build1_amd64.deb ... 2023-11-16T02:30:42.443 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libsepol-dev:amd64 (3.3-1build1) ... 2023-11-16T02:30:42.813 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libpcre2-32-0:amd64. 2023-11-16T02:30:42.828 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../08-libpcre2-32-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-16T02:30:42.872 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libpcre2-32-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-16T02:30:43.242 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libpcre2-posix3:amd64. 2023-11-16T02:30:43.257 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../09-libpcre2-posix3_10.39-3ubuntu0.1_amd64.deb ... 2023-11-16T02:30:43.300 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libpcre2-posix3:amd64 (10.39-3ubuntu0.1) ... 2023-11-16T02:30:43.577 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libpcre2-dev:amd64. 2023-11-16T02:30:43.592 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../10-libpcre2-dev_10.39-3ubuntu0.1_amd64.deb ... 2023-11-16T02:30:43.636 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libpcre2-dev:amd64 (10.39-3ubuntu0.1) ... 2023-11-16T02:30:43.941 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libselinux1-dev:amd64. 2023-11-16T02:30:43.958 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../11-libselinux1-dev_3.3-1build2_amd64.deb ... 2023-11-16T02:30:44.000 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libselinux1-dev:amd64 (3.3-1build2) ... 2023-11-16T02:30:44.314 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libdevmapper-dev:amd64. 2023-11-16T02:30:44.329 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../12-libdevmapper-dev_2%3a1.02.175-2.1ubuntu4_amd64.deb ... 2023-11-16T02:30:44.417 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libdevmapper-dev:amd64 (2:1.02.175-2.1ubuntu4) ... 2023-11-16T02:30:44.659 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libedit-dev:amd64. 2023-11-16T02:30:44.674 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../13-libedit-dev_3.1-20210910-1build1_amd64.deb ... 2023-11-16T02:30:44.709 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libedit-dev:amd64 (3.1-20210910-1build1) ... 2023-11-16T02:30:45.005 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2023-11-16T02:30:45.021 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../14-libgdbm-dev_1.23-1_amd64.deb ... 2023-11-16T02:30:45.063 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libgdbm-dev:amd64 (1.23-1) ... 2023-11-16T02:30:45.394 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libicu-dev:amd64. 2023-11-16T02:30:45.408 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../15-libicu-dev_70.1-2_amd64.deb ... 2023-11-16T02:30:45.450 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libicu-dev:amd64 (70.1-2) ... 2023-11-16T02:30:46.646 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libinireader0:amd64. 2023-11-16T02:30:46.662 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../16-libinireader0_53-1ubuntu3_amd64.deb ... 2023-11-16T02:30:46.704 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libinireader0:amd64 (53-1ubuntu3) ... 2023-11-16T02:30:46.956 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libinih-dev:amd64. 2023-11-16T02:30:46.973 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../17-libinih-dev_53-1ubuntu3_amd64.deb ... 2023-11-16T02:30:47.006 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libinih-dev:amd64 (53-1ubuntu3) ... 2023-11-16T02:30:47.343 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package pkg-config. 2023-11-16T02:30:47.359 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../18-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-11-16T02:30:47.418 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-11-16T02:30:47.654 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package sqlite3. 2023-11-16T02:30:47.670 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../19-sqlite3_3.37.2-2ubuntu0.1_amd64.deb ... 2023-11-16T02:30:47.713 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.1) ... 2023-11-16T02:30:48.015 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libblkid-dev:amd64. 2023-11-16T02:30:48.031 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../20-libblkid-dev_2.37.2-4ubuntu3_amd64.deb ... 2023-11-16T02:30:48.074 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libblkid-dev:amd64 (2.37.2-4ubuntu3) ... 2023-11-16T02:30:48.351 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package liburcu-dev:amd64. 2023-11-16T02:30:48.367 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../21-liburcu-dev_0.13.1-1_amd64.deb ... 2023-11-16T02:30:48.410 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking liburcu-dev:amd64 (0.13.1-1) ... 2023-11-16T02:30:48.768 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up liburcu-dev:amd64 (0.13.1-1) ... 2023-11-16T02:30:48.907 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libblkid-dev:amd64 (2.37.2-4ubuntu3) ... 2023-11-16T02:30:49.025 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libinireader0:amd64 (53-1ubuntu3) ... 2023-11-16T02:30:49.168 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up gawk (1:5.1.0-1ubuntu0.1) ... 2023-11-16T02:30:49.453 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up systemd (249.11-0ubuntu3.11) ... 2023-11-16T02:30:51.144 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libpcre2-32-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-16T02:30:51.295 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up udev (249.11-0ubuntu3.11) ... 2023-11-16T02:30:52.781 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up icu-devtools (70.1-2) ... 2023-11-16T02:30:52.882 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-11-16T02:30:53.109 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libudev-dev:amd64 (249.11-0ubuntu3.11) ... 2023-11-16T02:30:53.260 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libsepol-dev:amd64 (3.3-1build1) ... 2023-11-16T02:30:53.386 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libpmemblk1:amd64 (1.11.1-3build1) ... 2023-11-16T02:30:53.512 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libinih-dev:amd64 (53-1ubuntu3) ... 2023-11-16T02:30:53.672 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libpcre2-posix3:amd64 (10.39-3ubuntu0.1) ... 2023-11-16T02:30:53.798 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libmd-dev:amd64 (1.0.4-1build1) ... 2023-11-16T02:30:53.907 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libgdbm-dev:amd64 (1.23-1) ... 2023-11-16T02:30:54.008 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libicu-dev:amd64 (70.1-2) ... 2023-11-16T02:30:54.168 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libbsd-dev:amd64 (0.11.5-1) ... 2023-11-16T02:30:54.294 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.1) ... 2023-11-16T02:30:54.420 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up systemd-sysv (249.11-0ubuntu3.11) ... 2023-11-16T02:30:54.546 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libpcre2-dev:amd64 (10.39-3ubuntu0.1) ... 2023-11-16T02:30:54.697 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libselinux1-dev:amd64 (3.3-1build2) ... 2023-11-16T02:30:54.822 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libnss-systemd:amd64 (249.11-0ubuntu3.11) ... 2023-11-16T02:30:54.948 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up fio (3.28-1) ... 2023-11-16T02:30:55.567 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libedit-dev:amd64 (3.1-20210910-1build1) ... 2023-11-16T02:30:55.693 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libdevmapper-dev:amd64 (2:1.02.175-2.1ubuntu4) ... 2023-11-16T02:30:55.794 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libpam-systemd:amd64 (249.11-0ubuntu3.11) ... 2023-11-16T02:30:55.992 INFO:teuthology.orchestra.run.smithi204.stdout:debconf: unable to initialize frontend: Dialog 2023-11-16T02:30:55.992 INFO:teuthology.orchestra.run.smithi204.stdout:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-11-16T02:30:55.992 INFO:teuthology.orchestra.run.smithi204.stdout:debconf: falling back to frontend: Readline 2023-11-16T02:30:56.289 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for initramfs-tools (0.140ubuntu13.1) ... 2023-11-16T02:30:56.377 INFO:teuthology.orchestra.run.smithi204.stdout:update-initramfs: Generating /boot/initrd.img-6.6.0-rc5-g3b796cfe2969 2023-11-16T02:31:04.862 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:31:04.865 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:31:04.868 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:31:10.912 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-16T02:31:11.063 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-16T02:31:12.560 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-16T02:31:12.653 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-16T02:31:13.210 DEBUG:teuthology.orchestra.run.smithi204:> sudo useradd -m fsgqa 2023-11-16T02:31:13.229 INFO:teuthology.orchestra.run.smithi204.stderr:useradd: user 'fsgqa' already exists 2023-11-16T02:31:13.232 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-11-16T02:31:13.232 DEBUG:teuthology.orchestra.run.smithi204:> sudo groupadd fsgqa 2023-11-16T02:31:13.292 INFO:teuthology.orchestra.run.smithi204.stderr:groupadd: group 'fsgqa' already exists 2023-11-16T02:31:13.294 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-11-16T02:31:13.294 DEBUG:teuthology.orchestra.run.smithi204:> sudo useradd fsgqa2 2023-11-16T02:31:13.760 DEBUG:teuthology.orchestra.run.smithi204:> sudo useradd 123456-fsgqa 2023-11-16T02:31:14.155 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-11-16T02:31:14.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb91a2e0640 1 Processor -- start 2023-11-16T02:31:14.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb91a2e0640 1 -- start start 2023-11-16T02:31:14.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb91a2e0640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fb914070140 0x7fb914071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:31:14.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb91a2e0640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9140b32c0 0x7fb9141428e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:31:14.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb91a2e0640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9140708f0 con 0x7fb914071bd0 2023-11-16T02:31:14.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb91a2e0640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9140b2af0 con 0x7fb914070140 2023-11-16T02:31:14.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb91a2e0640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb914070bb0 con 0x7fb9140b32c0 2023-11-16T02:31:14.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb9137fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fb914071bd0 0x7fb9140b8a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:50524/0 (socket says 172.21.15.28:50524) 2023-11-16T02:31:14.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb9137fe640 1 -- 172.21.15.28:0/2725326836 learned_addr learned my addr 172.21.15.28:0/2725326836 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:31:14.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb913fff640 1 --2- 172.21.15.28:0/2725326836 >> v2:172.21.15.70:3300/0 conn(0x7fb914070140 0x7fb914071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:31:14.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb91887d640 1 --2- 172.21.15.28:0/2725326836 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9140b32c0 0x7fb9141428e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:31:14.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb912ffd640 1 -- 172.21.15.28:0/2725326836 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421844829 0 0) 0x7fb9140708f0 con 0x7fb914071bd0 2023-11-16T02:31:14.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb912ffd640 1 -- 172.21.15.28:0/2725326836 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8fc003530 con 0x7fb914071bd0 2023-11-16T02:31:14.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb912ffd640 1 -- 172.21.15.28:0/2725326836 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3647764546 0 0) 0x7fb8fc003530 con 0x7fb914071bd0 2023-11-16T02:31:14.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb912ffd640 1 -- 172.21.15.28:0/2725326836 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9140b32c0 msgr2=0x7fb9141428e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:31:14.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb912ffd640 1 --2- 172.21.15.28:0/2725326836 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9140b32c0 0x7fb9141428e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:31:14.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb912ffd640 1 -- 172.21.15.28:0/2725326836 >> v2:172.21.15.70:3300/0 conn(0x7fb914070140 msgr2=0x7fb914071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:31:14.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb912ffd640 1 --2- 172.21.15.28:0/2725326836 >> v2:172.21.15.70:3300/0 conn(0x7fb914070140 0x7fb914071690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:31:14.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb912ffd640 1 -- 172.21.15.28:0/2725326836 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb914070e90 con 0x7fb914071bd0 2023-11-16T02:31:14.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb912ffd640 1 -- 172.21.15.28:0/2725326836 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7fb908001680 con 0x7fb914071bd0 2023-11-16T02:31:14.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb912ffd640 1 -- 172.21.15.28:0/2725326836 >> v1:172.21.15.28:6789/0 conn(0x7fb914071bd0 legacy=0x7fb9140b8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:31:14.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb912ffd640 1 --2- 172.21.15.28:0/2725326836 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9140b32c0 0x7fb8fc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:31:14.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb912ffd640 1 --2- 172.21.15.28:0/2725326836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8fc003f50 0x7fb8fc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:31:14.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb912ffd640 1 --2- 172.21.15.28:0/2725326836 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8fc004d10 0x7fb8fc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:31:14.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb912ffd640 1 -- 172.21.15.28:0/2725326836 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9140b2af0 con 0x7fb8fc004d10 2023-11-16T02:31:14.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb912ffd640 1 -- 172.21.15.28:0/2725326836 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb914070bb0 con 0x7fb8fc003f50 2023-11-16T02:31:14.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb912ffd640 1 -- 172.21.15.28:0/2725326836 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc00ba40 con 0x7fb9140b32c0 2023-11-16T02:31:14.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb91887d640 1 --2- 172.21.15.28:0/2725326836 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8fc004d10 0x7fb8fc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:31:14.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb9137fe640 1 --2- 172.21.15.28:0/2725326836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8fc003f50 0x7fb8fc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:31:14.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb913fff640 1 --2- 172.21.15.28:0/2725326836 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9140b32c0 0x7fb8fc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:31:14.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb91887d640 1 -- 172.21.15.28:0/2725326836 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9140b32c0 msgr2=0x7fb8fc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:31:14.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb91887d640 1 --2- 172.21.15.28:0/2725326836 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9140b32c0 0x7fb8fc003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:31:14.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb91887d640 1 -- 172.21.15.28:0/2725326836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8fc003f50 msgr2=0x7fb8fc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:31:14.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb91887d640 1 --2- 172.21.15.28:0/2725326836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8fc003f50 0x7fb8fc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:31:14.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.285+0000 7fb91887d640 1 -- 172.21.15.28:0/2725326836 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8fc003530 con 0x7fb8fc004d10 2023-11-16T02:31:14.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.289+0000 7fb91887d640 1 --2- 172.21.15.28:0/2725326836 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8fc004d10 0x7fb8fc005190 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb90c009f90 tx=0x7fb90c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6becc038d8ce726d server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:31:14.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.289+0000 7fb912ffd640 1 -- 172.21.15.28:0/2725326836 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c0a5c30 con 0x7fb8fc004d10 2023-11-16T02:31:14.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.289+0000 7fb912ffd640 1 -- 172.21.15.28:0/2725326836 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90c00f040 con 0x7fb8fc004d10 2023-11-16T02:31:14.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.289+0000 7fb912ffd640 1 -- 172.21.15.28:0/2725326836 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c0ad440 con 0x7fb8fc004d10 2023-11-16T02:31:14.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.289+0000 7fb91a2e0640 1 -- 172.21.15.28:0/2725326836 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8fc004d10 msgr2=0x7fb8fc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:31:14.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.289+0000 7fb91a2e0640 1 --2- 172.21.15.28:0/2725326836 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8fc004d10 0x7fb8fc005190 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb90c009f90 tx=0x7fb90c01cc20 comp rx=0 tx=0).stop 2023-11-16T02:31:14.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.289+0000 7fb91887d640 1 -- 172.21.15.28:0/2725326836 reap_dead start 2023-11-16T02:31:14.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.289+0000 7fb91a2e0640 1 -- 172.21.15.28:0/2725326836 shutdown_connections 2023-11-16T02:31:14.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.289+0000 7fb91a2e0640 1 -- 172.21.15.28:0/2725326836 >> 172.21.15.28:0/2725326836 conn(0x7fb9140b9b20 msgr2=0x7fb9140b9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:31:14.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.289+0000 7fb91a2e0640 1 -- 172.21.15.28:0/2725326836 shutdown_connections 2023-11-16T02:31:14.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.289+0000 7fb91a2e0640 1 -- 172.21.15.28:0/2725326836 wait complete. 2023-11-16T02:31:14.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.289+0000 7fb91a2e0640 1 Processor -- start 2023-11-16T02:31:14.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.289+0000 7fb91a2e0640 1 -- start start 2023-11-16T02:31:14.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb91a2e0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8fc004d10 0x7fb9140bc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:31:14.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb91a2e0640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9141e3330 0x7fb914148860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:31:14.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb91a2e0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9141e3790 0x7fb9140a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:31:14.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb91a2e0640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9140bcc40 con 0x7fb8fc004d10 2023-11-16T02:31:14.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb91a2e0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91406cb90 con 0x7fb9141e3790 2023-11-16T02:31:14.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb91a2e0640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91406cde0 con 0x7fb9141e3330 2023-11-16T02:31:14.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb913fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8fc004d10 0x7fb9140bc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:31:14.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb913fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8fc004d10 0x7fb9140bc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42374/0 (socket says 172.21.15.28:42374) 2023-11-16T02:31:14.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb913fff640 1 -- 172.21.15.28:0/910696218 learned_addr learned my addr 172.21.15.28:0/910696218 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:31:14.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb9137fe640 1 --2- 172.21.15.28:0/910696218 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9141e3330 0x7fb914148860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:31:14.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb91887d640 1 --2- 172.21.15.28:0/910696218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9141e3790 0x7fb9140a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:31:14.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb913fff640 1 -- 172.21.15.28:0/910696218 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9141e3330 msgr2=0x7fb914148860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:31:14.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb913fff640 1 --2- 172.21.15.28:0/910696218 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9141e3330 0x7fb914148860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:31:14.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb913fff640 1 -- 172.21.15.28:0/910696218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9141e3790 msgr2=0x7fb9140a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:31:14.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb913fff640 1 --2- 172.21.15.28:0/910696218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9141e3790 0x7fb9140a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:31:14.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb913fff640 1 -- 172.21.15.28:0/910696218 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91406d0c0 con 0x7fb8fc004d10 2023-11-16T02:31:14.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb913fff640 1 --2- 172.21.15.28:0/910696218 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8fc004d10 0x7fb9140bc700 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb904011aa0 tx=0x7fb904011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:31:14.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb910ff9640 1 -- 172.21.15.28:0/910696218 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90400fb80 con 0x7fb8fc004d10 2023-11-16T02:31:14.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb910ff9640 1 -- 172.21.15.28:0/910696218 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90400fce0 con 0x7fb8fc004d10 2023-11-16T02:31:14.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb91a2e0640 1 -- 172.21.15.28:0/910696218 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb91406d3a0 con 0x7fb8fc004d10 2023-11-16T02:31:14.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb910ff9640 1 -- 172.21.15.28:0/910696218 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb904014680 con 0x7fb8fc004d10 2023-11-16T02:31:14.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb91a2e0640 1 -- 172.21.15.28:0/910696218 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb91406d8c0 con 0x7fb8fc004d10 2023-11-16T02:31:14.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb91a2e0640 1 -- 172.21.15.28:0/910696218 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb914066500 con 0x7fb8fc004d10 2023-11-16T02:31:14.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb910ff9640 1 -- 172.21.15.28:0/910696218 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb90401d400 con 0x7fb8fc004d10 2023-11-16T02:31:14.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb910ff9640 1 --2- 172.21.15.28:0/910696218 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb900065a90 0x7fb900067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:31:14.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb9137fe640 1 --2- 172.21.15.28:0/910696218 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb900065a90 0x7fb900067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:31:14.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.293+0000 7fb910ff9640 1 -- 172.21.15.28:0/910696218 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb904083ac0 con 0x7fb8fc004d10 2023-11-16T02:31:14.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.297+0000 7fb9137fe640 1 --2- 172.21.15.28:0/910696218 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb900065a90 0x7fb900067f50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb9080078f0 tx=0x7fb908009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:31:14.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.301+0000 7fb910ff9640 1 -- 172.21.15.28:0/910696218 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fb904051480 con 0x7fb8fc004d10 2023-11-16T02:31:14.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.513+0000 7fb91a2e0640 1 -- 172.21.15.28:0/910696218 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb9140b9990 con 0x7fb8fc004d10 2023-11-16T02:31:14.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.513+0000 7fb910ff9640 1 -- 172.21.15.28:0/910696218 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1268 (secure 0 0 0) 0x7fb904083e60 con 0x7fb8fc004d10 2023-11-16T02:31:14.521 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:31:14.521 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":1,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","modified":"2023-11-16T02:28:36.164888Z","created":"2023-11-16T02:28:36.164888Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3300","nonce":0},{"type":"v1","addr":"172.21.15.28:6789","nonce":0}]},"addr":"172.21.15.28:6789/0","public_addr":"172.21.15.28:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3301","nonce":0},{"type":"v1","addr":"172.21.15.70:6790","nonce":0}]},"addr":"172.21.15.70:6790/0","public_addr":"172.21.15.70:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-11-16T02:31:14.521 INFO:teuthology.orchestra.run.smithi028.stderr:dumped monmap epoch 1 2023-11-16T02:31:14.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.517+0000 7fb91a2e0640 1 -- 172.21.15.28:0/910696218 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb900065a90 msgr2=0x7fb900067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:31:14.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.517+0000 7fb91a2e0640 1 --2- 172.21.15.28:0/910696218 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb900065a90 0x7fb900067f50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb9080078f0 tx=0x7fb908009040 comp rx=0 tx=0).stop 2023-11-16T02:31:14.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.517+0000 7fb91a2e0640 1 -- 172.21.15.28:0/910696218 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8fc004d10 msgr2=0x7fb9140bc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:31:14.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.517+0000 7fb91a2e0640 1 --2- 172.21.15.28:0/910696218 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8fc004d10 0x7fb9140bc700 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb904011aa0 tx=0x7fb904011f60 comp rx=0 tx=0).stop 2023-11-16T02:31:14.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.517+0000 7fb91a2e0640 1 -- 172.21.15.28:0/910696218 shutdown_connections 2023-11-16T02:31:14.523 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.517+0000 7fb91a2e0640 1 --2- 172.21.15.28:0/910696218 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fb900065a90 0x7fb900067f50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:31:14.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.517+0000 7fb91a2e0640 1 --2- 172.21.15.28:0/910696218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9141e3790 0x7fb9140a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:31:14.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.517+0000 7fb91a2e0640 1 --2- 172.21.15.28:0/910696218 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fb9141e3330 0x7fb914148860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:31:14.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.517+0000 7fb91a2e0640 1 --2- 172.21.15.28:0/910696218 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb8fc004d10 0x7fb9140bc700 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:31:14.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.517+0000 7fb91a2e0640 1 -- 172.21.15.28:0/910696218 >> 172.21.15.28:0/910696218 conn(0x7fb9140b9b20 msgr2=0x7fb9140b8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:31:14.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.517+0000 7fb91a2e0640 1 -- 172.21.15.28:0/910696218 shutdown_connections 2023-11-16T02:31:14.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.517+0000 7fb91a2e0640 1 -- 172.21.15.28:0/910696218 wait complete. 2023-11-16T02:31:14.540 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-11-16T02:31:14.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6fd8eb640 1 Processor -- start 2023-11-16T02:31:14.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6fd8eb640 1 -- start start 2023-11-16T02:31:14.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6fd8eb640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7fa6f80b2a00 0x7fa6f81489e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:31:14.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6fd8eb640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f8148f20 con 0x7fa6f80b38f0 2023-11-16T02:31:14.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6fd8eb640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f806a880 con 0x7fa6f80b6020 2023-11-16T02:31:14.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6fd8eb640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f80b3e10 con 0x7fa6f80b2a00 2023-11-16T02:31:14.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6ee7fc640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fa6f80b38f0 0x7fa6f806a170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:50536/0 (socket says 172.21.15.28:50536) 2023-11-16T02:31:14.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6ee7fc640 1 -- 172.21.15.28:0/1427027776 learned_addr learned my addr 172.21.15.28:0/1427027776 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:31:14.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6f6ffd640 1 --2- 172.21.15.28:0/1427027776 >> v2:172.21.15.70:3300/0 conn(0x7fa6f80b2a00 0x7fa6f81489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:31:14.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6f67fc640 1 -- 172.21.15.28:0/1427027776 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106546389 0 0) 0x7fa6f8148f20 con 0x7fa6f80b38f0 2023-11-16T02:31:14.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6f67fc640 1 -- 172.21.15.28:0/1427027776 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6e4003530 con 0x7fa6f80b38f0 2023-11-16T02:31:14.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6f67fc640 1 -- 172.21.15.28:0/1427027776 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3755853566 0 0) 0x7fa6e4003530 con 0x7fa6f80b38f0 2023-11-16T02:31:14.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6f67fc640 1 -- 172.21.15.28:0/1427027776 >> v2:172.21.15.70:3300/0 conn(0x7fa6f80b2a00 msgr2=0x7fa6f81489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:31:14.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6f67fc640 1 --2- 172.21.15.28:0/1427027776 >> v2:172.21.15.70:3300/0 conn(0x7fa6f80b2a00 0x7fa6f81489e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:31:14.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6f67fc640 1 -- 172.21.15.28:0/1427027776 >> v1:172.21.15.70:6789/0 conn(0x7fa6f80b6020 legacy=0x7fa6f81532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:31:14.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6f67fc640 1 -- 172.21.15.28:0/1427027776 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f80b5820 con 0x7fa6f80b38f0 2023-11-16T02:31:14.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6f67fc640 1 -- 172.21.15.28:0/1427027776 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 328783910 0 0) 0x7fa6e8001680 con 0x7fa6f80b38f0 2023-11-16T02:31:14.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6f67fc640 1 -- 172.21.15.28:0/1427027776 >> v1:172.21.15.28:6789/0 conn(0x7fa6f80b38f0 legacy=0x7fa6f806a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:31:14.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6f67fc640 1 --2- 172.21.15.28:0/1427027776 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa6e4003980 0x7fa6e4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:31:14.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6f67fc640 1 --2- 172.21.15.28:0/1427027776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6e40047d0 0x7fa6e4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:31:14.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6f67fc640 1 --2- 172.21.15.28:0/1427027776 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6e4005190 0x7fa6e400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:31:14.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6f67fc640 1 -- 172.21.15.28:0/1427027776 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f80b3e10 con 0x7fa6e4005190 2023-11-16T02:31:14.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6f67fc640 1 -- 172.21.15.28:0/1427027776 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e400c040 con 0x7fa6e40047d0 2023-11-16T02:31:14.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6f67fc640 1 -- 172.21.15.28:0/1427027776 --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e400c200 con 0x7fa6e4003980 2023-11-16T02:31:14.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6f77fe640 1 --2- 172.21.15.28:0/1427027776 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6e4005190 0x7fa6e400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:31:14.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6ee7fc640 1 --2- 172.21.15.28:0/1427027776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6e40047d0 0x7fa6e4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:31:14.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6f6ffd640 1 --2- 172.21.15.28:0/1427027776 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa6e4003980 0x7fa6e4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:31:14.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6f77fe640 1 -- 172.21.15.28:0/1427027776 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa6e4003980 msgr2=0x7fa6e4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:31:14.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6f77fe640 1 --2- 172.21.15.28:0/1427027776 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa6e4003980 0x7fa6e4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:31:14.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6f77fe640 1 -- 172.21.15.28:0/1427027776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6e40047d0 msgr2=0x7fa6e4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:31:14.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6f77fe640 1 --2- 172.21.15.28:0/1427027776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6e40047d0 0x7fa6e4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:31:14.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6f77fe640 1 -- 172.21.15.28:0/1427027776 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e4003530 con 0x7fa6e4005190 2023-11-16T02:31:14.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.657+0000 7fa6ee7fc640 1 --2- 172.21.15.28:0/1427027776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6e40047d0 0x7fa6e4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-16T02:31:14.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.661+0000 7fa6f77fe640 1 -- 172.21.15.28:0/1427027776 reap_dead start 2023-11-16T02:31:14.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.661+0000 7fa6f77fe640 1 --2- 172.21.15.28:0/1427027776 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6e4005190 0x7fa6e400b990 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0001e70 tx=0x7fa6f001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ab9f5d042bfe01 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:31:14.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.661+0000 7fa6f67fc640 1 -- 172.21.15.28:0/1427027776 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0003b80 con 0x7fa6e4005190 2023-11-16T02:31:14.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.661+0000 7fa6f67fc640 1 -- 172.21.15.28:0/1427027776 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f0003d00 con 0x7fa6e4005190 2023-11-16T02:31:14.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.661+0000 7fa6f67fc640 1 -- 172.21.15.28:0/1427027776 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f0005260 con 0x7fa6e4005190 2023-11-16T02:31:14.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.661+0000 7fa6fd8eb640 1 -- 172.21.15.28:0/1427027776 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6e4005190 msgr2=0x7fa6e400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:31:14.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.661+0000 7fa6fd8eb640 1 --2- 172.21.15.28:0/1427027776 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6e4005190 0x7fa6e400b990 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0001e70 tx=0x7fa6f001c760 comp rx=0 tx=0).stop 2023-11-16T02:31:14.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.661+0000 7fa6fd8eb640 1 -- 172.21.15.28:0/1427027776 shutdown_connections 2023-11-16T02:31:14.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.661+0000 7fa6fd8eb640 1 --2- 172.21.15.28:0/1427027776 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6e4005190 0x7fa6e400b990 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:31:14.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.661+0000 7fa6fd8eb640 1 -- 172.21.15.28:0/1427027776 >> 172.21.15.28:0/1427027776 conn(0x7fa6f80bc3e0 msgr2=0x7fa6f80bc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:31:14.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.661+0000 7fa6fd8eb640 1 -- 172.21.15.28:0/1427027776 shutdown_connections 2023-11-16T02:31:14.669 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.661+0000 7fa6fd8eb640 1 -- 172.21.15.28:0/1427027776 wait complete. 2023-11-16T02:31:14.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.665+0000 7fa6fd8eb640 1 Processor -- start 2023-11-16T02:31:14.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.665+0000 7fa6fd8eb640 1 -- start start 2023-11-16T02:31:14.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.665+0000 7fa6fd8eb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6e4005190 0x7fa6f80b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:31:14.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.665+0000 7fa6fd8eb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6f81436b0 0x7fa6f81e1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:31:14.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.665+0000 7fa6fd8eb640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa6f81456b0 0x7fa6f80b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:31:14.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.665+0000 7fa6fd8eb640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f80b24f0 con 0x7fa6f81436b0 2023-11-16T02:31:14.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.665+0000 7fa6fd8eb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f8144f40 con 0x7fa6e4005190 2023-11-16T02:31:14.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.665+0000 7fa6fd8eb640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f8145220 con 0x7fa6f81456b0 2023-11-16T02:31:14.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.665+0000 7fa6ee7fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6f81436b0 0x7fa6f81e1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:31:14.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.665+0000 7fa6ee7fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6f81436b0 0x7fa6f81e1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42398/0 (socket says 172.21.15.28:42398) 2023-11-16T02:31:14.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.665+0000 7fa6ee7fc640 1 -- 172.21.15.28:0/4003805806 learned_addr learned my addr 172.21.15.28:0/4003805806 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:31:14.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.665+0000 7fa6f6ffd640 1 --2- 172.21.15.28:0/4003805806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6e4005190 0x7fa6f80b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:31:14.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.665+0000 7fa6f77fe640 1 --2- 172.21.15.28:0/4003805806 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa6f81456b0 0x7fa6f80b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:31:14.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.665+0000 7fa6ee7fc640 1 -- 172.21.15.28:0/4003805806 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa6f81456b0 msgr2=0x7fa6f80b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:31:14.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.665+0000 7fa6ee7fc640 1 --2- 172.21.15.28:0/4003805806 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa6f81456b0 0x7fa6f80b0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:31:14.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.665+0000 7fa6ee7fc640 1 -- 172.21.15.28:0/4003805806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6e4005190 msgr2=0x7fa6f80b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:31:14.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.665+0000 7fa6ee7fc640 1 --2- 172.21.15.28:0/4003805806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6e4005190 0x7fa6f80b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:31:14.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.665+0000 7fa6ee7fc640 1 -- 172.21.15.28:0/4003805806 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f80a7a60 con 0x7fa6f81436b0 2023-11-16T02:31:14.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.665+0000 7fa6ee7fc640 1 --2- 172.21.15.28:0/4003805806 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6f81436b0 0x7fa6f81e1050 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa6e800e7a0 tx=0x7fa6e800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:31:14.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.665+0000 7fa6f4ff9640 1 -- 172.21.15.28:0/4003805806 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e800eeb0 con 0x7fa6f81436b0 2023-11-16T02:31:14.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.665+0000 7fa6f4ff9640 1 -- 172.21.15.28:0/4003805806 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e800c870 con 0x7fa6f81436b0 2023-11-16T02:31:14.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.665+0000 7fa6fd8eb640 1 -- 172.21.15.28:0/4003805806 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f81e1590 con 0x7fa6f81436b0 2023-11-16T02:31:14.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.665+0000 7fa6f4ff9640 1 -- 172.21.15.28:0/4003805806 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e800cbe0 con 0x7fa6f81436b0 2023-11-16T02:31:14.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.665+0000 7fa6fd8eb640 1 -- 172.21.15.28:0/4003805806 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f8143eb0 con 0x7fa6f81436b0 2023-11-16T02:31:14.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.665+0000 7fa6fd8eb640 1 -- 172.21.15.28:0/4003805806 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f804e8a0 con 0x7fa6f81436b0 2023-11-16T02:31:14.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.665+0000 7fa6f4ff9640 1 -- 172.21.15.28:0/4003805806 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa6e800cd40 con 0x7fa6f81436b0 2023-11-16T02:31:14.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.669+0000 7fa6f4ff9640 1 --2- 172.21.15.28:0/4003805806 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fa6d8065a90 0x7fa6d8067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:31:14.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.669+0000 7fa6f4ff9640 1 -- 172.21.15.28:0/4003805806 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6e8082d30 con 0x7fa6f81436b0 2023-11-16T02:31:14.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.669+0000 7fa6f6ffd640 1 --2- 172.21.15.28:0/4003805806 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fa6d8065a90 0x7fa6d8067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:31:14.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.669+0000 7fa6f6ffd640 1 --2- 172.21.15.28:0/4003805806 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fa6d8065a90 0x7fa6d8067f50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0009910 tx=0x7fa6e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:31:14.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.673+0000 7fa6f4ff9640 1 -- 172.21.15.28:0/4003805806 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7fa6e8054210 con 0x7fa6f81436b0 2023-11-16T02:31:14.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.881+0000 7fa6fd8eb640 1 -- 172.21.15.28:0/4003805806 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7fa6f8145360 con 0x7fa6f81436b0 2023-11-16T02:31:14.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.881+0000 7fa6f4ff9640 1 -- 172.21.15.28:0/4003805806 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v13) v1 ==== 92+0+63 (secure 0 0 0) 0x7fa6e8001520 con 0x7fa6f81436b0 2023-11-16T02:31:14.885 INFO:teuthology.orchestra.run.smithi028.stdout:[client.admin] 2023-11-16T02:31:14.885 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBUflVlX9NKFxAA4p7Zp8Uf7upt8EYYFgRbcg== 2023-11-16T02:31:14.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.881+0000 7fa6fd8eb640 1 -- 172.21.15.28:0/4003805806 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fa6d8065a90 msgr2=0x7fa6d8067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:31:14.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.881+0000 7fa6fd8eb640 1 --2- 172.21.15.28:0/4003805806 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fa6d8065a90 0x7fa6d8067f50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0009910 tx=0x7fa6e0008040 comp rx=0 tx=0).stop 2023-11-16T02:31:14.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.881+0000 7fa6fd8eb640 1 -- 172.21.15.28:0/4003805806 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6f81436b0 msgr2=0x7fa6f81e1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:31:14.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.881+0000 7fa6fd8eb640 1 --2- 172.21.15.28:0/4003805806 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6f81436b0 0x7fa6f81e1050 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa6e800e7a0 tx=0x7fa6e800ec60 comp rx=0 tx=0).stop 2023-11-16T02:31:14.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.881+0000 7fa6fd8eb640 1 -- 172.21.15.28:0/4003805806 shutdown_connections 2023-11-16T02:31:14.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.881+0000 7fa6fd8eb640 1 --2- 172.21.15.28:0/4003805806 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7fa6d8065a90 0x7fa6d8067f50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:31:14.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.881+0000 7fa6fd8eb640 1 --2- 172.21.15.28:0/4003805806 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7fa6f81456b0 0x7fa6f80b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:31:14.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.881+0000 7fa6fd8eb640 1 --2- 172.21.15.28:0/4003805806 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6f81436b0 0x7fa6f81e1050 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:31:14.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.881+0000 7fa6fd8eb640 1 --2- 172.21.15.28:0/4003805806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6e4005190 0x7fa6f80b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:31:14.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.881+0000 7fa6fd8eb640 1 -- 172.21.15.28:0/4003805806 >> 172.21.15.28:0/4003805806 conn(0x7fa6f80bc3e0 msgr2=0x7fa6f80b9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:31:14.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.881+0000 7fa6fd8eb640 1 -- 172.21.15.28:0/4003805806 shutdown_connections 2023-11-16T02:31:14.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:31:14.881+0000 7fa6fd8eb640 1 -- 172.21.15.28:0/4003805806 wait complete. 2023-11-16T02:31:14.906 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-16T02:31:14.906 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/tmp/tmp.aa1AheDDlixfstests-dev/local.config 2023-11-16T02:31:14.927 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.28:6789:/test export TEST_DIR=/tmp/tmp.EmIut5Gdirtest export SCRATCH_DEV=172.21.15.28:6789:/scratch export SCRATCH_MNT=/tmp/tmp.IyzH09SmRgscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQBUflVlX9NKFxAA4p7Zp8Uf7upt8EYYFgRbcg==" 2023-11-16T02:31:14.927 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-16T02:31:14.927 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/tmp/tmp.aa1AheDDlixfstests-dev/ceph.exclude 2023-11-16T02:31:14.991 DEBUG:teuthology.orchestra.run.smithi204:> (cd /tmp/tmp.aa1AheDDlixfstests-dev && exec sudo make) 2023-11-16T02:31:15.063 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize -cfi 2023-11-16T02:31:15.406 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: putting auxiliary files in '.'. 2023-11-16T02:31:15.406 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file './config.guess' 2023-11-16T02:31:15.415 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file './config.sub' 2023-11-16T02:31:15.435 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file './install-sh' 2023-11-16T02:31:15.447 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file './ltmain.sh' 2023-11-16T02:31:15.498 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-11-16T02:31:15.498 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-11-16T02:31:15.518 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-11-16T02:31:15.529 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-11-16T02:31:15.541 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-11-16T02:31:15.550 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-11-16T02:31:15.561 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-11-16T02:31:15.563 INFO:teuthology.orchestra.run.smithi204.stdout:cp include/install-sh . 2023-11-16T02:31:15.565 INFO:teuthology.orchestra.run.smithi204.stdout:aclocal -I m4 2023-11-16T02:31:16.593 INFO:teuthology.orchestra.run.smithi204.stdout:autoheader 2023-11-16T02:31:16.950 INFO:teuthology.orchestra.run.smithi204.stdout:autoconf 2023-11-16T02:31:17.356 INFO:teuthology.orchestra.run.smithi204.stdout:./configure \ 2023-11-16T02:31:17.356 INFO:teuthology.orchestra.run.smithi204.stdout: --libexecdir=/usr/lib \ 2023-11-16T02:31:17.356 INFO:teuthology.orchestra.run.smithi204.stdout: --exec_prefix=/var/lib 2023-11-16T02:31:17.888 INFO:teuthology.orchestra.run.smithi204.stdout:checking build system type... x86_64-pc-linux-gnu 2023-11-16T02:31:17.888 INFO:teuthology.orchestra.run.smithi204.stdout:checking host system type... x86_64-pc-linux-gnu 2023-11-16T02:31:17.934 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to print strings... printf 2023-11-16T02:31:17.934 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc... gcc 2023-11-16T02:31:18.221 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether the C compiler works... yes 2023-11-16T02:31:18.221 INFO:teuthology.orchestra.run.smithi204.stdout:checking for C compiler default output file name... a.out 2023-11-16T02:31:18.263 INFO:teuthology.orchestra.run.smithi204.stdout:checking for suffix of executables... 2023-11-16T02:31:18.397 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether we are cross compiling... no 2023-11-16T02:31:18.424 INFO:teuthology.orchestra.run.smithi204.stdout:checking for suffix of object files... o 2023-11-16T02:31:18.447 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether the compiler supports GNU C... yes 2023-11-16T02:31:18.470 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether gcc accepts -g... yes 2023-11-16T02:31:18.574 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc option to enable C11 features... none needed 2023-11-16T02:31:18.579 INFO:teuthology.orchestra.run.smithi204.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-11-16T02:31:18.585 INFO:teuthology.orchestra.run.smithi204.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-11-16T02:31:18.587 INFO:teuthology.orchestra.run.smithi204.stdout:checking for egrep... /usr/bin/grep -E 2023-11-16T02:31:18.590 INFO:teuthology.orchestra.run.smithi204.stdout:checking for fgrep... /usr/bin/grep -F 2023-11-16T02:31:18.597 INFO:teuthology.orchestra.run.smithi204.stdout:checking for ld used by gcc... /usr/bin/ld 2023-11-16T02:31:18.602 INFO:teuthology.orchestra.run.smithi204.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-11-16T02:31:18.618 INFO:teuthology.orchestra.run.smithi204.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-11-16T02:31:18.649 INFO:teuthology.orchestra.run.smithi204.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-11-16T02:31:18.649 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether ln -s works... yes 2023-11-16T02:31:18.662 INFO:teuthology.orchestra.run.smithi204.stdout:checking the maximum length of command line arguments... 1572864 2023-11-16T02:31:18.668 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-11-16T02:31:18.669 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-11-16T02:31:18.669 INFO:teuthology.orchestra.run.smithi204.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-11-16T02:31:18.669 INFO:teuthology.orchestra.run.smithi204.stdout:checking for objdump... objdump 2023-11-16T02:31:18.669 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to recognize dependent libraries... pass_all 2023-11-16T02:31:18.670 INFO:teuthology.orchestra.run.smithi204.stdout:checking for dlltool... no 2023-11-16T02:31:18.670 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-11-16T02:31:18.670 INFO:teuthology.orchestra.run.smithi204.stdout:checking for ar... ar 2023-11-16T02:31:18.718 INFO:teuthology.orchestra.run.smithi204.stdout:checking for archiver @FILE support... @ 2023-11-16T02:31:18.718 INFO:teuthology.orchestra.run.smithi204.stdout:checking for strip... strip 2023-11-16T02:31:18.719 INFO:teuthology.orchestra.run.smithi204.stdout:checking for ranlib... ranlib 2023-11-16T02:31:18.719 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gawk... gawk 2023-11-16T02:31:18.808 INFO:teuthology.orchestra.run.smithi204.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-11-16T02:31:18.814 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sysroot... no 2023-11-16T02:31:18.819 INFO:teuthology.orchestra.run.smithi204.stdout:checking for a working dd... /usr/bin/dd 2023-11-16T02:31:18.828 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-11-16T02:31:18.845 INFO:teuthology.orchestra.run.smithi204.stdout:checking for mt... mt 2023-11-16T02:31:18.862 INFO:teuthology.orchestra.run.smithi204.stdout:checking if mt is a manifest tool... no 2023-11-16T02:31:18.896 INFO:teuthology.orchestra.run.smithi204.stdout:checking for stdio.h... yes 2023-11-16T02:31:18.942 INFO:teuthology.orchestra.run.smithi204.stdout:checking for stdlib.h... yes 2023-11-16T02:31:18.976 INFO:teuthology.orchestra.run.smithi204.stdout:checking for string.h... yes 2023-11-16T02:31:19.027 INFO:teuthology.orchestra.run.smithi204.stdout:checking for inttypes.h... yes 2023-11-16T02:31:19.060 INFO:teuthology.orchestra.run.smithi204.stdout:checking for stdint.h... yes 2023-11-16T02:31:19.092 INFO:teuthology.orchestra.run.smithi204.stdout:checking for strings.h... yes 2023-11-16T02:31:19.126 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/stat.h... yes 2023-11-16T02:31:19.160 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/types.h... yes 2023-11-16T02:31:19.213 INFO:teuthology.orchestra.run.smithi204.stdout:checking for unistd.h... yes 2023-11-16T02:31:19.251 INFO:teuthology.orchestra.run.smithi204.stdout:checking for dlfcn.h... yes 2023-11-16T02:31:19.257 INFO:teuthology.orchestra.run.smithi204.stdout:checking for objdir... .libs 2023-11-16T02:31:19.369 INFO:teuthology.orchestra.run.smithi204.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-11-16T02:31:19.369 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-11-16T02:31:19.397 INFO:teuthology.orchestra.run.smithi204.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-11-16T02:31:19.638 INFO:teuthology.orchestra.run.smithi204.stdout:checking if gcc static flag -static works... yes 2023-11-16T02:31:19.679 INFO:teuthology.orchestra.run.smithi204.stdout:checking if gcc supports -c -o file.o... yes 2023-11-16T02:31:19.679 INFO:teuthology.orchestra.run.smithi204.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-11-16T02:31:19.694 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-11-16T02:31:19.730 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether -lc should be explicitly linked in... no 2023-11-16T02:31:19.834 INFO:teuthology.orchestra.run.smithi204.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-11-16T02:31:19.835 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to hardcode library paths into programs... immediate 2023-11-16T02:31:19.846 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether stripping libraries is possible... yes 2023-11-16T02:31:19.846 INFO:teuthology.orchestra.run.smithi204.stdout:checking if libtool supports shared libraries... yes 2023-11-16T02:31:19.846 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether to build shared libraries... yes 2023-11-16T02:31:19.846 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether to build static libraries... yes 2023-11-16T02:31:19.861 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc... (cached) gcc 2023-11-16T02:31:19.904 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-11-16T02:31:19.904 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether gcc accepts -g... (cached) yes 2023-11-16T02:31:19.905 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-11-16T02:31:19.905 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gmake... /usr/bin/gmake 2023-11-16T02:31:19.905 INFO:teuthology.orchestra.run.smithi204.stderr:./configure: line 12753: test: $(SHELL): binary operator expected 2023-11-16T02:31:19.906 INFO:teuthology.orchestra.run.smithi204.stdout:checking for tar... /bin/tar 2023-11-16T02:31:19.907 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gzip... /bin/gzip 2023-11-16T02:31:19.920 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether gcc -MM is supported... yes 2023-11-16T02:31:19.920 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sort... /bin/sort 2023-11-16T02:31:19.920 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether ln -s works... yes 2023-11-16T02:31:19.921 INFO:teuthology.orchestra.run.smithi204.stdout:checking for rpm... no 2023-11-16T02:31:19.958 INFO:teuthology.orchestra.run.smithi204.stdout:checking for assert.h... yes 2023-11-16T02:31:19.999 INFO:teuthology.orchestra.run.smithi204.stdout:checking for bstring.h... no 2023-11-16T02:31:20.038 INFO:teuthology.orchestra.run.smithi204.stdout:checking for libgen.h... yes 2023-11-16T02:31:20.129 INFO:teuthology.orchestra.run.smithi204.stdout:checking for dirent.h... yes 2023-11-16T02:31:20.209 INFO:teuthology.orchestra.run.smithi204.stdout:checking for errno.h... yes 2023-11-16T02:31:20.247 INFO:teuthology.orchestra.run.smithi204.stdout:checking for malloc.h... yes 2023-11-16T02:31:20.288 INFO:teuthology.orchestra.run.smithi204.stdout:checking for uuid.h... no 2023-11-16T02:31:20.342 INFO:teuthology.orchestra.run.smithi204.stdout:checking for uuid/uuid.h... yes 2023-11-16T02:31:20.393 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/uuid.h... no 2023-11-16T02:31:20.433 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/file.h... yes 2023-11-16T02:31:20.472 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/fcntl.h... yes 2023-11-16T02:31:20.513 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/syssgi.h... no 2023-11-16T02:31:20.571 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/param.h... yes 2023-11-16T02:31:20.571 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/stat.h... (cached) yes 2023-11-16T02:31:20.610 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/statvfs.h... yes 2023-11-16T02:31:20.647 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/time.h... yes 2023-11-16T02:31:20.694 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/ioctl.h... yes 2023-11-16T02:31:20.735 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/wait.h... yes 2023-11-16T02:31:20.735 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/types.h... (cached) yes 2023-11-16T02:31:20.735 INFO:teuthology.orchestra.run.smithi204.stdout:checking for strings.h... (cached) yes 2023-11-16T02:31:20.773 INFO:teuthology.orchestra.run.smithi204.stdout:checking for err.h... yes 2023-11-16T02:31:20.812 INFO:teuthology.orchestra.run.smithi204.stdout:checking for linux/falloc.h... yes 2023-11-16T02:31:20.853 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/fs/xfs_fsops.h... no 2023-11-16T02:31:20.895 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/fs/xfs_itable.h... no 2023-11-16T02:31:20.937 INFO:teuthology.orchestra.run.smithi204.stdout:checking for xfs/platform_defs.h... no 2023-11-16T02:31:20.978 INFO:teuthology.orchestra.run.smithi204.stdout:checking for btrfs/ioctl.h... no 2023-11-16T02:31:21.019 INFO:teuthology.orchestra.run.smithi204.stdout:checking for cifs/ioctl.h... no 2023-11-16T02:31:21.059 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/mman.h... yes 2023-11-16T02:31:21.082 INFO:teuthology.orchestra.run.smithi204.stdout:checking for xfs/xfs_log_format.h... no 2023-11-16T02:31:21.140 INFO:teuthology.orchestra.run.smithi204.stdout:checking for uuid_compare... no 2023-11-16T02:31:21.188 INFO:teuthology.orchestra.run.smithi204.stdout:checking for uuid_compare in -luuid... yes 2023-11-16T02:31:21.300 INFO:teuthology.orchestra.run.smithi204.stdout:checking for xfs/xfs.h... yes 2023-11-16T02:31:21.324 INFO:teuthology.orchestra.run.smithi204.stdout:checking for xfs/libxfs.h... no 2023-11-16T02:31:21.372 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2023-11-16T02:31:21.405 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether xlog_assign_lsn is declared... no 2023-11-16T02:31:21.452 INFO:teuthology.orchestra.run.smithi204.stdout:checking for xfs/xqm.h... yes 2023-11-16T02:31:21.526 INFO:teuthology.orchestra.run.smithi204.stdout:checking xfsctl from xfs/xfs.h... ok 2023-11-16T02:31:21.565 INFO:teuthology.orchestra.run.smithi204.stdout:checking for xfs/handle.h... yes 2023-11-16T02:31:21.614 INFO:teuthology.orchestra.run.smithi204.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-11-16T02:31:21.661 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/acl.h... yes 2023-11-16T02:31:21.703 INFO:teuthology.orchestra.run.smithi204.stdout:checking for acl/libacl.h... yes 2023-11-16T02:31:21.753 INFO:teuthology.orchestra.run.smithi204.stdout:checking for acl_init in -lacl... yes 2023-11-16T02:31:21.794 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gdbm-ndbm.h... no 2023-11-16T02:31:21.836 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gdbm/ndbm.h... no 2023-11-16T02:31:21.877 INFO:teuthology.orchestra.run.smithi204.stdout:checking for ndbm.h... no 2023-11-16T02:31:21.918 INFO:teuthology.orchestra.run.smithi204.stdout:checking for libaio.h... yes 2023-11-16T02:31:21.960 INFO:teuthology.orchestra.run.smithi204.stdout:checking for liburing.h... no 2023-11-16T02:31:22.001 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/capability.h... no 2023-11-16T02:31:22.040 INFO:teuthology.orchestra.run.smithi204.stdout:checking for linux/fiemap.h... yes 2023-11-16T02:31:22.090 INFO:teuthology.orchestra.run.smithi204.stdout:checking for fallocate... yes 2023-11-16T02:31:22.143 INFO:teuthology.orchestra.run.smithi204.stdout:checking for open_by_handle_at... yes 2023-11-16T02:31:22.184 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/prctl.h... yes 2023-11-16T02:31:22.223 INFO:teuthology.orchestra.run.smithi204.stdout:checking for linux/fs.h... yes 2023-11-16T02:31:22.265 INFO:teuthology.orchestra.run.smithi204.stdout:checking for btrfsutil.h... no 2023-11-16T02:31:22.321 INFO:teuthology.orchestra.run.smithi204.stdout:checking for copy_file_range... yes 2023-11-16T02:31:22.378 INFO:teuthology.orchestra.run.smithi204.stdout:checking for SEEK_DATA... yes 2023-11-16T02:31:22.454 INFO:teuthology.orchestra.run.smithi204.stdout:checking for BMV_OF_SHARED... yes 2023-11-16T02:31:22.510 INFO:teuthology.orchestra.run.smithi204.stdout:checking for nftw... yes 2023-11-16T02:31:22.564 INFO:teuthology.orchestra.run.smithi204.stdout:checking for RLIMIT_NOFILE... yes 2023-11-16T02:31:22.603 INFO:teuthology.orchestra.run.smithi204.stdout:checking for FIEXCHANGE_RANGE... no 2023-11-16T02:31:22.656 INFO:teuthology.orchestra.run.smithi204.stdout:checking for renameat2... yes 2023-11-16T02:31:22.706 INFO:teuthology.orchestra.run.smithi204.stdout:checking for reallocarray... yes 2023-11-16T02:31:22.757 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct mount_attr... yes 2023-11-16T02:31:22.816 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct btrfs_qgroup_limit... yes 2023-11-16T02:31:22.869 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-11-16T02:31:22.922 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-11-16T02:31:22.975 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-11-16T02:31:23.028 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-11-16T02:31:23.081 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-11-16T02:31:23.134 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-11-16T02:31:23.173 INFO:teuthology.orchestra.run.smithi204.stdout:checking for linux/btrfs.h... yes 2023-11-16T02:31:23.215 INFO:teuthology.orchestra.run.smithi204.stdout:checking for linux/btrfs_tree.h... yes 2023-11-16T02:31:23.242 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-11-16T02:31:23.269 INFO:teuthology.orchestra.run.smithi204.stdout:configure: creating ./config.status 2023-11-16T02:31:24.092 INFO:teuthology.orchestra.run.smithi204.stdout:config.status: creating include/builddefs 2023-11-16T02:31:24.120 INFO:teuthology.orchestra.run.smithi204.stdout:config.status: creating include/config.h 2023-11-16T02:31:24.141 INFO:teuthology.orchestra.run.smithi204.stdout:config.status: executing libtool commands 2023-11-16T02:31:24.211 INFO:teuthology.orchestra.run.smithi204.stdout:Building include 2023-11-16T02:31:24.217 INFO:teuthology.orchestra.run.smithi204.stdout:Building lib 2023-11-16T02:31:24.223 INFO:teuthology.orchestra.run.smithi204.stdout: [LTDEP] 2023-11-16T02:31:24.418 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dataascii.lo 2023-11-16T02:31:24.564 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] databin.lo 2023-11-16T02:31:24.750 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] datapid.lo 2023-11-16T02:31:24.889 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] file_lock.lo 2023-11-16T02:31:25.080 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] forker.lo 2023-11-16T02:31:25.259 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] pattern.lo 2023-11-16T02:31:25.404 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] open_flags.lo 2023-11-16T02:31:25.581 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] random_range.lo 2023-11-16T02:31:25.838 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] string_to_tokens.lo 2023-11-16T02:31:25.966 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] str_to_bytes.lo 2023-11-16T02:31:26.135 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] tlibio.lo 2023-11-16T02:31:26.421 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] write_log.lo 2023-11-16T02:31:26.507 INFO:teuthology.orchestra.run.smithi204.stderr:write_log.c: In function 'wlog_record_write': 2023-11-16T02:31:26.508 INFO:teuthology.orchestra.run.smithi204.stderr:write_log.c:205:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:26.508 INFO:teuthology.orchestra.run.smithi204.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2023-11-16T02:31:26.508 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:26.508 INFO:teuthology.orchestra.run.smithi204.stderr:write_log.c:209:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:26.508 INFO:teuthology.orchestra.run.smithi204.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2023-11-16T02:31:26.508 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:26.711 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] random.lo 2023-11-16T02:31:26.840 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] 2023-11-16T02:31:26.958 INFO:teuthology.orchestra.run.smithi204.stdout:Building ltp 2023-11-16T02:31:26.963 INFO:teuthology.orchestra.run.smithi204.stdout: [DEP] 2023-11-16T02:31:27.155 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] doio 2023-11-16T02:31:34.715 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fsstress 2023-11-16T02:31:34.715 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fsx 2023-11-16T02:31:34.747 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] growfiles 2023-11-16T02:31:34.748 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] iogen 2023-11-16T02:31:34.748 INFO:teuthology.orchestra.run.smithi204.stderr:iogen.c: In function 'main': 2023-11-16T02:31:34.748 INFO:teuthology.orchestra.run.smithi204.stderr:iogen.c:280:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:34.748 INFO:teuthology.orchestra.run.smithi204.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2023-11-16T02:31:34.749 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:34.749 INFO:teuthology.orchestra.run.smithi204.stderr:iogen.c: In function 'parse_cmdline': 2023-11-16T02:31:34.749 INFO:teuthology.orchestra.run.smithi204.stderr:iogen.c:1535:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:34.749 INFO:teuthology.orchestra.run.smithi204.stderr: 1535 | getcwd(fptr->f_path, 2023-11-16T02:31:34.749 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:34.749 INFO:teuthology.orchestra.run.smithi204.stderr: 1536 | sizeof(fptr->f_path)-1); 2023-11-16T02:31:34.749 INFO:teuthology.orchestra.run.smithi204.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:34.749 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-stress 2023-11-16T02:31:34.750 INFO:teuthology.orchestra.run.smithi204.stderr:aio-stress.c: In function 'setup_shared_mem': 2023-11-16T02:31:34.750 INFO:teuthology.orchestra.run.smithi204.stderr:aio-stress.c:1013:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:34.750 INFO:teuthology.orchestra.run.smithi204.stderr: 1013 | ftruncate(fd, total_ram); 2023-11-16T02:31:34.750 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:34.751 INFO:teuthology.orchestra.run.smithi204.stdout:Building src 2023-11-16T02:31:34.751 INFO:teuthology.orchestra.run.smithi204.stdout: [DEP] 2023-11-16T02:31:34.751 INFO:teuthology.orchestra.run.smithi204.stdout: [DEP] 2023-11-16T02:31:34.751 INFO:teuthology.orchestra.run.smithi204.stdout: [DEP] 2023-11-16T02:31:34.751 INFO:teuthology.orchestra.run.smithi204.stdout: [DEP] 2023-11-16T02:31:34.751 INFO:teuthology.orchestra.run.smithi204.stdout: [DEP] 2023-11-16T02:31:34.751 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dirstress 2023-11-16T02:31:34.871 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fill 2023-11-16T02:31:35.008 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:31:35.014 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:31:35.017 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:31:35.064 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fill2 2023-11-16T02:31:35.337 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] getpagesize 2023-11-16T02:31:35.510 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] holes 2023-11-16T02:31:35.749 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] lstat64 2023-11-16T02:31:35.974 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] nametest 2023-11-16T02:31:36.136 INFO:teuthology.orchestra.run.smithi204.stderr:nametest.c: In function 'main': 2023-11-16T02:31:36.137 INFO:teuthology.orchestra.run.smithi204.stderr:nametest.c:236:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:36.137 INFO:teuthology.orchestra.run.smithi204.stderr: 236 | write(1, "\n", 1); 2023-11-16T02:31:36.137 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-16T02:31:36.137 INFO:teuthology.orchestra.run.smithi204.stderr:nametest.c:238:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:36.137 INFO:teuthology.orchestra.run.smithi204.stderr: 238 | write(1, ".", 1); 2023-11-16T02:31:36.137 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-16T02:31:36.137 INFO:teuthology.orchestra.run.smithi204.stderr:nametest.c:288:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:36.137 INFO:teuthology.orchestra.run.smithi204.stderr: 288 | write(1, ".", 1); 2023-11-16T02:31:36.137 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-16T02:31:36.263 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] permname 2023-11-16T02:31:36.506 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] randholes 2023-11-16T02:31:36.800 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] runas 2023-11-16T02:31:37.017 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] truncfile 2023-11-16T02:31:37.241 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] usemem 2023-11-16T02:31:37.431 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] mmapcat 2023-11-16T02:31:37.577 INFO:teuthology.orchestra.run.smithi204.stderr:mmapcat.c: In function 'main': 2023-11-16T02:31:37.577 INFO:teuthology.orchestra.run.smithi204.stderr:mmapcat.c:29:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:37.577 INFO:teuthology.orchestra.run.smithi204.stderr: 29 | write(1,ptr2,ptr - ptr2); 2023-11-16T02:31:37.577 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:37.620 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] append_reader 2023-11-16T02:31:37.813 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] append_writer 2023-11-16T02:31:38.006 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dirperf 2023-11-16T02:31:38.273 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] metaperf 2023-11-16T02:31:38.427 INFO:teuthology.orchestra.run.smithi204.stderr:metaperf.c: In function 'crfiles': 2023-11-16T02:31:38.427 INFO:teuthology.orchestra.run.smithi204.stderr:metaperf.c:166:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:38.427 INFO:teuthology.orchestra.run.smithi204.stderr: 166 | write(fd, buf, fsize); 2023-11-16T02:31:38.427 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:38.427 INFO:teuthology.orchestra.run.smithi204.stderr:metaperf.c: In function 't_linkun': 2023-11-16T02:31:38.427 INFO:teuthology.orchestra.run.smithi204.stderr:metaperf.c:454:25: warning: ignoring return value of 'link' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:38.428 INFO:teuthology.orchestra.run.smithi204.stderr: 454 | link("a", *fnp); 2023-11-16T02:31:38.428 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~ 2023-11-16T02:31:38.428 INFO:teuthology.orchestra.run.smithi204.stderr:metaperf.c: In function 't_chown': 2023-11-16T02:31:38.428 INFO:teuthology.orchestra.run.smithi204.stderr:metaperf.c:404:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:38.428 INFO:teuthology.orchestra.run.smithi204.stderr: 404 | chown(*fnp, 2, -1); 2023-11-16T02:31:38.428 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:38.428 INFO:teuthology.orchestra.run.smithi204.stderr:metaperf.c:406:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:38.428 INFO:teuthology.orchestra.run.smithi204.stderr: 406 | chown(*fnp, 1, -1); 2023-11-16T02:31:38.428 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:38.428 INFO:teuthology.orchestra.run.smithi204.stderr:metaperf.c: In function 'i_chown': 2023-11-16T02:31:38.428 INFO:teuthology.orchestra.run.smithi204.stderr:metaperf.c:291:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:38.428 INFO:teuthology.orchestra.run.smithi204.stderr: 291 | chown(*fnp, 1, -1); 2023-11-16T02:31:38.429 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:38.429 INFO:teuthology.orchestra.run.smithi204.stderr:metaperf.c: In function 'main': 2023-11-16T02:31:38.429 INFO:teuthology.orchestra.run.smithi204.stderr:metaperf.c:152:9: warning: ignoring return value of 'chdir' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:38.429 INFO:teuthology.orchestra.run.smithi204.stderr: 152 | chdir(".."); 2023-11-16T02:31:38.429 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~ 2023-11-16T02:31:38.602 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] devzero 2023-11-16T02:31:38.822 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] feature 2023-11-16T02:31:39.085 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] alloc 2023-11-16T02:31:39.246 INFO:teuthology.orchestra.run.smithi204.stderr:alloc.c: In function 'main': 2023-11-16T02:31:39.247 INFO:teuthology.orchestra.run.smithi204.stderr:alloc.c:247:17: warning: ignoring return value of 'mkstemp' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:39.247 INFO:teuthology.orchestra.run.smithi204.stderr: 247 | mkstemp(tmpfile); 2023-11-16T02:31:39.247 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-16T02:31:39.342 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fault 2023-11-16T02:31:39.548 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fstest 2023-11-16T02:31:39.832 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_access_root 2023-11-16T02:31:39.978 INFO:teuthology.orchestra.run.smithi204.stderr:t_access_root.c: In function 'main': 2023-11-16T02:31:39.978 INFO:teuthology.orchestra.run.smithi204.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:39.978 INFO:teuthology.orchestra.run.smithi204.stderr: 55 | system(cmd); 2023-11-16T02:31:39.978 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~ 2023-11-16T02:31:40.027 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] godown 2023-11-16T02:31:40.241 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] resvtest 2023-11-16T02:31:40.470 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] writemod 2023-11-16T02:31:40.656 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] writev_on_pagefault 2023-11-16T02:31:40.857 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] makeextents 2023-11-16T02:31:41.079 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] itrash 2023-11-16T02:31:41.271 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] rename 2023-11-16T02:31:41.446 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] multi_open_unlink 2023-11-16T02:31:41.655 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] unwritten_sync 2023-11-16T02:31:41.880 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] genhashnames 2023-11-16T02:31:42.108 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_holes 2023-11-16T02:31:42.295 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_mmap_writev 2023-11-16T02:31:42.485 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_truncate_cmtime 2023-11-16T02:31:42.684 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dirhash_collide 2023-11-16T02:31:42.906 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_rename_overwrite 2023-11-16T02:31:43.085 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] holetest 2023-11-16T02:31:43.239 INFO:teuthology.orchestra.run.smithi204.stderr:holetest.c: In function 'pt_write_marker': 2023-11-16T02:31:43.239 INFO:teuthology.orchestra.run.smithi204.stderr:holetest.c:140:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:43.239 INFO:teuthology.orchestra.run.smithi204.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2023-11-16T02:31:43.239 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:43.356 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_truncate_self 2023-11-16T02:31:43.538 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] af_unix 2023-11-16T02:31:43.743 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_mmap_stale_pmd 2023-11-16T02:31:43.892 INFO:teuthology.orchestra.run.smithi204.stderr:t_mmap_stale_pmd.c: In function 'main': 2023-11-16T02:31:43.892 INFO:teuthology.orchestra.run.smithi204.stderr:t_mmap_stale_pmd.c:42:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:43.892 INFO:teuthology.orchestra.run.smithi204.stderr: 42 | ftruncate(fd, 0); 2023-11-16T02:31:43.892 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-16T02:31:43.892 INFO:teuthology.orchestra.run.smithi204.stderr:t_mmap_stale_pmd.c:43:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:43.892 INFO:teuthology.orchestra.run.smithi204.stderr: 43 | ftruncate(fd, MiB(4)); 2023-11-16T02:31:43.892 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:43.893 INFO:teuthology.orchestra.run.smithi204.stderr:t_mmap_stale_pmd.c:55:9: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:43.893 INFO:teuthology.orchestra.run.smithi204.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2023-11-16T02:31:43.893 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:43.939 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_mmap_cow_race 2023-11-16T02:31:44.090 INFO:teuthology.orchestra.run.smithi204.stderr:t_mmap_cow_race.c: In function 'main': 2023-11-16T02:31:44.090 INFO:teuthology.orchestra.run.smithi204.stderr:t_mmap_cow_race.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:44.090 INFO:teuthology.orchestra.run.smithi204.stderr: 61 | ftruncate(fd, 0); 2023-11-16T02:31:44.091 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-16T02:31:44.091 INFO:teuthology.orchestra.run.smithi204.stderr:t_mmap_cow_race.c:62:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:44.091 INFO:teuthology.orchestra.run.smithi204.stderr: 62 | ftruncate(fd, MiB(2)); 2023-11-16T02:31:44.091 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:44.146 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_mmap_fallocate 2023-11-16T02:31:44.337 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fsync-err 2023-11-16T02:31:44.566 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_mmap_write_ro 2023-11-16T02:31:44.760 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_ext4_dax_journal_corruption 2023-11-16T02:31:44.909 INFO:teuthology.orchestra.run.smithi204.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2023-11-16T02:31:44.910 INFO:teuthology.orchestra.run.smithi204.stderr:t_ext4_dax_journal_corruption.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:44.910 INFO:teuthology.orchestra.run.smithi204.stderr: 61 | ftruncate(fd, 0); 2023-11-16T02:31:44.910 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-16T02:31:44.962 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_ext4_dax_inline_corruption 2023-11-16T02:31:45.160 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_ofd_locks 2023-11-16T02:31:45.400 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_mmap_collision 2023-11-16T02:31:45.644 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] mmap-write-concurrent 2023-11-16T02:31:45.856 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_get_file_time 2023-11-16T02:31:46.042 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_create_short_dirs 2023-11-16T02:31:46.250 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_create_long_dirs 2023-11-16T02:31:46.700 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_enospc 2023-11-16T02:31:46.955 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_mmap_writev_overlap 2023-11-16T02:31:47.168 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] checkpoint_journal 2023-11-16T02:31:47.365 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] mmap-rw-fault 2023-11-16T02:31:47.591 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] allocstale 2023-11-16T02:31:47.804 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_mmap_cow_memory_failure 2023-11-16T02:31:48.017 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fake-dump-rootino 2023-11-16T02:31:48.208 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dio-buf-fault 2023-11-16T02:31:48.403 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] rewinddir-test 2023-11-16T02:31:48.616 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfsctl 2023-11-16T02:31:48.850 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] bstat 2023-11-16T02:31:49.104 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_mtab 2023-11-16T02:31:49.255 INFO:teuthology.orchestra.run.smithi204.stderr:t_mtab.c: In function 'update_mtab': 2023-11-16T02:31:49.256 INFO:teuthology.orchestra.run.smithi204.stderr:t_mtab.c:256:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:49.256 INFO:teuthology.orchestra.run.smithi204.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2023-11-16T02:31:49.256 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:49.336 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] getdevicesize 2023-11-16T02:31:49.519 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] preallo_rw_pattern_reader 2023-11-16T02:31:49.677 INFO:teuthology.orchestra.run.smithi204.stderr:In file included from preallo_rw_pattern_reader.c:2: 2023-11-16T02:31:49.677 INFO:teuthology.orchestra.run.smithi204.stderr:iopat.c: In function 'main': 2023-11-16T02:31:49.677 INFO:teuthology.orchestra.run.smithi204.stderr:iopat.c:38:4: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:49.677 INFO:teuthology.orchestra.run.smithi204.stderr: 38 | read(fd, &x, 1048576); 2023-11-16T02:31:49.678 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:49.721 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] preallo_rw_pattern_writer 2023-11-16T02:31:49.879 INFO:teuthology.orchestra.run.smithi204.stderr:In file included from preallo_rw_pattern_writer.c:2: 2023-11-16T02:31:49.879 INFO:teuthology.orchestra.run.smithi204.stderr:iopat.c: In function 'main': 2023-11-16T02:31:49.879 INFO:teuthology.orchestra.run.smithi204.stderr:iopat.c:34:4: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:49.879 INFO:teuthology.orchestra.run.smithi204.stderr: 34 | write(fd, &x, 1048576); 2023-11-16T02:31:49.879 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:49.921 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] ftrunc 2023-11-16T02:31:50.112 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] trunc 2023-11-16T02:31:50.320 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fs_perms 2023-11-16T02:31:50.470 INFO:teuthology.orchestra.run.smithi204.stderr:fs_perms.c: In function 'main': 2023-11-16T02:31:50.470 INFO:teuthology.orchestra.run.smithi204.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:50.470 INFO:teuthology.orchestra.run.smithi204.stderr: 54 | system("rm -f test.file"); 2023-11-16T02:31:50.470 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:50.470 INFO:teuthology.orchestra.run.smithi204.stderr:fs_perms.c: In function 'testsetup': 2023-11-16T02:31:50.470 INFO:teuthology.orchestra.run.smithi204.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:50.470 INFO:teuthology.orchestra.run.smithi204.stderr: 67 | system("cp testx.file test.file"); 2023-11-16T02:31:50.470 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:50.470 INFO:teuthology.orchestra.run.smithi204.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:50.471 INFO:teuthology.orchestra.run.smithi204.stderr: 69 | chown("test.file",cuserId,cgroupId); 2023-11-16T02:31:50.471 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:50.471 INFO:teuthology.orchestra.run.smithi204.stderr:fs_perms.c: In function 'testfperm': 2023-11-16T02:31:50.471 INFO:teuthology.orchestra.run.smithi204.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:50.471 INFO:teuthology.orchestra.run.smithi204.stderr: 123 | seteuid(0); 2023-11-16T02:31:50.471 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~ 2023-11-16T02:31:50.471 INFO:teuthology.orchestra.run.smithi204.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:50.471 INFO:teuthology.orchestra.run.smithi204.stderr: 124 | setegid(0); 2023-11-16T02:31:50.471 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~ 2023-11-16T02:31:50.525 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] testx 2023-11-16T02:31:50.692 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] looptest 2023-11-16T02:31:50.929 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] locktest 2023-11-16T02:31:51.288 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] unwritten_mmap 2023-11-16T02:31:51.493 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] bulkstat_unlink_test 2023-11-16T02:31:51.653 INFO:teuthology.orchestra.run.smithi204.stderr:bulkstat_unlink_test.c: In function 'main': 2023-11-16T02:31:51.653 INFO:teuthology.orchestra.run.smithi204.stderr:bulkstat_unlink_test.c:106:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:51.653 INFO:teuthology.orchestra.run.smithi204.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2023-11-16T02:31:51.653 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:51.653 INFO:teuthology.orchestra.run.smithi204.stderr:bulkstat_unlink_test.c:178:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:51.653 INFO:teuthology.orchestra.run.smithi204.stderr: 178 | system(fname); 2023-11-16T02:31:51.653 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~ 2023-11-16T02:31:51.740 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] deduperace 2023-11-16T02:31:51.980 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] bulkstat_unlink_test_modified 2023-11-16T02:31:52.140 INFO:teuthology.orchestra.run.smithi204.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2023-11-16T02:31:52.140 INFO:teuthology.orchestra.run.smithi204.stderr:bulkstat_unlink_test_modified.c:83:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.140 INFO:teuthology.orchestra.run.smithi204.stderr: 83 | write(fd, fname, sizeof(fname)); 2023-11-16T02:31:52.140 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.140 INFO:teuthology.orchestra.run.smithi204.stderr:bulkstat_unlink_test_modified.c:139:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.141 INFO:teuthology.orchestra.run.smithi204.stderr: 139 | write(fd, fname, sizeof(fname)); 2023-11-16T02:31:52.141 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.141 INFO:teuthology.orchestra.run.smithi204.stderr:bulkstat_unlink_test_modified.c:185:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.141 INFO:teuthology.orchestra.run.smithi204.stderr: 185 | system(fname); 2023-11-16T02:31:52.141 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~ 2023-11-16T02:31:52.224 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_dir_offset 2023-11-16T02:31:52.412 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_futimens 2023-11-16T02:31:52.592 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_immutable 2023-11-16T02:31:52.763 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c: In function 'create_test_area': 2023-11-16T02:31:52.764 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.764 INFO:teuthology.orchestra.run.smithi204.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2023-11-16T02:31:52.764 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.764 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.764 INFO:teuthology.orchestra.run.smithi204.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2023-11-16T02:31:52.764 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.765 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c: In function 'remove_test_area': 2023-11-16T02:31:52.765 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.765 INFO:teuthology.orchestra.run.smithi204.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2023-11-16T02:31:52.765 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.765 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.765 INFO:teuthology.orchestra.run.smithi204.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-11-16T02:31:52.765 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.765 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.766 INFO:teuthology.orchestra.run.smithi204.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2023-11-16T02:31:52.766 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.766 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.766 INFO:teuthology.orchestra.run.smithi204.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-11-16T02:31:52.766 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.767 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.767 INFO:teuthology.orchestra.run.smithi204.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2023-11-16T02:31:52.767 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.768 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.768 INFO:teuthology.orchestra.run.smithi204.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2023-11-16T02:31:52.768 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.768 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c: In function 'check_test_area': 2023-11-16T02:31:52.768 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.768 INFO:teuthology.orchestra.run.smithi204.stderr: 1788 | asprintf(&path, "%s/", dir); 2023-11-16T02:31:52.768 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.768 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.768 INFO:teuthology.orchestra.run.smithi204.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2023-11-16T02:31:52.768 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.768 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.769 INFO:teuthology.orchestra.run.smithi204.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2023-11-16T02:31:52.769 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.769 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.769 INFO:teuthology.orchestra.run.smithi204.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2023-11-16T02:31:52.769 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.769 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.769 INFO:teuthology.orchestra.run.smithi204.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2023-11-16T02:31:52.769 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.769 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.769 INFO:teuthology.orchestra.run.smithi204.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2023-11-16T02:31:52.769 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.769 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.769 INFO:teuthology.orchestra.run.smithi204.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2023-11-16T02:31:52.770 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.770 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.770 INFO:teuthology.orchestra.run.smithi204.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-11-16T02:31:52.770 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.770 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.770 INFO:teuthology.orchestra.run.smithi204.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-11-16T02:31:52.770 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.772 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c: In function 'test_immutable': 2023-11-16T02:31:52.772 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.772 INFO:teuthology.orchestra.run.smithi204.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2023-11-16T02:31:52.772 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.772 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.773 INFO:teuthology.orchestra.run.smithi204.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2023-11-16T02:31:52.773 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.773 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:408:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.773 INFO:teuthology.orchestra.run.smithi204.stderr: 408 | chown(path, 0, 0); 2023-11-16T02:31:52.773 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.773 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.773 INFO:teuthology.orchestra.run.smithi204.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2023-11-16T02:31:52.773 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.773 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.773 INFO:teuthology.orchestra.run.smithi204.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2023-11-16T02:31:52.773 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.773 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:553:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.774 INFO:teuthology.orchestra.run.smithi204.stderr: 553 | chown(path, 0, 0); 2023-11-16T02:31:52.774 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.774 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.774 INFO:teuthology.orchestra.run.smithi204.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2023-11-16T02:31:52.774 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.774 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.774 INFO:teuthology.orchestra.run.smithi204.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2023-11-16T02:31:52.774 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.774 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.774 INFO:teuthology.orchestra.run.smithi204.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2023-11-16T02:31:52.774 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.774 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.774 INFO:teuthology.orchestra.run.smithi204.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2023-11-16T02:31:52.775 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.775 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.775 INFO:teuthology.orchestra.run.smithi204.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2023-11-16T02:31:52.775 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.775 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.775 INFO:teuthology.orchestra.run.smithi204.stderr: 653 | chown(path, 0, 0); 2023-11-16T02:31:52.775 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.775 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.775 INFO:teuthology.orchestra.run.smithi204.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-11-16T02:31:52.775 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.775 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.775 INFO:teuthology.orchestra.run.smithi204.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2023-11-16T02:31:52.775 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.776 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:705:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.776 INFO:teuthology.orchestra.run.smithi204.stderr: 705 | chown(path, 0, 0); 2023-11-16T02:31:52.776 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.776 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.776 INFO:teuthology.orchestra.run.smithi204.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-11-16T02:31:52.776 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.778 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c: In function 'test_append': 2023-11-16T02:31:52.778 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.778 INFO:teuthology.orchestra.run.smithi204.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2023-11-16T02:31:52.778 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.778 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.778 INFO:teuthology.orchestra.run.smithi204.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2023-11-16T02:31:52.778 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.779 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1051:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.779 INFO:teuthology.orchestra.run.smithi204.stderr: 1051 | chown(path, 0, 0); 2023-11-16T02:31:52.779 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.779 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.779 INFO:teuthology.orchestra.run.smithi204.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2023-11-16T02:31:52.779 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.779 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.779 INFO:teuthology.orchestra.run.smithi204.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2023-11-16T02:31:52.779 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.779 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1516:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.779 INFO:teuthology.orchestra.run.smithi204.stderr: 1516 | chown(path, 0, 0); 2023-11-16T02:31:52.779 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.779 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.780 INFO:teuthology.orchestra.run.smithi204.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2023-11-16T02:31:52.780 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.780 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.780 INFO:teuthology.orchestra.run.smithi204.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2023-11-16T02:31:52.780 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.780 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.780 INFO:teuthology.orchestra.run.smithi204.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2023-11-16T02:31:52.780 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.780 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.780 INFO:teuthology.orchestra.run.smithi204.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2023-11-16T02:31:52.780 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.780 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1573:11: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.780 INFO:teuthology.orchestra.run.smithi204.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2023-11-16T02:31:52.781 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.781 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.781 INFO:teuthology.orchestra.run.smithi204.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2023-11-16T02:31:52.781 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.781 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.781 INFO:teuthology.orchestra.run.smithi204.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2023-11-16T02:31:52.781 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.781 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.781 INFO:teuthology.orchestra.run.smithi204.stderr: 1618 | chown(path, 0, 0); 2023-11-16T02:31:52.781 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.781 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.781 INFO:teuthology.orchestra.run.smithi204.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2023-11-16T02:31:52.782 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.782 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.782 INFO:teuthology.orchestra.run.smithi204.stderr: 1644 | chown(path, 0, 0); 2023-11-16T02:31:52.782 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.782 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.782 INFO:teuthology.orchestra.run.smithi204.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-11-16T02:31:52.782 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.782 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.783 INFO:teuthology.orchestra.run.smithi204.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2023-11-16T02:31:52.783 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.783 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1692:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.783 INFO:teuthology.orchestra.run.smithi204.stderr: 1692 | chown(path, 0, 0); 2023-11-16T02:31:52.783 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-16T02:31:52.783 INFO:teuthology.orchestra.run.smithi204.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:52.783 INFO:teuthology.orchestra.run.smithi204.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-11-16T02:31:52.783 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:53.329 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] stale_handle 2023-11-16T02:31:53.487 INFO:teuthology.orchestra.run.smithi204.stderr:stale_handle.c: In function 'main': 2023-11-16T02:31:53.487 INFO:teuthology.orchestra.run.smithi204.stderr:stale_handle.c:102:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:53.487 INFO:teuthology.orchestra.run.smithi204.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2023-11-16T02:31:53.487 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:53.544 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] pwrite_mmap_blocked 2023-11-16T02:31:53.739 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_dir_offset2 2023-11-16T02:31:53.974 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] seek_sanity_test 2023-11-16T02:31:54.143 INFO:teuthology.orchestra.run.smithi204.stderr:seek_sanity_test.c: In function 'test18': 2023-11-16T02:31:54.144 INFO:teuthology.orchestra.run.smithi204.stderr:seek_sanity_test.c:460:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:54.144 INFO:teuthology.orchestra.run.smithi204.stderr: 460 | ftruncate(fd, 0); 2023-11-16T02:31:54.144 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-16T02:31:54.146 INFO:teuthology.orchestra.run.smithi204.stderr:seek_sanity_test.c: In function 'test_basic_support': 2023-11-16T02:31:54.146 INFO:teuthology.orchestra.run.smithi204.stderr:seek_sanity_test.c:1207:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:54.146 INFO:teuthology.orchestra.run.smithi204.stderr: 1207 | ftruncate(fd, 0); 2023-11-16T02:31:54.146 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-16T02:31:54.147 INFO:teuthology.orchestra.run.smithi204.stderr:seek_sanity_test.c:1256:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:54.147 INFO:teuthology.orchestra.run.smithi204.stderr: 1256 | ftruncate(fd, 0); 2023-11-16T02:31:54.147 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-16T02:31:54.147 INFO:teuthology.orchestra.run.smithi204.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2023-11-16T02:31:54.147 INFO:teuthology.orchestra.run.smithi204.stderr:seek_sanity_test.c:88:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:54.147 INFO:teuthology.orchestra.run.smithi204.stderr: 88 | ftruncate(fd, 0); 2023-11-16T02:31:54.148 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-16T02:31:54.148 INFO:teuthology.orchestra.run.smithi204.stderr:seek_sanity_test.c:89:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:54.148 INFO:teuthology.orchestra.run.smithi204.stderr: 89 | pwrite(fd, "a", 1, offset); 2023-11-16T02:31:54.148 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:54.148 INFO:teuthology.orchestra.run.smithi204.stderr:seek_sanity_test.c:98:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:54.148 INFO:teuthology.orchestra.run.smithi204.stderr: 98 | ftruncate(fd, 0); 2023-11-16T02:31:54.148 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-16T02:31:54.148 INFO:teuthology.orchestra.run.smithi204.stderr:seek_sanity_test.c:99:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:54.148 INFO:teuthology.orchestra.run.smithi204.stderr: 99 | pwrite(fd, "a", 1, offset); 2023-11-16T02:31:54.148 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:54.471 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] seek_copy_test 2023-11-16T02:31:54.692 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_readdir_1 2023-11-16T02:31:54.839 INFO:teuthology.orchestra.run.smithi204.stderr:t_readdir_1.c: In function 'main': 2023-11-16T02:31:54.839 INFO:teuthology.orchestra.run.smithi204.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:54.839 INFO:teuthology.orchestra.run.smithi204.stderr: 30 | read(fd, buf, 100); 2023-11-16T02:31:54.839 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:54.881 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_readdir_2 2023-11-16T02:31:55.072 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fsync-tester 2023-11-16T02:31:55.222 INFO:teuthology.orchestra.run.smithi204.stderr:fsync-tester.c: In function 'main': 2023-11-16T02:31:55.222 INFO:teuthology.orchestra.run.smithi204.stderr:fsync-tester.c:391:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:55.222 INFO:teuthology.orchestra.run.smithi204.stderr: 391 | read(fd, &seed, sizeof(seed)); 2023-11-16T02:31:55.223 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:55.223 INFO:teuthology.orchestra.run.smithi204.stderr:fsync-tester.c:541:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:55.223 INFO:teuthology.orchestra.run.smithi204.stderr: 541 | system("reboot -fn"); 2023-11-16T02:31:55.223 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:55.223 INFO:teuthology.orchestra.run.smithi204.stderr:fsync-tester.c: In function 'drop_all_caches': 2023-11-16T02:31:55.224 INFO:teuthology.orchestra.run.smithi204.stderr:fsync-tester.c:90:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:55.224 INFO:teuthology.orchestra.run.smithi204.stderr: 90 | write(fd, value, sizeof(value)-1); 2023-11-16T02:31:55.224 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:55.372 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] nsexec 2023-11-16T02:31:55.596 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] cloner 2023-11-16T02:31:55.816 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] renameat2 2023-11-16T02:31:56.027 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_getcwd 2023-11-16T02:31:56.176 INFO:teuthology.orchestra.run.smithi204.stderr:t_getcwd.c: In function 'test_getcwd': 2023-11-16T02:31:56.176 INFO:teuthology.orchestra.run.smithi204.stderr:t_getcwd.c:21:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:56.176 INFO:teuthology.orchestra.run.smithi204.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2023-11-16T02:31:56.176 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:56.230 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] e4compact 2023-11-16T02:31:56.477 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] test-nextquota 2023-11-16T02:31:56.695 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] punch-alternating 2023-11-16T02:31:56.911 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] attr-list-by-handle-cursor-test 2023-11-16T02:31:57.121 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] listxattr 2023-11-16T02:31:57.308 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dio-interleaved 2023-11-16T02:31:57.512 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_dir_type 2023-11-16T02:31:57.709 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dio-invalidate-cache 2023-11-16T02:31:57.858 INFO:teuthology.orchestra.run.smithi204.stderr:dio-invalidate-cache.c: In function 'main': 2023-11-16T02:31:57.859 INFO:teuthology.orchestra.run.smithi204.stderr:dio-invalidate-cache.c:286:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:31:57.859 INFO:teuthology.orchestra.run.smithi204.stderr: 286 | write(fd, buf, blksz * nr_child); 2023-11-16T02:31:57.859 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:31:57.956 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] stat_test 2023-11-16T02:31:58.295 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_encrypted_d_revalidate 2023-11-16T02:31:58.502 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] attr_replace_test 2023-11-16T02:31:58.710 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] swapon 2023-11-16T02:31:58.917 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] mkswap 2023-11-16T02:31:59.111 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_attr_corruption 2023-11-16T02:31:59.303 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_open_tmpfiles 2023-11-16T02:31:59.527 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fscrypt-crypt-util 2023-11-16T02:32:00.249 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] bulkstat_null_ocount 2023-11-16T02:32:00.451 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] splice-test 2023-11-16T02:32:00.675 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] chprojid_fail 2023-11-16T02:32:00.882 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] detached_mounts_propagation 2023-11-16T02:32:01.113 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] ext4_resize 2023-11-16T02:32:01.305 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_readdir_3 2023-11-16T02:32:01.546 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] splice2pipe 2023-11-16T02:32:01.693 INFO:teuthology.orchestra.run.smithi204.stderr:splice2pipe.c: In function 'prepare_pipe': 2023-11-16T02:32:01.694 INFO:teuthology.orchestra.run.smithi204.stderr:splice2pipe.c:57:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:32:01.694 INFO:teuthology.orchestra.run.smithi204.stderr: 57 | write(p[1], buffer, n); 2023-11-16T02:32:01.694 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:32:01.694 INFO:teuthology.orchestra.run.smithi204.stderr:splice2pipe.c:65:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:32:01.694 INFO:teuthology.orchestra.run.smithi204.stderr: 65 | read(p[0], buffer, n); 2023-11-16T02:32:01.694 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:32:01.751 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] uuid_ioctl 2023-11-16T02:32:01.951 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fiemap-tester 2023-11-16T02:32:02.257 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_stripealign 2023-11-16T02:32:02.454 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] open_by_handle 2023-11-16T02:32:02.747 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] t_mmap_dio 2023-11-16T02:32:02.953 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfsfind 2023-11-16T02:32:03.193 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fssum 2023-11-16T02:32:03.674 INFO:teuthology.orchestra.run.smithi204.stdout:Building log-writes 2023-11-16T02:32:03.682 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] replay-log 2023-11-16T02:32:04.073 INFO:teuthology.orchestra.run.smithi204.stdout:Building perf 2023-11-16T02:32:04.077 INFO:teuthology.orchestra.run.smithi204.stdout:Building aio-dio-regress 2023-11-16T02:32:04.087 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aiocp 2023-11-16T02:32:04.368 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-dio-append-write-fallocate-race 2023-11-16T02:32:04.589 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-dio-append-write-read-race 2023-11-16T02:32:04.817 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-dio-cow-race 2023-11-16T02:32:05.023 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-dio-cycle-write 2023-11-16T02:32:05.090 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:32:05.093 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:32:05.096 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:32:05.170 INFO:teuthology.orchestra.run.smithi204.stderr:aio-dio-cycle-write.c: In function 'init_test': 2023-11-16T02:32:05.170 INFO:teuthology.orchestra.run.smithi204.stderr:aio-dio-cycle-write.c:83:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:32:05.171 INFO:teuthology.orchestra.run.smithi204.stderr: 83 | ftruncate(fd, buf_size); 2023-11-16T02:32:05.171 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:32:05.260 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-dio-eof-race 2023-11-16T02:32:05.496 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-dio-extend-stat 2023-11-16T02:32:05.712 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-dio-fcntl-race 2023-11-16T02:32:05.924 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-dio-hole-filling-race 2023-11-16T02:32:06.123 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-dio-invalidate-failure 2023-11-16T02:32:06.333 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-dio-invalidate-readahead 2023-11-16T02:32:06.550 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aiodio_sparse2 2023-11-16T02:32:06.699 INFO:teuthology.orchestra.run.smithi204.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2023-11-16T02:32:06.700 INFO:teuthology.orchestra.run.smithi204.stderr:aiodio_sparse2.c:111:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:32:06.700 INFO:teuthology.orchestra.run.smithi204.stderr: 111 | ftruncate(fd, filesize); 2023-11-16T02:32:06.701 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-11-16T02:32:06.701 INFO:teuthology.orchestra.run.smithi204.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2023-11-16T02:32:06.701 INFO:teuthology.orchestra.run.smithi204.stderr:aiodio_sparse2.c:274:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-16T02:32:06.701 INFO:teuthology.orchestra.run.smithi204.stderr: 274 | ftruncate(fd, size); 2023-11-16T02:32:06.702 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~~~~~~~~~~ 2023-11-16T02:32:06.821 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-dio-subblock-eof-read 2023-11-16T02:32:07.015 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-dio-write-verify 2023-11-16T02:32:07.264 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-11-16T02:32:07.449 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-11-16T02:32:07.627 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] aio-last-ref-held-by-io 2023-11-16T02:32:07.854 INFO:teuthology.orchestra.run.smithi204.stdout:Building vfs 2023-11-16T02:32:07.862 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] vfstest 2023-11-16T02:32:10.130 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] mount-idmapped 2023-11-16T02:32:10.598 INFO:teuthology.orchestra.run.smithi204.stdout:Building m4 2023-11-16T02:32:10.605 INFO:teuthology.orchestra.run.smithi204.stdout:Building common 2023-11-16T02:32:10.611 INFO:teuthology.orchestra.run.smithi204.stdout:Building tests 2023-11-16T02:32:10.620 INFO:teuthology.orchestra.run.smithi204.stdout:Building btrfs 2023-11-16T02:32:10.629 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/btrfs/group.list 2023-11-16T02:32:10.762 INFO:teuthology.orchestra.run.smithi204.stdout:Building ceph 2023-11-16T02:32:10.770 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/ceph/group.list 2023-11-16T02:32:10.803 INFO:teuthology.orchestra.run.smithi204.stdout:Building cifs 2023-11-16T02:32:10.811 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/cifs/group.list 2023-11-16T02:32:10.840 INFO:teuthology.orchestra.run.smithi204.stdout:Building ext4 2023-11-16T02:32:10.849 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/ext4/group.list 2023-11-16T02:32:10.933 INFO:teuthology.orchestra.run.smithi204.stdout:Building f2fs 2023-11-16T02:32:10.942 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/f2fs/group.list 2023-11-16T02:32:10.981 INFO:teuthology.orchestra.run.smithi204.stdout:Building generic 2023-11-16T02:32:10.992 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/generic/group.list 2023-11-16T02:32:11.207 INFO:teuthology.orchestra.run.smithi204.stdout:Building nfs 2023-11-16T02:32:11.216 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/nfs/group.list 2023-11-16T02:32:11.249 INFO:teuthology.orchestra.run.smithi204.stdout:Building ocfs2 2023-11-16T02:32:11.259 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/ocfs2/group.list 2023-11-16T02:32:11.289 INFO:teuthology.orchestra.run.smithi204.stdout:Building overlay 2023-11-16T02:32:11.297 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/overlay/group.list 2023-11-16T02:32:11.387 INFO:teuthology.orchestra.run.smithi204.stdout:Building perf 2023-11-16T02:32:11.395 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/perf/group.list 2023-11-16T02:32:11.422 INFO:teuthology.orchestra.run.smithi204.stdout:Building selftest 2023-11-16T02:32:11.430 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/selftest/group.list 2023-11-16T02:32:11.458 INFO:teuthology.orchestra.run.smithi204.stdout:Building shared 2023-11-16T02:32:11.467 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/shared/group.list 2023-11-16T02:32:11.506 INFO:teuthology.orchestra.run.smithi204.stdout:Building tmpfs 2023-11-16T02:32:11.514 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/tmpfs/group.list 2023-11-16T02:32:11.544 INFO:teuthology.orchestra.run.smithi204.stdout:Building udf 2023-11-16T02:32:11.552 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/udf/group.list 2023-11-16T02:32:11.578 INFO:teuthology.orchestra.run.smithi204.stdout:Building xfs 2023-11-16T02:32:11.589 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/xfs/group.list 2023-11-16T02:32:11.809 DEBUG:teuthology.orchestra.run.smithi204:> (cd /tmp/tmp.aa1AheDDlixfstests-dev && exec sudo make install) 2023-11-16T02:32:11.896 INFO:teuthology.orchestra.run.smithi204.stdout:Building include 2023-11-16T02:32:11.902 INFO:teuthology.orchestra.run.smithi204.stdout:Building lib 2023-11-16T02:32:11.909 INFO:teuthology.orchestra.run.smithi204.stdout:Building ltp 2023-11-16T02:32:11.917 INFO:teuthology.orchestra.run.smithi204.stdout:Building src 2023-11-16T02:32:11.970 INFO:teuthology.orchestra.run.smithi204.stdout:Building log-writes 2023-11-16T02:32:11.977 INFO:teuthology.orchestra.run.smithi204.stdout:Building perf 2023-11-16T02:32:11.983 INFO:teuthology.orchestra.run.smithi204.stdout:Building aio-dio-regress 2023-11-16T02:32:11.990 INFO:teuthology.orchestra.run.smithi204.stdout:Building vfs 2023-11-16T02:32:11.997 INFO:teuthology.orchestra.run.smithi204.stdout:Building m4 2023-11-16T02:32:12.003 INFO:teuthology.orchestra.run.smithi204.stdout:Building common 2023-11-16T02:32:12.012 INFO:teuthology.orchestra.run.smithi204.stdout:Building tests 2023-11-16T02:32:12.018 INFO:teuthology.orchestra.run.smithi204.stdout:Building btrfs 2023-11-16T02:32:12.028 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/btrfs/group.list 2023-11-16T02:32:12.157 INFO:teuthology.orchestra.run.smithi204.stdout:Building ceph 2023-11-16T02:32:12.166 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/ceph/group.list 2023-11-16T02:32:12.198 INFO:teuthology.orchestra.run.smithi204.stdout:Building cifs 2023-11-16T02:32:12.207 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/cifs/group.list 2023-11-16T02:32:12.235 INFO:teuthology.orchestra.run.smithi204.stdout:Building ext4 2023-11-16T02:32:12.244 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/ext4/group.list 2023-11-16T02:32:12.327 INFO:teuthology.orchestra.run.smithi204.stdout:Building f2fs 2023-11-16T02:32:12.337 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/f2fs/group.list 2023-11-16T02:32:12.374 INFO:teuthology.orchestra.run.smithi204.stdout:Building generic 2023-11-16T02:32:12.385 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/generic/group.list 2023-11-16T02:32:12.594 INFO:teuthology.orchestra.run.smithi204.stdout:Building nfs 2023-11-16T02:32:12.602 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/nfs/group.list 2023-11-16T02:32:12.635 INFO:teuthology.orchestra.run.smithi204.stdout:Building ocfs2 2023-11-16T02:32:12.643 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/ocfs2/group.list 2023-11-16T02:32:12.673 INFO:teuthology.orchestra.run.smithi204.stdout:Building overlay 2023-11-16T02:32:12.682 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/overlay/group.list 2023-11-16T02:32:12.772 INFO:teuthology.orchestra.run.smithi204.stdout:Building perf 2023-11-16T02:32:12.780 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/perf/group.list 2023-11-16T02:32:12.806 INFO:teuthology.orchestra.run.smithi204.stdout:Building selftest 2023-11-16T02:32:12.814 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/selftest/group.list 2023-11-16T02:32:12.843 INFO:teuthology.orchestra.run.smithi204.stdout:Building shared 2023-11-16T02:32:12.851 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/shared/group.list 2023-11-16T02:32:12.890 INFO:teuthology.orchestra.run.smithi204.stdout:Building tmpfs 2023-11-16T02:32:12.898 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/tmpfs/group.list 2023-11-16T02:32:12.929 INFO:teuthology.orchestra.run.smithi204.stdout:Building udf 2023-11-16T02:32:12.937 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/udf/group.list 2023-11-16T02:32:12.963 INFO:teuthology.orchestra.run.smithi204.stdout:Building xfs 2023-11-16T02:32:12.974 INFO:teuthology.orchestra.run.smithi204.stdout: [GROUP] /tmp/tmp.aa1AheDDlixfstests-dev/tests/xfs/group.list 2023-11-16T02:32:13.182 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-11-16T02:32:13.186 INFO:teuthology.orchestra.run.smithi204.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-16T02:32:13.186 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-11-16T02:32:13.190 INFO:teuthology.orchestra.run.smithi204.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-16T02:32:13.191 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-11-16T02:32:13.195 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-11-16T02:32:13.215 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-11-16T02:32:13.374 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-11-16T02:32:13.394 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-11-16T02:32:13.423 INFO:teuthology.orchestra.run.smithi204.stdout:Building log-writes 2023-11-16T02:32:13.429 INFO:teuthology.orchestra.run.smithi204.stdout:Building perf 2023-11-16T02:32:13.436 INFO:teuthology.orchestra.run.smithi204.stdout:Building aio-dio-regress 2023-11-16T02:32:13.443 INFO:teuthology.orchestra.run.smithi204.stdout:Building vfs 2023-11-16T02:32:13.448 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake -C log-writes install 2023-11-16T02:32:13.451 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-11-16T02:32:13.472 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-11-16T02:32:13.492 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake -C perf install 2023-11-16T02:32:13.496 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-11-16T02:32:13.516 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-11-16T02:32:13.565 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-11-16T02:32:13.569 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-11-16T02:32:13.589 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-11-16T02:32:13.703 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake -C vfs install 2023-11-16T02:32:13.706 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-11-16T02:32:13.726 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-11-16T02:32:13.754 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-11-16T02:32:13.774 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-11-16T02:32:16.523 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-11-16T02:32:16.744 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-11-16T02:32:16.790 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-11-16T02:32:16.797 INFO:teuthology.orchestra.run.smithi204.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-16T02:32:16.797 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-11-16T02:32:16.798 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-11-16T02:32:16.818 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-11-16T02:32:17.098 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-11-16T02:32:17.102 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aa1AheDDlixfstests-dev/tests/btrfs/ install 2023-11-16T02:32:17.107 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-11-16T02:32:17.128 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 /var/lib/xfstests/tests/btrfs 2023-11-16T02:32:18.859 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-11-16T02:32:18.877 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out /var/lib/xfstests/tests/btrfs 2023-11-16T02:32:20.612 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aa1AheDDlixfstests-dev/tests/ceph/ install 2023-11-16T02:32:20.616 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-11-16T02:32:20.636 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-11-16T02:32:20.679 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-11-16T02:32:20.700 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-11-16T02:32:20.742 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aa1AheDDlixfstests-dev/tests/cifs/ install 2023-11-16T02:32:20.746 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-11-16T02:32:20.766 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-11-16T02:32:20.786 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-11-16T02:32:20.806 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-11-16T02:32:20.827 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aa1AheDDlixfstests-dev/tests/ext4/ install 2023-11-16T02:32:20.834 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-11-16T02:32:20.852 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-11-16T02:32:21.250 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-11-16T02:32:21.270 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-11-16T02:32:21.690 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aa1AheDDlixfstests-dev/tests/f2fs/ install 2023-11-16T02:32:21.692 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-11-16T02:32:21.712 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-11-16T02:32:21.738 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-11-16T02:32:21.758 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-11-16T02:32:21.784 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aa1AheDDlixfstests-dev/tests/generic/ install 2023-11-16T02:32:21.792 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-11-16T02:32:21.812 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 /var/lib/xfstests/tests/generic 2023-11-16T02:32:26.008 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-11-16T02:32:26.029 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out /var/lib/xfstests/tests/generic 2023-11-16T02:32:30.246 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aa1AheDDlixfstests-dev/tests/nfs/ install 2023-11-16T02:32:30.250 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-11-16T02:32:30.270 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-11-16T02:32:30.290 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-11-16T02:32:30.311 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-11-16T02:32:30.331 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aa1AheDDlixfstests-dev/tests/ocfs2/ install 2023-11-16T02:32:30.335 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-11-16T02:32:30.355 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-11-16T02:32:30.375 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-11-16T02:32:30.396 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-11-16T02:32:30.416 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aa1AheDDlixfstests-dev/tests/overlay/ install 2023-11-16T02:32:30.420 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-11-16T02:32:30.441 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-11-16T02:32:31.022 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-11-16T02:32:31.043 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-11-16T02:32:31.627 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aa1AheDDlixfstests-dev/tests/perf/ install 2023-11-16T02:32:31.631 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-11-16T02:32:31.651 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-11-16T02:32:31.672 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-11-16T02:32:31.692 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-11-16T02:32:31.712 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aa1AheDDlixfstests-dev/tests/selftest/ install 2023-11-16T02:32:31.716 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-11-16T02:32:31.736 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-11-16T02:32:31.784 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-11-16T02:32:31.805 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-11-16T02:32:31.853 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aa1AheDDlixfstests-dev/tests/shared/ install 2023-11-16T02:32:31.857 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-11-16T02:32:31.877 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-11-16T02:32:31.909 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-11-16T02:32:31.930 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-11-16T02:32:31.961 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aa1AheDDlixfstests-dev/tests/tmpfs/ install 2023-11-16T02:32:31.965 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-11-16T02:32:31.986 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-11-16T02:32:32.006 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-11-16T02:32:32.026 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-11-16T02:32:32.046 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aa1AheDDlixfstests-dev/tests/udf/ install 2023-11-16T02:32:32.050 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-11-16T02:32:32.071 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-11-16T02:32:32.091 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-11-16T02:32:32.113 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-11-16T02:32:32.131 INFO:teuthology.orchestra.run.smithi204.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.aa1AheDDlixfstests-dev/tests/xfs/ install 2023-11-16T02:32:32.139 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-11-16T02:32:32.160 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-11-16T02:32:35.170 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:32:35.173 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:32:35.175 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:32:36.130 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-11-16T02:32:36.150 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-11-16T02:32:40.153 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-11-16T02:32:40.174 INFO:teuthology.orchestra.run.smithi204.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-11-16T02:32:40.193 INFO:teuthology.orchestra.run.smithi204.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-11-16T02:32:40.214 INFO:teuthology.orchestra.run.smithi204.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-11-16T02:32:40.236 DEBUG:teuthology.orchestra.run.smithi204:> (cd /tmp/tmp.ja3gF9tsUCxfsprogs-dev && exec sudo make) 2023-11-16T02:32:40.262 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize -c -i -f 2023-11-16T02:32:40.474 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: putting auxiliary files in AC_CONFIG_AUX_DIR, '.'. 2023-11-16T02:32:40.474 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file './config.guess' 2023-11-16T02:32:40.483 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file './config.sub' 2023-11-16T02:32:40.492 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file './install-sh' 2023-11-16T02:32:40.502 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file './ltmain.sh' 2023-11-16T02:32:40.544 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-11-16T02:32:40.544 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-11-16T02:32:40.554 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-11-16T02:32:40.564 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-11-16T02:32:40.574 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-11-16T02:32:40.584 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-11-16T02:32:40.595 INFO:teuthology.orchestra.run.smithi204.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-11-16T02:32:40.597 INFO:teuthology.orchestra.run.smithi204.stdout:cp include/install-sh . 2023-11-16T02:32:40.599 INFO:teuthology.orchestra.run.smithi204.stdout:aclocal -I m4 2023-11-16T02:32:41.631 INFO:teuthology.orchestra.run.smithi204.stdout:autoconf 2023-11-16T02:32:42.063 INFO:teuthology.orchestra.run.smithi204.stdout:./configure $LOCAL_CONFIGURE_OPTIONS 2023-11-16T02:32:42.217 INFO:teuthology.orchestra.run.smithi204.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2023-11-16T02:32:42.289 INFO:teuthology.orchestra.run.smithi204.stdout:checking build system type... x86_64-pc-linux-gnu 2023-11-16T02:32:42.289 INFO:teuthology.orchestra.run.smithi204.stdout:checking host system type... x86_64-pc-linux-gnu 2023-11-16T02:32:42.321 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to print strings... printf 2023-11-16T02:32:42.321 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc... gcc 2023-11-16T02:32:42.409 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether the C compiler works... yes 2023-11-16T02:32:42.409 INFO:teuthology.orchestra.run.smithi204.stdout:checking for C compiler default output file name... a.out 2023-11-16T02:32:42.451 INFO:teuthology.orchestra.run.smithi204.stdout:checking for suffix of executables... 2023-11-16T02:32:42.500 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether we are cross compiling... no 2023-11-16T02:32:42.527 INFO:teuthology.orchestra.run.smithi204.stdout:checking for suffix of object files... o 2023-11-16T02:32:42.550 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether the compiler supports GNU C... yes 2023-11-16T02:32:42.574 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether gcc accepts -g... yes 2023-11-16T02:32:42.626 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc option to enable C11 features... none needed 2023-11-16T02:32:42.633 INFO:teuthology.orchestra.run.smithi204.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-11-16T02:32:42.638 INFO:teuthology.orchestra.run.smithi204.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-11-16T02:32:42.641 INFO:teuthology.orchestra.run.smithi204.stdout:checking for egrep... /usr/bin/grep -E 2023-11-16T02:32:42.644 INFO:teuthology.orchestra.run.smithi204.stdout:checking for fgrep... /usr/bin/grep -F 2023-11-16T02:32:42.651 INFO:teuthology.orchestra.run.smithi204.stdout:checking for ld used by gcc... /usr/bin/ld 2023-11-16T02:32:42.655 INFO:teuthology.orchestra.run.smithi204.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-11-16T02:32:42.660 INFO:teuthology.orchestra.run.smithi204.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-11-16T02:32:42.689 INFO:teuthology.orchestra.run.smithi204.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-11-16T02:32:42.690 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether ln -s works... yes 2023-11-16T02:32:42.696 INFO:teuthology.orchestra.run.smithi204.stdout:checking the maximum length of command line arguments... 1572864 2023-11-16T02:32:42.702 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-11-16T02:32:42.702 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-11-16T02:32:42.702 INFO:teuthology.orchestra.run.smithi204.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-11-16T02:32:42.702 INFO:teuthology.orchestra.run.smithi204.stdout:checking for objdump... objdump 2023-11-16T02:32:42.703 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to recognize dependent libraries... pass_all 2023-11-16T02:32:42.703 INFO:teuthology.orchestra.run.smithi204.stdout:checking for dlltool... no 2023-11-16T02:32:42.704 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-11-16T02:32:42.704 INFO:teuthology.orchestra.run.smithi204.stdout:checking for ar... ar 2023-11-16T02:32:42.741 INFO:teuthology.orchestra.run.smithi204.stdout:checking for archiver @FILE support... @ 2023-11-16T02:32:42.741 INFO:teuthology.orchestra.run.smithi204.stdout:checking for strip... strip 2023-11-16T02:32:42.742 INFO:teuthology.orchestra.run.smithi204.stdout:checking for ranlib... ranlib 2023-11-16T02:32:42.742 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gawk... gawk 2023-11-16T02:32:42.830 INFO:teuthology.orchestra.run.smithi204.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-11-16T02:32:42.833 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sysroot... no 2023-11-16T02:32:42.842 INFO:teuthology.orchestra.run.smithi204.stdout:checking for a working dd... /usr/bin/dd 2023-11-16T02:32:42.848 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-11-16T02:32:42.867 INFO:teuthology.orchestra.run.smithi204.stdout:checking for mt... mt 2023-11-16T02:32:42.874 INFO:teuthology.orchestra.run.smithi204.stdout:checking if mt is a manifest tool... no 2023-11-16T02:32:42.900 INFO:teuthology.orchestra.run.smithi204.stdout:checking for stdio.h... yes 2023-11-16T02:32:42.931 INFO:teuthology.orchestra.run.smithi204.stdout:checking for stdlib.h... yes 2023-11-16T02:32:42.963 INFO:teuthology.orchestra.run.smithi204.stdout:checking for string.h... yes 2023-11-16T02:32:42.995 INFO:teuthology.orchestra.run.smithi204.stdout:checking for inttypes.h... yes 2023-11-16T02:32:43.028 INFO:teuthology.orchestra.run.smithi204.stdout:checking for stdint.h... yes 2023-11-16T02:32:43.060 INFO:teuthology.orchestra.run.smithi204.stdout:checking for strings.h... yes 2023-11-16T02:32:43.093 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/stat.h... yes 2023-11-16T02:32:43.127 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/types.h... yes 2023-11-16T02:32:43.164 INFO:teuthology.orchestra.run.smithi204.stdout:checking for unistd.h... yes 2023-11-16T02:32:43.202 INFO:teuthology.orchestra.run.smithi204.stdout:checking for dlfcn.h... yes 2023-11-16T02:32:43.207 INFO:teuthology.orchestra.run.smithi204.stdout:checking for objdir... .libs 2023-11-16T02:32:43.308 INFO:teuthology.orchestra.run.smithi204.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-11-16T02:32:43.308 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-11-16T02:32:43.336 INFO:teuthology.orchestra.run.smithi204.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-11-16T02:32:43.439 INFO:teuthology.orchestra.run.smithi204.stdout:checking if gcc static flag -static works... yes 2023-11-16T02:32:43.482 INFO:teuthology.orchestra.run.smithi204.stdout:checking if gcc supports -c -o file.o... yes 2023-11-16T02:32:43.482 INFO:teuthology.orchestra.run.smithi204.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-11-16T02:32:43.497 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-11-16T02:32:43.532 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether -lc should be explicitly linked in... no 2023-11-16T02:32:43.611 INFO:teuthology.orchestra.run.smithi204.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-11-16T02:32:43.611 INFO:teuthology.orchestra.run.smithi204.stdout:checking how to hardcode library paths into programs... immediate 2023-11-16T02:32:43.615 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether stripping libraries is possible... yes 2023-11-16T02:32:43.615 INFO:teuthology.orchestra.run.smithi204.stdout:checking if libtool supports shared libraries... yes 2023-11-16T02:32:43.615 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether to build shared libraries... yes 2023-11-16T02:32:43.615 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether to build static libraries... yes 2023-11-16T02:32:43.615 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc... (cached) gcc 2023-11-16T02:32:43.657 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-11-16T02:32:43.658 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether gcc accepts -g... (cached) yes 2023-11-16T02:32:43.658 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-11-16T02:32:43.671 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc... (cached) gcc 2023-11-16T02:32:43.716 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-11-16T02:32:43.716 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether gcc accepts -g... (cached) yes 2023-11-16T02:32:43.716 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-11-16T02:32:43.722 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc... (cached) gcc 2023-11-16T02:32:43.766 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-11-16T02:32:43.767 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether gcc accepts -g... (cached) yes 2023-11-16T02:32:43.767 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-11-16T02:32:43.767 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gmake... /usr/bin/gmake 2023-11-16T02:32:43.767 INFO:teuthology.orchestra.run.smithi204.stdout:checking for tar... /usr/bin/tar 2023-11-16T02:32:43.767 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gzip... /usr/bin/gzip 2023-11-16T02:32:43.781 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether gcc -MM is supported... yes 2023-11-16T02:32:43.782 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sort... /bin/sort 2023-11-16T02:32:43.782 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether ln -s works... yes 2023-11-16T02:32:43.782 INFO:teuthology.orchestra.run.smithi204.stdout:checking for msgfmt... /usr/bin/msgfmt 2023-11-16T02:32:43.782 INFO:teuthology.orchestra.run.smithi204.stdout:checking for msgmerge... /usr/bin/msgmerge 2023-11-16T02:32:43.782 INFO:teuthology.orchestra.run.smithi204.stdout:checking for xgettext... /usr/bin/xgettext 2023-11-16T02:32:43.782 INFO:teuthology.orchestra.run.smithi204.stdout:checking for rpm... no 2023-11-16T02:32:43.836 INFO:teuthology.orchestra.run.smithi204.stdout:checking for ini.h... yes 2023-11-16T02:32:43.886 INFO:teuthology.orchestra.run.smithi204.stdout:checking for ini_parse in -linih... yes 2023-11-16T02:32:43.926 INFO:teuthology.orchestra.run.smithi204.stdout:checking for uuid.h... no 2023-11-16T02:32:43.968 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sys/uuid.h... no 2023-11-16T02:32:44.006 INFO:teuthology.orchestra.run.smithi204.stdout:checking for uuid/uuid.h... yes 2023-11-16T02:32:44.064 INFO:teuthology.orchestra.run.smithi204.stdout:checking for uuid_compare... no 2023-11-16T02:32:44.113 INFO:teuthology.orchestra.run.smithi204.stdout:checking for uuid_compare in -luuid... yes 2023-11-16T02:32:44.153 INFO:teuthology.orchestra.run.smithi204.stdout:checking for pthread.h... yes 2023-11-16T02:32:44.202 INFO:teuthology.orchestra.run.smithi204.stdout:checking for pthread_mutex_init in -lpthread... yes 2023-11-16T02:32:44.246 INFO:teuthology.orchestra.run.smithi204.stdout:checking for urcu.h... yes 2023-11-16T02:32:44.284 INFO:teuthology.orchestra.run.smithi204.stdout:checking for liburcu... yes 2023-11-16T02:32:44.314 INFO:teuthology.orchestra.run.smithi204.stdout:checking for fadvise ... yes 2023-11-16T02:32:44.342 INFO:teuthology.orchestra.run.smithi204.stdout:checking for madvise ... yes 2023-11-16T02:32:44.370 INFO:teuthology.orchestra.run.smithi204.stdout:checking for mincore ... yes 2023-11-16T02:32:44.410 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sendfile ... yes 2023-11-16T02:32:44.441 INFO:teuthology.orchestra.run.smithi204.stdout:checking for getmntent ... yes 2023-11-16T02:32:44.493 INFO:teuthology.orchestra.run.smithi204.stdout:checking for fallocate... yes 2023-11-16T02:32:44.546 INFO:teuthology.orchestra.run.smithi204.stdout:checking for fiemap... yes 2023-11-16T02:32:44.605 INFO:teuthology.orchestra.run.smithi204.stdout:checking for pwritev2... yes 2023-11-16T02:32:44.663 INFO:teuthology.orchestra.run.smithi204.stdout:checking for preadv... yes 2023-11-16T02:32:44.719 INFO:teuthology.orchestra.run.smithi204.stdout:checking for copy_file_range... yes 2023-11-16T02:32:44.771 INFO:teuthology.orchestra.run.smithi204.stdout:checking for sync_file_range... yes 2023-11-16T02:32:44.826 INFO:teuthology.orchestra.run.smithi204.stdout:checking for syncfs... yes 2023-11-16T02:32:44.865 INFO:teuthology.orchestra.run.smithi204.stdout:checking for mntent.h... yes 2023-11-16T02:32:44.914 INFO:teuthology.orchestra.run.smithi204.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2023-11-16T02:32:44.949 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether fls is declared... no 2023-11-16T02:32:45.005 INFO:teuthology.orchestra.run.smithi204.stdout:checking for readdir... yes 2023-11-16T02:32:45.044 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether fsetxattr is declared... yes 2023-11-16T02:32:45.080 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether mremap is declared... yes 2023-11-16T02:32:45.132 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct fsxattr... yes 2023-11-16T02:32:45.160 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct fsxattr.fsx_cowextsize... yes 2023-11-16T02:32:45.212 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct fscrypt_add_key_arg... yes 2023-11-16T02:32:45.241 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct fscrypt_add_key_arg.key_id... yes 2023-11-16T02:32:45.305 INFO:teuthology.orchestra.run.smithi204.stdout:checking for GETFSMAP... yes 2023-11-16T02:32:45.358 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct statfs... yes 2023-11-16T02:32:45.386 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct statfs.f_flags... yes 2023-11-16T02:32:45.411 INFO:teuthology.orchestra.run.smithi204.stdout:checking for MAP_SYNC... yes 2023-11-16T02:32:45.525 INFO:teuthology.orchestra.run.smithi204.stdout:checking for library containing dm_task_create... -ldevmapper 2023-11-16T02:32:45.561 INFO:teuthology.orchestra.run.smithi204.stdout:checking for mallinfo ... yes 2023-11-16T02:32:45.594 INFO:teuthology.orchestra.run.smithi204.stdout:checking for mallinfo2 ... yes 2023-11-16T02:32:45.634 INFO:teuthology.orchestra.run.smithi204.stdout:checking for attr/attributes.h... yes 2023-11-16T02:32:45.662 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct attrlist_cursor... yes 2023-11-16T02:32:45.664 INFO:teuthology.orchestra.run.smithi204.stdout:checking for pkg-config... /usr/bin/pkg-config 2023-11-16T02:32:45.667 INFO:teuthology.orchestra.run.smithi204.stdout:checking pkg-config is at least version 0.9.0... yes 2023-11-16T02:32:45.679 INFO:teuthology.orchestra.run.smithi204.stdout:checking for icu-i18n... yes 2023-11-16T02:32:45.718 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether openat is declared... yes 2023-11-16T02:32:45.761 INFO:teuthology.orchestra.run.smithi204.stdout:checking whether fstatat is declared... yes 2023-11-16T02:32:45.799 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct sg_io_hdr ... yes 2023-11-16T02:32:45.829 INFO:teuthology.orchestra.run.smithi204.stdout:checking for struct hd_geometry ... yes 2023-11-16T02:32:45.844 INFO:teuthology.orchestra.run.smithi204.stdout:checking for systemd... yes 2023-11-16T02:32:45.847 INFO:teuthology.orchestra.run.smithi204.stdout:checking for systemd system unit dir... /lib/systemd/system 2023-11-16T02:32:45.848 INFO:teuthology.orchestra.run.smithi204.stdout:checking for system crontab dir... /etc/cron.d 2023-11-16T02:32:45.860 INFO:teuthology.orchestra.run.smithi204.stdout:checking for udev... yes 2023-11-16T02:32:45.863 INFO:teuthology.orchestra.run.smithi204.stdout:checking for udev rule dir... /lib/udev/rules.d 2023-11-16T02:32:45.972 INFO:teuthology.orchestra.run.smithi204.stdout:checking for library containing blkid_probe_all... -lblkid 2023-11-16T02:32:46.024 INFO:teuthology.orchestra.run.smithi204.stdout:checking for blkid_probe_get_topology... yes 2023-11-16T02:32:46.099 INFO:teuthology.orchestra.run.smithi204.stdout:checking size of long... 8 2023-11-16T02:32:46.172 INFO:teuthology.orchestra.run.smithi204.stdout:checking size of char *... 8 2023-11-16T02:32:46.195 INFO:teuthology.orchestra.run.smithi204.stdout:checking for umode_t... no 2023-11-16T02:32:46.261 INFO:teuthology.orchestra.run.smithi204.stdout:checking for atomic64_t support in liburcu... yes 2023-11-16T02:32:46.291 INFO:teuthology.orchestra.run.smithi204.stdout:configure: creating ./config.status 2023-11-16T02:32:47.145 INFO:teuthology.orchestra.run.smithi204.stdout:config.status: creating include/builddefs 2023-11-16T02:32:47.171 INFO:teuthology.orchestra.run.smithi204.stdout:config.status: creating include/platform_defs.h 2023-11-16T02:32:47.193 INFO:teuthology.orchestra.run.smithi204.stdout:config.status: executing libtool commands 2023-11-16T02:32:47.272 INFO:teuthology.orchestra.run.smithi204.stdout: [HEADERS] include 2023-11-16T02:32:47.297 INFO:teuthology.orchestra.run.smithi204.stdout: [HEADERS] libxfs 2023-11-16T02:32:47.332 INFO:teuthology.orchestra.run.smithi204.stdout:Building include 2023-11-16T02:32:47.341 INFO:teuthology.orchestra.run.smithi204.stdout: [LN] disk 2023-11-16T02:32:47.345 INFO:teuthology.orchestra.run.smithi204.stdout:Building libfrog 2023-11-16T02:32:47.351 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] gen_crc32table 2023-11-16T02:32:47.419 INFO:teuthology.orchestra.run.smithi204.stdout: [GENERATE] crc32table.h 2023-11-16T02:32:47.898 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] avl64.lo 2023-11-16T02:32:48.369 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] bitmap.lo 2023-11-16T02:32:48.713 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] bulkstat.lo 2023-11-16T02:32:49.104 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] convert.lo 2023-11-16T02:32:49.472 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] crc32.lo 2023-11-16T02:32:49.704 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fsgeom.lo 2023-11-16T02:32:50.036 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] list_sort.lo 2023-11-16T02:32:50.260 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] linux.lo 2023-11-16T02:32:50.607 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] logging.lo 2023-11-16T02:32:50.777 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] paths.lo 2023-11-16T02:32:51.218 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] projects.lo 2023-11-16T02:32:51.534 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] ptvar.lo 2023-11-16T02:32:51.801 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] radix-tree.lo 2023-11-16T02:32:52.328 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] randbytes.lo 2023-11-16T02:32:52.555 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] scrub.lo 2023-11-16T02:32:52.770 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] util.lo 2023-11-16T02:32:53.021 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] workqueue.lo 2023-11-16T02:32:53.314 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] libfrog.la 2023-11-16T02:32:53.435 INFO:teuthology.orchestra.run.smithi204.stdout:Building libxfs 2023-11-16T02:32:55.098 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] cache.lo 2023-11-16T02:32:55.646 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] defer_item.lo 2023-11-16T02:32:56.095 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] init.lo 2023-11-16T02:32:56.819 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] kmem.lo 2023-11-16T02:32:57.128 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] logitem.lo 2023-11-16T02:32:57.463 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] rdwr.lo 2023-11-16T02:32:58.324 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] topology.lo 2023-11-16T02:32:58.719 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] trans.lo 2023-11-16T02:32:59.248 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] util.lo 2023-11-16T02:32:59.776 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_ag.lo 2023-11-16T02:33:00.588 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_ag_resv.lo 2023-11-16T02:33:00.960 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_alloc.lo 2023-11-16T02:33:02.509 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_alloc_btree.lo 2023-11-16T02:33:03.005 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_attr.lo 2023-11-16T02:33:03.613 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_attr_leaf.lo 2023-11-16T02:33:05.022 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_attr_remote.lo 2023-11-16T02:33:05.253 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:33:05.259 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:33:05.263 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:33:05.579 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_bit.lo 2023-11-16T02:33:05.878 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_bmap.lo 2023-11-16T02:33:08.632 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_bmap_btree.lo 2023-11-16T02:33:09.166 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_btree.lo 2023-11-16T02:33:11.356 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_btree_staging.lo 2023-11-16T02:33:11.841 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_da_btree.lo 2023-11-16T02:33:13.146 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_defer.lo 2023-11-16T02:33:13.677 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_dir2.lo 2023-11-16T02:33:14.206 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_dir2_block.lo 2023-11-16T02:33:15.065 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_dir2_data.lo 2023-11-16T02:33:15.853 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_dir2_leaf.lo 2023-11-16T02:33:16.787 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_dir2_node.lo 2023-11-16T02:33:17.855 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_dir2_sf.lo 2023-11-16T02:33:18.659 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_dquot_buf.lo 2023-11-16T02:33:19.064 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_ialloc.lo 2023-11-16T02:33:20.369 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_iext_tree.lo 2023-11-16T02:33:21.112 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_inode_buf.lo 2023-11-16T02:33:21.771 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_inode_fork.lo 2023-11-16T02:33:22.414 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_ialloc_btree.lo 2023-11-16T02:33:22.957 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_log_rlimit.lo 2023-11-16T02:33:23.290 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_refcount.lo 2023-11-16T02:33:24.131 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_refcount_btree.lo 2023-11-16T02:33:24.604 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_rmap.lo 2023-11-16T02:33:25.807 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_rmap_btree.lo 2023-11-16T02:33:26.356 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_rtbitmap.lo 2023-11-16T02:33:27.001 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_sb.lo 2023-11-16T02:33:27.831 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_symlink_remote.lo 2023-11-16T02:33:28.208 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_trans_inode.lo 2023-11-16T02:33:28.519 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_trans_resv.lo 2023-11-16T02:33:29.097 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_types.lo 2023-11-16T02:33:29.472 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] libxfs.la 2023-11-16T02:33:29.689 INFO:teuthology.orchestra.run.smithi204.stdout:Building libxlog 2023-11-16T02:33:29.785 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_log_recover.lo 2023-11-16T02:33:30.627 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] util.lo 2023-11-16T02:33:31.016 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] libxlog.la 2023-11-16T02:33:31.120 INFO:teuthology.orchestra.run.smithi204.stdout:Building libxcmd 2023-11-16T02:33:31.252 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] command.lo 2023-11-16T02:33:31.608 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] input.lo 2023-11-16T02:33:31.928 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] help.lo 2023-11-16T02:33:32.187 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] quit.lo 2023-11-16T02:33:32.424 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] libxcmd.la 2023-11-16T02:33:32.527 INFO:teuthology.orchestra.run.smithi204.stdout:Building libhandle 2023-11-16T02:33:32.608 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] handle.lo 2023-11-16T02:33:32.995 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] jdm.lo 2023-11-16T02:33:33.291 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] libhandle.la 2023-11-16T02:33:33.433 INFO:teuthology.orchestra.run.smithi204.stdout:Building copy 2023-11-16T02:33:33.489 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_copy.o 2023-11-16T02:33:33.928 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] xfs_copy 2023-11-16T02:33:34.115 INFO:teuthology.orchestra.run.smithi204.stdout:Building db 2023-11-16T02:33:35.316 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:33:35.319 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:33:35.321 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:33:36.168 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] addr.o 2023-11-16T02:33:36.293 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] agf.o 2023-11-16T02:33:36.403 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] agfl.o 2023-11-16T02:33:36.512 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] agi.o 2023-11-16T02:33:36.625 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] attr.o 2023-11-16T02:33:36.841 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] attrshort.o 2023-11-16T02:33:36.969 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] bit.o 2023-11-16T02:33:37.106 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] block.o 2023-11-16T02:33:37.259 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] bmap.o 2023-11-16T02:33:37.463 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] btblock.o 2023-11-16T02:33:37.606 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] bmroot.o 2023-11-16T02:33:37.786 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] check.o 2023-11-16T02:33:39.626 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] command.o 2023-11-16T02:33:39.745 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] crc.o 2023-11-16T02:33:39.878 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] debug.o 2023-11-16T02:33:39.984 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dir2.o 2023-11-16T02:33:40.286 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dir2sf.o 2023-11-16T02:33:40.439 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dquot.o 2023-11-16T02:33:40.568 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] echo.o 2023-11-16T02:33:40.673 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] faddr.o 2023-11-16T02:33:40.872 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] field.o 2023-11-16T02:33:41.000 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] flist.o 2023-11-16T02:33:41.243 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fprint.o 2023-11-16T02:33:41.419 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] frag.o 2023-11-16T02:33:41.667 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] freesp.o 2023-11-16T02:33:41.877 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] hash.o 2023-11-16T02:33:41.958 INFO:teuthology.orchestra.run.smithi204.stderr:hash.c: In function 'hash_f': 2023-11-16T02:33:41.958 INFO:teuthology.orchestra.run.smithi204.stderr:hash.c:76:58: warning: pointer targets in passing argument 1 of 'libxfs_da_hashname' differ in signedness [-Wpointer-sign] 2023-11-16T02:33:41.959 INFO:teuthology.orchestra.run.smithi204.stderr: 76 | hashval = libxfs_da_hashname(argv[c], strlen(argv[c])); 2023-11-16T02:33:41.959 INFO:teuthology.orchestra.run.smithi204.stderr: | ~~~~^~~ 2023-11-16T02:33:41.959 INFO:teuthology.orchestra.run.smithi204.stderr: | | 2023-11-16T02:33:41.959 INFO:teuthology.orchestra.run.smithi204.stderr: | char * 2023-11-16T02:33:41.959 INFO:teuthology.orchestra.run.smithi204.stderr:In file included from ../include/libxfs.h:59, 2023-11-16T02:33:41.959 INFO:teuthology.orchestra.run.smithi204.stderr: from hash.c:7: 2023-11-16T02:33:41.959 INFO:teuthology.orchestra.run.smithi204.stderr:../libxfs/xfs_da_btree.h:223:37: note: expected 'const uint8_t *' {aka 'const unsigned char *'} but argument is of type 'char *' 2023-11-16T02:33:41.960 INFO:teuthology.orchestra.run.smithi204.stderr: 223 | uint xfs_da_hashname(const uint8_t *name_string, int name_length); 2023-11-16T02:33:41.960 INFO:teuthology.orchestra.run.smithi204.stderr: | ~~~~~~~~~~~~~~~^~~~~~~~~~~ 2023-11-16T02:33:41.963 INFO:teuthology.orchestra.run.smithi204.stderr:hash.c: In function 'collide_dirents': 2023-11-16T02:33:41.963 INFO:teuthology.orchestra.run.smithi204.stderr:hash.c:258:36: warning: pointer targets in passing argument 2 of 'openat' differ in signedness [-Wpointer-sign] 2023-11-16T02:33:41.963 INFO:teuthology.orchestra.run.smithi204.stderr: 258 | newfd = openat(fd, name, O_CREAT, 0600); 2023-11-16T02:33:41.963 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~ 2023-11-16T02:33:41.963 INFO:teuthology.orchestra.run.smithi204.stderr: | | 2023-11-16T02:33:41.963 INFO:teuthology.orchestra.run.smithi204.stderr: | const unsigned char * 2023-11-16T02:33:41.964 INFO:teuthology.orchestra.run.smithi204.stderr:In file included from /usr/include/fcntl.h:314, 2023-11-16T02:33:41.964 INFO:teuthology.orchestra.run.smithi204.stderr: from ../include/platform_defs.h:12, 2023-11-16T02:33:41.964 INFO:teuthology.orchestra.run.smithi204.stderr: from ../include/libxfs.h:11, 2023-11-16T02:33:41.964 INFO:teuthology.orchestra.run.smithi204.stderr: from hash.c:7: 2023-11-16T02:33:41.964 INFO:teuthology.orchestra.run.smithi204.stderr:/usr/include/x86_64-linux-gnu/bits/fcntl2.h:117:31: note: expected 'const char *' but argument is of type 'const unsigned char *' 2023-11-16T02:33:41.964 INFO:teuthology.orchestra.run.smithi204.stderr: 117 | openat (int __fd, const char *__path, int __oflag, ...) 2023-11-16T02:33:41.964 INFO:teuthology.orchestra.run.smithi204.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-11-16T02:33:41.964 INFO:teuthology.orchestra.run.smithi204.stderr:hash.c:273:25: warning: pointer targets in passing argument 1 of 'strncpy' differ in signedness [-Wpointer-sign] 2023-11-16T02:33:41.964 INFO:teuthology.orchestra.run.smithi204.stderr: 273 | strncpy(direntname, name, MAXNAMELEN); 2023-11-16T02:33:41.964 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~ 2023-11-16T02:33:41.964 INFO:teuthology.orchestra.run.smithi204.stderr: | | 2023-11-16T02:33:41.964 INFO:teuthology.orchestra.run.smithi204.stderr: | unsigned char * 2023-11-16T02:33:41.965 INFO:teuthology.orchestra.run.smithi204.stderr:In file included from /usr/include/features.h:486, 2023-11-16T02:33:41.965 INFO:teuthology.orchestra.run.smithi204.stderr: from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33, 2023-11-16T02:33:41.965 INFO:teuthology.orchestra.run.smithi204.stderr: from /usr/include/stdio.h:27, 2023-11-16T02:33:41.965 INFO:teuthology.orchestra.run.smithi204.stderr: from ../include/platform_defs.h:10, 2023-11-16T02:33:41.965 INFO:teuthology.orchestra.run.smithi204.stderr: from ../include/libxfs.h:11, 2023-11-16T02:33:41.965 INFO:teuthology.orchestra.run.smithi204.stderr: from hash.c:7: 2023-11-16T02:33:41.965 INFO:teuthology.orchestra.run.smithi204.stderr:/usr/include/x86_64-linux-gnu/bits/string_fortified.h:92:1: note: expected 'char * restrict' but argument is of type 'unsigned char *' 2023-11-16T02:33:41.965 INFO:teuthology.orchestra.run.smithi204.stderr: 92 | __NTH (strncpy (char *__restrict __dest, const char *__restrict __src, 2023-11-16T02:33:41.965 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~ 2023-11-16T02:33:41.965 INFO:teuthology.orchestra.run.smithi204.stderr:hash.c:273:37: warning: pointer targets in passing argument 2 of 'strncpy' differ in signedness [-Wpointer-sign] 2023-11-16T02:33:41.966 INFO:teuthology.orchestra.run.smithi204.stderr: 273 | strncpy(direntname, name, MAXNAMELEN); 2023-11-16T02:33:41.966 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~ 2023-11-16T02:33:41.966 INFO:teuthology.orchestra.run.smithi204.stderr: | | 2023-11-16T02:33:41.966 INFO:teuthology.orchestra.run.smithi204.stderr: | const unsigned char * 2023-11-16T02:33:41.966 INFO:teuthology.orchestra.run.smithi204.stderr:In file included from /usr/include/features.h:486, 2023-11-16T02:33:41.966 INFO:teuthology.orchestra.run.smithi204.stderr: from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33, 2023-11-16T02:33:41.966 INFO:teuthology.orchestra.run.smithi204.stderr: from /usr/include/stdio.h:27, 2023-11-16T02:33:41.966 INFO:teuthology.orchestra.run.smithi204.stderr: from ../include/platform_defs.h:10, 2023-11-16T02:33:41.966 INFO:teuthology.orchestra.run.smithi204.stderr: from ../include/libxfs.h:11, 2023-11-16T02:33:41.967 INFO:teuthology.orchestra.run.smithi204.stderr: from hash.c:7: 2023-11-16T02:33:41.967 INFO:teuthology.orchestra.run.smithi204.stderr:/usr/include/x86_64-linux-gnu/bits/string_fortified.h:92:1: note: expected 'const char * restrict' but argument is of type 'const unsigned char *' 2023-11-16T02:33:41.967 INFO:teuthology.orchestra.run.smithi204.stderr: 92 | __NTH (strncpy (char *__restrict __dest, const char *__restrict __src, 2023-11-16T02:33:41.967 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~ 2023-11-16T02:33:41.967 INFO:teuthology.orchestra.run.smithi204.stderr:hash.c:278:44: warning: pointer targets in passing argument 2 of 'linkat' differ in signedness [-Wpointer-sign] 2023-11-16T02:33:41.967 INFO:teuthology.orchestra.run.smithi204.stderr: 278 | error = linkat(fd, name, fd, direntname, 0); 2023-11-16T02:33:41.967 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~ 2023-11-16T02:33:41.967 INFO:teuthology.orchestra.run.smithi204.stderr: | | 2023-11-16T02:33:41.967 INFO:teuthology.orchestra.run.smithi204.stderr: | const unsigned char * 2023-11-16T02:33:41.968 INFO:teuthology.orchestra.run.smithi204.stderr:In file included from ../include/platform_defs.h:19, 2023-11-16T02:33:41.968 INFO:teuthology.orchestra.run.smithi204.stderr: from ../include/libxfs.h:11, 2023-11-16T02:33:41.968 INFO:teuthology.orchestra.run.smithi204.stderr: from hash.c:7: 2023-11-16T02:33:41.969 INFO:teuthology.orchestra.run.smithi204.stderr:/usr/include/unistd.h:825:46: note: expected 'const char *' but argument is of type 'const unsigned char *' 2023-11-16T02:33:41.969 INFO:teuthology.orchestra.run.smithi204.stderr: 825 | extern int linkat (int __fromfd, const char *__from, int __tofd, 2023-11-16T02:33:41.969 INFO:teuthology.orchestra.run.smithi204.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-11-16T02:33:41.969 INFO:teuthology.orchestra.run.smithi204.stderr:hash.c:278:54: warning: pointer targets in passing argument 4 of 'linkat' differ in signedness [-Wpointer-sign] 2023-11-16T02:33:41.969 INFO:teuthology.orchestra.run.smithi204.stderr: 278 | error = linkat(fd, name, fd, direntname, 0); 2023-11-16T02:33:41.969 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~~ 2023-11-16T02:33:41.969 INFO:teuthology.orchestra.run.smithi204.stderr: | | 2023-11-16T02:33:41.969 INFO:teuthology.orchestra.run.smithi204.stderr: | unsigned char * 2023-11-16T02:33:41.969 INFO:teuthology.orchestra.run.smithi204.stderr:In file included from ../include/platform_defs.h:19, 2023-11-16T02:33:41.969 INFO:teuthology.orchestra.run.smithi204.stderr: from ../include/libxfs.h:11, 2023-11-16T02:33:41.969 INFO:teuthology.orchestra.run.smithi204.stderr: from hash.c:7: 2023-11-16T02:33:41.969 INFO:teuthology.orchestra.run.smithi204.stderr:/usr/include/unistd.h:826:32: note: expected 'const char *' but argument is of type 'unsigned char *' 2023-11-16T02:33:41.970 INFO:teuthology.orchestra.run.smithi204.stderr: 826 | const char *__to, int __flags) 2023-11-16T02:33:41.970 INFO:teuthology.orchestra.run.smithi204.stderr: | ~~~~~~~~~~~~^~~~ 2023-11-16T02:33:41.970 INFO:teuthology.orchestra.run.smithi204.stderr:hash.c: In function 'collide_xattrs': 2023-11-16T02:33:41.970 INFO:teuthology.orchestra.run.smithi204.stderr:hash.c:318:26: warning: pointer targets in passing argument 1 of 'snprintf' differ in signedness [-Wpointer-sign] 2023-11-16T02:33:41.970 INFO:teuthology.orchestra.run.smithi204.stderr: 318 | snprintf(xattrname, MAXNAMELEN + 5, "user.%s", name); 2023-11-16T02:33:41.970 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~ 2023-11-16T02:33:41.970 INFO:teuthology.orchestra.run.smithi204.stderr: | | 2023-11-16T02:33:41.970 INFO:teuthology.orchestra.run.smithi204.stderr: | unsigned char * 2023-11-16T02:33:41.970 INFO:teuthology.orchestra.run.smithi204.stderr:In file included from /usr/include/features.h:486, 2023-11-16T02:33:41.971 INFO:teuthology.orchestra.run.smithi204.stderr: from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33, 2023-11-16T02:33:41.971 INFO:teuthology.orchestra.run.smithi204.stderr: from /usr/include/stdio.h:27, 2023-11-16T02:33:41.971 INFO:teuthology.orchestra.run.smithi204.stderr: from ../include/platform_defs.h:10, 2023-11-16T02:33:41.971 INFO:teuthology.orchestra.run.smithi204.stderr: from ../include/libxfs.h:11, 2023-11-16T02:33:41.971 INFO:teuthology.orchestra.run.smithi204.stderr: from hash.c:7: 2023-11-16T02:33:41.971 INFO:teuthology.orchestra.run.smithi204.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:68:1: note: expected 'char * restrict' but argument is of type 'unsigned char *' 2023-11-16T02:33:41.971 INFO:teuthology.orchestra.run.smithi204.stderr: 68 | __NTH (snprintf (char *__restrict __s, size_t __n, 2023-11-16T02:33:41.972 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~ 2023-11-16T02:33:41.972 INFO:teuthology.orchestra.run.smithi204.stderr:hash.c:319:39: warning: pointer targets in passing argument 2 of 'fsetxattr' differ in signedness [-Wpointer-sign] 2023-11-16T02:33:41.972 INFO:teuthology.orchestra.run.smithi204.stderr: 319 | error = fsetxattr(fd, xattrname, "1", 1, 0); 2023-11-16T02:33:41.972 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~ 2023-11-16T02:33:41.972 INFO:teuthology.orchestra.run.smithi204.stderr: | | 2023-11-16T02:33:41.972 INFO:teuthology.orchestra.run.smithi204.stderr: | unsigned char * 2023-11-16T02:33:41.972 INFO:teuthology.orchestra.run.smithi204.stderr:In file included from hash.c:16: 2023-11-16T02:33:41.972 INFO:teuthology.orchestra.run.smithi204.stderr:/usr/include/x86_64-linux-gnu/sys/xattr.h:54:45: note: expected 'const char *' but argument is of type 'unsigned char *' 2023-11-16T02:33:41.972 INFO:teuthology.orchestra.run.smithi204.stderr: 54 | extern int fsetxattr (int __fd, const char *__name, const void *__value, 2023-11-16T02:33:41.972 INFO:teuthology.orchestra.run.smithi204.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-11-16T02:33:41.972 INFO:teuthology.orchestra.run.smithi204.stderr:hash.c:332:26: warning: pointer targets in passing argument 1 of 'snprintf' differ in signedness [-Wpointer-sign] 2023-11-16T02:33:41.973 INFO:teuthology.orchestra.run.smithi204.stderr: 332 | snprintf(xattrname, MAXNAMELEN + 5, "user.%s", name); 2023-11-16T02:33:41.973 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~ 2023-11-16T02:33:41.973 INFO:teuthology.orchestra.run.smithi204.stderr: | | 2023-11-16T02:33:41.973 INFO:teuthology.orchestra.run.smithi204.stderr: | unsigned char * 2023-11-16T02:33:41.973 INFO:teuthology.orchestra.run.smithi204.stderr:In file included from /usr/include/features.h:486, 2023-11-16T02:33:41.973 INFO:teuthology.orchestra.run.smithi204.stderr: from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33, 2023-11-16T02:33:41.973 INFO:teuthology.orchestra.run.smithi204.stderr: from /usr/include/stdio.h:27, 2023-11-16T02:33:41.973 INFO:teuthology.orchestra.run.smithi204.stderr: from ../include/platform_defs.h:10, 2023-11-16T02:33:41.973 INFO:teuthology.orchestra.run.smithi204.stderr: from ../include/libxfs.h:11, 2023-11-16T02:33:41.973 INFO:teuthology.orchestra.run.smithi204.stderr: from hash.c:7: 2023-11-16T02:33:41.974 INFO:teuthology.orchestra.run.smithi204.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:68:1: note: expected 'char * restrict' but argument is of type 'unsigned char *' 2023-11-16T02:33:41.974 INFO:teuthology.orchestra.run.smithi204.stderr: 68 | __NTH (snprintf (char *__restrict __s, size_t __n, 2023-11-16T02:33:41.974 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~ 2023-11-16T02:33:41.974 INFO:teuthology.orchestra.run.smithi204.stderr:hash.c:337:47: warning: pointer targets in passing argument 2 of 'fsetxattr' differ in signedness [-Wpointer-sign] 2023-11-16T02:33:41.974 INFO:teuthology.orchestra.run.smithi204.stderr: 337 | error = fsetxattr(fd, xattrname, "1", 1, 0); 2023-11-16T02:33:41.974 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~~~~~~~ 2023-11-16T02:33:41.974 INFO:teuthology.orchestra.run.smithi204.stderr: | | 2023-11-16T02:33:41.974 INFO:teuthology.orchestra.run.smithi204.stderr: | unsigned char * 2023-11-16T02:33:41.974 INFO:teuthology.orchestra.run.smithi204.stderr:In file included from hash.c:16: 2023-11-16T02:33:41.974 INFO:teuthology.orchestra.run.smithi204.stderr:/usr/include/x86_64-linux-gnu/sys/xattr.h:54:45: note: expected 'const char *' but argument is of type 'unsigned char *' 2023-11-16T02:33:41.974 INFO:teuthology.orchestra.run.smithi204.stderr: 54 | extern int fsetxattr (int __fd, const char *__name, const void *__value, 2023-11-16T02:33:41.974 INFO:teuthology.orchestra.run.smithi204.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-11-16T02:33:41.975 INFO:teuthology.orchestra.run.smithi204.stderr:hash.c: In function 'hashcoll_f': 2023-11-16T02:33:41.975 INFO:teuthology.orchestra.run.smithi204.stderr:hash.c:417:52: warning: pointer targets in passing argument 2 of 'collide_xattrs' differ in signedness [-Wpointer-sign] 2023-11-16T02:33:41.975 INFO:teuthology.orchestra.run.smithi204.stderr: 417 | error = collide_xattrs(nr, buf, len, fd); 2023-11-16T02:33:41.975 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~ 2023-11-16T02:33:41.975 INFO:teuthology.orchestra.run.smithi204.stderr: | | 2023-11-16T02:33:41.975 INFO:teuthology.orchestra.run.smithi204.stderr: | char * 2023-11-16T02:33:41.975 INFO:teuthology.orchestra.run.smithi204.stderr:hash.c:300:34: note: expected 'const unsigned char *' but argument is of type 'char *' 2023-11-16T02:33:41.975 INFO:teuthology.orchestra.run.smithi204.stderr: 300 | const unsigned char *name, 2023-11-16T02:33:41.975 INFO:teuthology.orchestra.run.smithi204.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-11-16T02:33:41.975 INFO:teuthology.orchestra.run.smithi204.stderr:hash.c:419:53: warning: pointer targets in passing argument 2 of 'collide_dirents' differ in signedness [-Wpointer-sign] 2023-11-16T02:33:41.975 INFO:teuthology.orchestra.run.smithi204.stderr: 419 | error = collide_dirents(nr, buf, len, fd); 2023-11-16T02:33:41.975 INFO:teuthology.orchestra.run.smithi204.stderr: | ^~~ 2023-11-16T02:33:41.976 INFO:teuthology.orchestra.run.smithi204.stderr: | | 2023-11-16T02:33:41.976 INFO:teuthology.orchestra.run.smithi204.stderr: | char * 2023-11-16T02:33:41.976 INFO:teuthology.orchestra.run.smithi204.stderr:hash.c:234:34: note: expected 'const unsigned char *' but argument is of type 'char *' 2023-11-16T02:33:41.976 INFO:teuthology.orchestra.run.smithi204.stderr: 234 | const unsigned char *name, 2023-11-16T02:33:41.976 INFO:teuthology.orchestra.run.smithi204.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-11-16T02:33:41.976 INFO:teuthology.orchestra.run.smithi204.stderr:hash.c:431:56: warning: pointer targets in passing argument 2 of 'collide_xattrs' differ in signedness [-Wpointer-sign] 2023-11-16T02:33:41.976 INFO:teuthology.orchestra.run.smithi204.stderr: 431 | error = collide_xattrs(nr, argv[c], len, fd); 2023-11-16T02:33:41.976 INFO:teuthology.orchestra.run.smithi204.stderr: | ~~~~^~~ 2023-11-16T02:33:41.976 INFO:teuthology.orchestra.run.smithi204.stderr: | | 2023-11-16T02:33:41.976 INFO:teuthology.orchestra.run.smithi204.stderr: | char * 2023-11-16T02:33:41.977 INFO:teuthology.orchestra.run.smithi204.stderr:hash.c:300:34: note: expected 'const unsigned char *' but argument is of type 'char *' 2023-11-16T02:33:41.977 INFO:teuthology.orchestra.run.smithi204.stderr: 300 | const unsigned char *name, 2023-11-16T02:33:41.977 INFO:teuthology.orchestra.run.smithi204.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-11-16T02:33:41.977 INFO:teuthology.orchestra.run.smithi204.stderr:hash.c:433:57: warning: pointer targets in passing argument 2 of 'collide_dirents' differ in signedness [-Wpointer-sign] 2023-11-16T02:33:41.977 INFO:teuthology.orchestra.run.smithi204.stderr: 433 | error = collide_dirents(nr, argv[c], len, fd); 2023-11-16T02:33:41.977 INFO:teuthology.orchestra.run.smithi204.stderr: | ~~~~^~~ 2023-11-16T02:33:41.977 INFO:teuthology.orchestra.run.smithi204.stderr: | | 2023-11-16T02:33:41.977 INFO:teuthology.orchestra.run.smithi204.stderr: | char * 2023-11-16T02:33:41.977 INFO:teuthology.orchestra.run.smithi204.stderr:hash.c:234:34: note: expected 'const unsigned char *' but argument is of type 'char *' 2023-11-16T02:33:41.977 INFO:teuthology.orchestra.run.smithi204.stderr: 234 | const unsigned char *name, 2023-11-16T02:33:41.977 INFO:teuthology.orchestra.run.smithi204.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-11-16T02:33:42.063 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] help.o 2023-11-16T02:33:42.175 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] init.o 2023-11-16T02:33:42.319 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] inode.o 2023-11-16T02:33:42.606 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] input.o 2023-11-16T02:33:42.758 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] io.o 2023-11-16T02:33:42.976 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] logformat.o 2023-11-16T02:33:43.107 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] malloc.o 2023-11-16T02:33:43.214 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] metadump.o 2023-11-16T02:33:44.038 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] output.o 2023-11-16T02:33:44.158 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] print.o 2023-11-16T02:33:44.323 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] quit.o 2023-11-16T02:33:44.424 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] sb.o 2023-11-16T02:33:44.686 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] sig.o 2023-11-16T02:33:44.792 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] strvec.o 2023-11-16T02:33:44.903 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] text.o 2023-11-16T02:33:45.021 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] type.o 2023-11-16T02:33:45.154 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] write.o 2023-11-16T02:33:45.404 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] attrset.o 2023-11-16T02:33:45.537 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] symlink.o 2023-11-16T02:33:45.651 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fsmap.o 2023-11-16T02:33:45.782 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fuzz.o 2023-11-16T02:33:45.961 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] obfuscate.o 2023-11-16T02:33:46.117 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] btdump.o 2023-11-16T02:33:46.308 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] btheight.o 2023-11-16T02:33:46.490 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] convert.o 2023-11-16T02:33:46.647 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] info.o 2023-11-16T02:33:46.779 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] iunlink.o 2023-11-16T02:33:46.968 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] namei.o 2023-11-16T02:33:47.182 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] timelimit.o 2023-11-16T02:33:47.306 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] xfs_db 2023-11-16T02:33:47.554 INFO:teuthology.orchestra.run.smithi204.stdout:Building estimate 2023-11-16T02:33:47.610 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_estimate.o 2023-11-16T02:33:47.757 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] xfs_estimate 2023-11-16T02:33:47.844 INFO:teuthology.orchestra.run.smithi204.stdout:Building fsck 2023-11-16T02:33:47.850 INFO:teuthology.orchestra.run.smithi204.stdout:Building fsr 2023-11-16T02:33:47.907 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_fsr.o 2023-11-16T02:33:48.341 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] xfs_fsr 2023-11-16T02:33:48.467 INFO:teuthology.orchestra.run.smithi204.stdout:Building growfs 2023-11-16T02:33:48.524 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_growfs.o 2023-11-16T02:33:48.703 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] xfs_growfs 2023-11-16T02:33:48.890 INFO:teuthology.orchestra.run.smithi204.stdout:Building io 2023-11-16T02:33:50.275 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] init.o 2023-11-16T02:33:50.393 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] attr.o 2023-11-16T02:33:50.536 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] bmap.o 2023-11-16T02:33:50.718 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] bulkstat.o 2023-11-16T02:33:50.878 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] crc32cselftest.o 2023-11-16T02:33:50.964 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] cowextsize.o 2023-11-16T02:33:51.073 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] encrypt.o 2023-11-16T02:33:51.295 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] file.o 2023-11-16T02:33:51.400 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] freeze.o 2023-11-16T02:33:51.489 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fsuuid.o 2023-11-16T02:33:51.596 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fsync.o 2023-11-16T02:33:51.675 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] getrusage.o 2023-11-16T02:33:51.769 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] imap.o 2023-11-16T02:33:51.857 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] inject.o 2023-11-16T02:33:51.954 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] label.o 2023-11-16T02:33:52.069 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] link.o 2023-11-16T02:33:52.149 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] mmap.o 2023-11-16T02:33:52.362 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] open.o 2023-11-16T02:33:52.647 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] parent.o 2023-11-16T02:33:52.812 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] pread.o 2023-11-16T02:33:52.985 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] prealloc.o 2023-11-16T02:33:53.125 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] pwrite.o 2023-11-16T02:33:53.279 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] reflink.o 2023-11-16T02:33:53.407 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] resblks.o 2023-11-16T02:33:53.490 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] scrub.o 2023-11-16T02:33:53.620 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] seek.o 2023-11-16T02:33:53.726 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] shutdown.o 2023-11-16T02:33:53.808 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] stat.o 2023-11-16T02:33:54.009 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] swapext.o 2023-11-16T02:33:54.095 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] sync.o 2023-11-16T02:33:54.171 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] truncate.o 2023-11-16T02:33:54.252 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] utimes.o 2023-11-16T02:33:54.334 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fadvise.o 2023-11-16T02:33:54.424 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] madvise.o 2023-11-16T02:33:54.515 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] mincore.o 2023-11-16T02:33:54.610 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] sendfile.o 2023-11-16T02:33:54.712 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fiemap.o 2023-11-16T02:33:54.867 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] copy_file_range.o 2023-11-16T02:33:54.967 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] sync_file_range.o 2023-11-16T02:33:55.056 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] readdir.o 2023-11-16T02:33:55.157 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] log_writes.o 2023-11-16T02:33:55.246 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fsmap.o 2023-11-16T02:33:55.476 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] xfs_io 2023-11-16T02:33:55.662 INFO:teuthology.orchestra.run.smithi204.stdout:Building logprint 2023-11-16T02:33:55.940 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] logprint.o 2023-11-16T02:33:56.080 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] log_copy.o 2023-11-16T02:33:56.195 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] log_dump.o 2023-11-16T02:33:56.323 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] log_misc.o 2023-11-16T02:33:56.843 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] log_print_all.o 2023-11-16T02:33:57.100 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] log_print_trans.o 2023-11-16T02:33:57.213 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] log_redo.o 2023-11-16T02:33:57.472 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] xfs_logprint 2023-11-16T02:33:57.663 INFO:teuthology.orchestra.run.smithi204.stdout:Building mkfs 2023-11-16T02:33:57.758 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] proto.o 2023-11-16T02:33:58.041 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_mkfs.o 2023-11-16T02:33:58.795 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] mkfs.xfs 2023-11-16T02:33:58.989 INFO:teuthology.orchestra.run.smithi204.stdout:Building quota 2023-11-16T02:33:59.378 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] init.o 2023-11-16T02:33:59.478 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] util.o 2023-11-16T02:33:59.642 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] edit.o 2023-11-16T02:33:59.843 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] free.o 2023-11-16T02:33:59.994 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] linux.o 2023-11-16T02:34:00.069 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] path.o 2023-11-16T02:34:00.181 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] project.o 2023-11-16T02:34:00.328 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] quot.o 2023-11-16T02:34:00.485 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] quota.o 2023-11-16T02:34:00.655 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] report.o 2023-11-16T02:34:00.884 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] state.o 2023-11-16T02:34:01.061 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] xfs_quota 2023-11-16T02:34:01.193 INFO:teuthology.orchestra.run.smithi204.stdout:Building mdrestore 2023-11-16T02:34:01.250 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_mdrestore.o 2023-11-16T02:34:01.412 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] xfs_mdrestore 2023-11-16T02:34:01.582 INFO:teuthology.orchestra.run.smithi204.stdout:Building repair 2023-11-16T02:34:02.907 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] agheader.o 2023-11-16T02:34:03.123 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] agbtree.o 2023-11-16T02:34:03.363 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] attr_repair.o 2023-11-16T02:34:03.722 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] avl.o 2023-11-16T02:34:03.933 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] bulkload.o 2023-11-16T02:34:04.049 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] bmap.o 2023-11-16T02:34:04.194 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] btree.o 2023-11-16T02:34:04.537 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] da_util.o 2023-11-16T02:34:04.763 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dino_chunks.o 2023-11-16T02:34:05.136 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dinode.o 2023-11-16T02:34:05.376 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:34:05.379 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:34:05.381 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:34:05.865 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] dir2.o 2023-11-16T02:34:06.282 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] globals.o 2023-11-16T02:34:06.377 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] incore_bmc.o 2023-11-16T02:34:06.476 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] incore.o 2023-11-16T02:34:06.627 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] incore_ext.o 2023-11-16T02:34:06.843 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] incore_ino.o 2023-11-16T02:34:07.115 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] init.o 2023-11-16T02:34:07.254 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase1.o 2023-11-16T02:34:07.376 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase2.o 2023-11-16T02:34:07.570 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase3.o 2023-11-16T02:34:07.714 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase4.o 2023-11-16T02:34:07.898 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase5.o 2023-11-16T02:34:08.158 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase6.o 2023-11-16T02:34:09.017 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase7.o 2023-11-16T02:34:09.157 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] prefetch.o 2023-11-16T02:34:09.497 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] progress.o 2023-11-16T02:34:09.707 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] quotacheck.o 2023-11-16T02:34:09.921 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] rmap.o 2023-11-16T02:34:10.320 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] rt.o 2023-11-16T02:34:10.484 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] sb.o 2023-11-16T02:34:10.705 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] scan.o 2023-11-16T02:34:11.473 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] slab.o 2023-11-16T02:34:11.633 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] threads.o 2023-11-16T02:34:11.746 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] versions.o 2023-11-16T02:34:11.869 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_repair.o 2023-11-16T02:34:12.182 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] xfs_repair 2023-11-16T02:34:12.432 INFO:teuthology.orchestra.run.smithi204.stdout:Building rtcp 2023-11-16T02:34:12.487 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_rtcp.o 2023-11-16T02:34:12.671 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] xfs_rtcp 2023-11-16T02:34:12.772 INFO:teuthology.orchestra.run.smithi204.stdout:Building m4 2023-11-16T02:34:12.779 INFO:teuthology.orchestra.run.smithi204.stdout:Building man 2023-11-16T02:34:12.788 INFO:teuthology.orchestra.run.smithi204.stdout:Building man2 2023-11-16T02:34:12.798 INFO:teuthology.orchestra.run.smithi204.stdout:Building man3 2023-11-16T02:34:12.807 INFO:teuthology.orchestra.run.smithi204.stdout:Building man5 2023-11-16T02:34:12.815 INFO:teuthology.orchestra.run.smithi204.stdout:Building man8 2023-11-16T02:34:12.833 INFO:teuthology.orchestra.run.smithi204.stdout: [SED] mkfs.xfs.8 2023-11-16T02:34:12.840 INFO:teuthology.orchestra.run.smithi204.stdout:Building doc 2023-11-16T02:34:12.850 INFO:teuthology.orchestra.run.smithi204.stdout: [ZIP] CHANGES.gz 2023-11-16T02:34:12.861 INFO:teuthology.orchestra.run.smithi204.stdout:Building debian 2023-11-16T02:34:12.867 INFO:teuthology.orchestra.run.smithi204.stdout:Building spaceman 2023-11-16T02:34:13.149 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] info.o 2023-11-16T02:34:13.252 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] init.o 2023-11-16T02:34:13.376 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] file.o 2023-11-16T02:34:13.501 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] health.o 2023-11-16T02:34:13.669 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] prealloc.o 2023-11-16T02:34:13.789 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] trim.o 2023-11-16T02:34:13.910 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] freesp.o 2023-11-16T02:34:14.093 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] xfs_spaceman 2023-11-16T02:34:14.221 INFO:teuthology.orchestra.run.smithi204.stdout:Building scrub 2023-11-16T02:34:14.942 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] common.o 2023-11-16T02:34:15.085 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] counter.o 2023-11-16T02:34:15.157 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] descr.o 2023-11-16T02:34:15.243 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] disk.o 2023-11-16T02:34:15.366 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] filemap.o 2023-11-16T02:34:15.459 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] fscounters.o 2023-11-16T02:34:15.558 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] inodes.o 2023-11-16T02:34:15.708 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase1.o 2023-11-16T02:34:15.819 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase2.o 2023-11-16T02:34:15.927 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase3.o 2023-11-16T02:34:16.046 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase4.o 2023-11-16T02:34:16.145 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase5.o 2023-11-16T02:34:16.297 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase6.o 2023-11-16T02:34:16.479 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] phase7.o 2023-11-16T02:34:16.602 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] progress.o 2023-11-16T02:34:16.713 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] read_verify.o 2023-11-16T02:34:16.839 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] repair.o 2023-11-16T02:34:16.967 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] scrub.o 2023-11-16T02:34:17.184 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] spacemap.o 2023-11-16T02:34:17.304 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] vfs.o 2023-11-16T02:34:17.427 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] xfs_scrub.o 2023-11-16T02:34:17.625 INFO:teuthology.orchestra.run.smithi204.stdout: [CC] unicrash.o 2023-11-16T02:34:17.802 INFO:teuthology.orchestra.run.smithi204.stdout: [LD] xfs_scrub 2023-11-16T02:34:18.004 INFO:teuthology.orchestra.run.smithi204.stdout: [SED] xfs_scrub_all 2023-11-16T02:34:18.013 INFO:teuthology.orchestra.run.smithi204.stdout: [SED] xfs_scrub@.service 2023-11-16T02:34:18.019 INFO:teuthology.orchestra.run.smithi204.stdout: [SED] xfs_scrub_all.service 2023-11-16T02:34:18.026 INFO:teuthology.orchestra.run.smithi204.stdout: [SED] xfs_scrub_fail@.service 2023-11-16T02:34:18.032 INFO:teuthology.orchestra.run.smithi204.stdout: [SED] xfs_scrub_all.cron 2023-11-16T02:34:18.038 INFO:teuthology.orchestra.run.smithi204.stdout:Building po 2023-11-16T02:34:18.065 INFO:teuthology.orchestra.run.smithi204.stdout: [GETTXT] xfsprogs.pot 2023-11-16T02:34:18.307 INFO:teuthology.orchestra.run.smithi204.stdout: [MSGFMT] de.mo 2023-11-16T02:34:18.342 INFO:teuthology.orchestra.run.smithi204.stderr:2345 translated messages. 2023-11-16T02:34:18.345 INFO:teuthology.orchestra.run.smithi204.stdout: [MSGFMT] pl.mo 2023-11-16T02:34:18.391 INFO:teuthology.orchestra.run.smithi204.stderr:3104 translated messages. 2023-11-16T02:34:18.391 INFO:teuthology.orchestra.run.smithi204.stdout:gmake[2]: Nothing to be done for 'include'. 2023-11-16T02:34:18.396 DEBUG:teuthology.orchestra.run.smithi204:> (cd /tmp/tmp.ja3gF9tsUCxfsprogs-dev && exec sudo make install) 2023-11-16T02:34:18.428 INFO:teuthology.orchestra.run.smithi204.stdout:Installing libfrog-install 2023-11-16T02:34:18.868 INFO:teuthology.orchestra.run.smithi204.stdout:Installing libxfs-install 2023-11-16T02:34:20.523 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-11-16T02:34:20.545 INFO:teuthology.orchestra.run.smithi204.stdout:Installing libxlog-install 2023-11-16T02:34:20.635 INFO:teuthology.orchestra.run.smithi204.stdout:Installing libxcmd-install 2023-11-16T02:34:20.768 INFO:teuthology.orchestra.run.smithi204.stdout:Installing libhandle-install 2023-11-16T02:34:20.845 INFO:teuthology.orchestra.run.smithi204.stdout:cd ../libhandle/.libs; ../../install-sh -o root -g root -m 755 -d /lib; ../../install-sh -o root -g root -m 755 -T so_dot_version libhandle.lai /lib; ../../install-sh -o root -g root -T so_dot_current libhandle.lai /lib 2023-11-16T02:34:20.911 INFO:teuthology.orchestra.run.smithi204.stdout:Installing copy-install 2023-11-16T02:34:20.962 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-16T02:34:20.982 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_copy /usr/sbin 2023-11-16T02:34:21.038 INFO:teuthology.orchestra.run.smithi204.stdout:Installing db-install 2023-11-16T02:34:23.081 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-16T02:34:23.101 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_db /usr/sbin 2023-11-16T02:34:23.156 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 xfs_admin.sh /usr/sbin/xfs_admin 2023-11-16T02:34:23.177 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 xfs_ncheck.sh /usr/sbin/xfs_ncheck 2023-11-16T02:34:23.197 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 xfs_metadump.sh /usr/sbin/xfs_metadump 2023-11-16T02:34:23.219 INFO:teuthology.orchestra.run.smithi204.stdout:Installing estimate-install 2023-11-16T02:34:23.270 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-16T02:34:23.290 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_estimate /usr/sbin 2023-11-16T02:34:23.338 INFO:teuthology.orchestra.run.smithi204.stdout:Installing fsck-install 2023-11-16T02:34:23.342 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-11-16T02:34:23.363 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 xfs_fsck.sh /sbin/fsck.xfs 2023-11-16T02:34:23.384 INFO:teuthology.orchestra.run.smithi204.stdout:Installing fsr-install 2023-11-16T02:34:23.438 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-16T02:34:23.457 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_fsr /usr/sbin 2023-11-16T02:34:23.506 INFO:teuthology.orchestra.run.smithi204.stdout:Installing growfs-install 2023-11-16T02:34:23.557 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-16T02:34:23.577 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_growfs /usr/sbin 2023-11-16T02:34:23.632 INFO:teuthology.orchestra.run.smithi204.stdout:Installing io-install 2023-11-16T02:34:25.010 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-16T02:34:26.662 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_io /usr/sbin 2023-11-16T02:34:26.700 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_bmap.sh /usr/sbin/xfs_bmap 2023-11-16T02:34:26.700 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_freeze.sh /usr/sbin/xfs_freeze 2023-11-16T02:34:26.700 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mkfile.sh /usr/sbin/xfs_mkfile 2023-11-16T02:34:26.701 INFO:teuthology.orchestra.run.smithi204.stdout:Installing logprint-install 2023-11-16T02:34:26.701 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-16T02:34:26.701 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_logprint /usr/sbin 2023-11-16T02:34:26.701 INFO:teuthology.orchestra.run.smithi204.stdout:Installing mkfs-install 2023-11-16T02:34:26.701 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-11-16T02:34:26.701 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 mkfs.xfs /sbin 2023-11-16T02:34:26.701 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/share/xfsprogs/mkfs 2023-11-16T02:34:26.701 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 644 dax_x86_64.conf lts_4.19.conf lts_5.4.conf lts_5.10.conf lts_5.15.conf lts_6.1.conf lts_6.6.conf /usr/share/xfsprogs/mkfs 2023-11-16T02:34:26.701 INFO:teuthology.orchestra.run.smithi204.stdout:Installing quota-install 2023-11-16T02:34:26.701 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-16T02:34:26.701 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_quota /usr/sbin 2023-11-16T02:34:26.702 INFO:teuthology.orchestra.run.smithi204.stdout:Installing mdrestore-install 2023-11-16T02:34:26.702 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-16T02:34:26.702 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mdrestore /usr/sbin 2023-11-16T02:34:26.702 INFO:teuthology.orchestra.run.smithi204.stdout:Installing repair-install 2023-11-16T02:34:27.679 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-11-16T02:34:27.699 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_repair /sbin 2023-11-16T02:34:27.756 INFO:teuthology.orchestra.run.smithi204.stdout:Installing rtcp-install 2023-11-16T02:34:27.808 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-16T02:34:27.829 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_rtcp /usr/sbin 2023-11-16T02:34:27.877 INFO:teuthology.orchestra.run.smithi204.stdout:Installing m4-install 2023-11-16T02:34:27.882 INFO:teuthology.orchestra.run.smithi204.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-16T02:34:27.883 INFO:teuthology.orchestra.run.smithi204.stdout:Installing man-install 2023-11-16T02:34:27.894 INFO:teuthology.orchestra.run.smithi204.stdout:gmake[2]: Nothing to be done for 'install'. 2023-11-16T02:34:27.899 INFO:teuthology.orchestra.run.smithi204.stdout:gmake[2]: Nothing to be done for 'install'. 2023-11-16T02:34:27.908 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man5 2023-11-16T02:34:27.933 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 projects.5 /usr/share/man/man5/projects.5 2023-11-16T02:34:27.957 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 projid.5 /usr/share/man/man5/projid.5 2023-11-16T02:34:27.982 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs.5 /usr/share/man/man5/xfs.5 2023-11-16T02:34:28.011 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man8 2023-11-16T02:34:28.037 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 fsck.xfs.8 /usr/share/man/man8/fsck.xfs.8 2023-11-16T02:34:28.063 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-11-16T02:34:28.084 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_admin.8 /usr/share/man/man8/xfs_admin.8 2023-11-16T02:34:28.110 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_bmap.8 /usr/share/man/man8/xfs_bmap.8 2023-11-16T02:34:28.133 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_copy.8 /usr/share/man/man8/xfs_copy.8 2023-11-16T02:34:28.156 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_db.8 /usr/share/man/man8/xfs_db.8 2023-11-16T02:34:28.180 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_estimate.8 /usr/share/man/man8/xfs_estimate.8 2023-11-16T02:34:28.204 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_freeze.8 /usr/share/man/man8/xfs_freeze.8 2023-11-16T02:34:28.227 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_fsr.8 /usr/share/man/man8/xfs_fsr.8 2023-11-16T02:34:28.251 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_growfs.8 /usr/share/man/man8/xfs_growfs.8 2023-11-16T02:34:28.274 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_info.8 /usr/share/man/man8/xfs_info.8 2023-11-16T02:34:28.298 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_io.8 /usr/share/man/man8/xfs_io.8 2023-11-16T02:34:28.322 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_logprint.8 /usr/share/man/man8/xfs_logprint.8 2023-11-16T02:34:28.346 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_mdrestore.8 /usr/share/man/man8/xfs_mdrestore.8 2023-11-16T02:34:28.369 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_metadump.8 /usr/share/man/man8/xfs_metadump.8 2023-11-16T02:34:28.393 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_mkfile.8 /usr/share/man/man8/xfs_mkfile.8 2023-11-16T02:34:28.416 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_ncheck.8 /usr/share/man/man8/xfs_ncheck.8 2023-11-16T02:34:28.441 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_quota.8 /usr/share/man/man8/xfs_quota.8 2023-11-16T02:34:28.465 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_repair.8 /usr/share/man/man8/xfs_repair.8 2023-11-16T02:34:28.489 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_rtcp.8 /usr/share/man/man8/xfs_rtcp.8 2023-11-16T02:34:28.511 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_scrub.8 /usr/share/man/man8/xfs_scrub.8 2023-11-16T02:34:28.535 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_scrub_all.8 /usr/share/man/man8/xfs_scrub_all.8 2023-11-16T02:34:28.559 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 xfs_spaceman.8 /usr/share/man/man8/xfs_spaceman.8 2023-11-16T02:34:28.582 INFO:teuthology.orchestra.run.smithi204.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-11-16T02:34:28.604 INFO:teuthology.orchestra.run.smithi204.stdout:Installing doc-install 2023-11-16T02:34:28.608 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-11-16T02:34:28.628 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 644 CHANGES.gz CREDITS /usr/share/doc/xfsprogs 2023-11-16T02:34:28.667 INFO:teuthology.orchestra.run.smithi204.stdout:Installing debian-install 2023-11-16T02:34:28.671 INFO:teuthology.orchestra.run.smithi204.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-16T02:34:28.672 INFO:teuthology.orchestra.run.smithi204.stdout:Installing spaceman-install 2023-11-16T02:34:28.948 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-16T02:34:28.968 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_spaceman /usr/sbin 2023-11-16T02:34:29.015 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 xfs_info.sh /usr/sbin/xfs_info 2023-11-16T02:34:29.037 INFO:teuthology.orchestra.run.smithi204.stdout:Installing scrub-install 2023-11-16T02:34:29.750 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-16T02:34:29.772 INFO:teuthology.orchestra.run.smithi204.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_scrub /usr/sbin 2023-11-16T02:34:29.819 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 xfs_scrub_all /usr/sbin 2023-11-16T02:34:29.839 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /lib/systemd/system 2023-11-16T02:34:29.859 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 644 xfs_scrub@.service xfs_scrub_all.service xfs_scrub_all.timer xfs_scrub_fail@.service /lib/systemd/system 2023-11-16T02:34:29.896 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/xfsprogs 2023-11-16T02:34:29.918 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 xfs_scrub_fail /usr/lib/xfsprogs 2023-11-16T02:34:29.937 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/xfsprogs 2023-11-16T02:34:29.957 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 644 xfs_scrub_all.cron /usr/lib/xfsprogs 2023-11-16T02:34:29.980 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /lib/udev/rules.d 2023-11-16T02:34:29.997 INFO:teuthology.orchestra.run.smithi204.stdout:for i in xfs.rules; do \ 2023-11-16T02:34:29.997 INFO:teuthology.orchestra.run.smithi204.stdout: ../install-sh -o root -g root -m 644 $i /lib/udev/rules.d/64-$i; \ 2023-11-16T02:34:29.997 INFO:teuthology.orchestra.run.smithi204.stdout:done 2023-11-16T02:34:30.020 INFO:teuthology.orchestra.run.smithi204.stdout:Installing po-install 2023-11-16T02:34:30.114 INFO:teuthology.orchestra.run.smithi204.stdout:Installing include-install 2023-11-16T02:34:30.118 INFO:teuthology.orchestra.run.smithi204.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-11-16T02:34:30.138 INFO:teuthology.orchestra.run.smithi204.stdout:./install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-11-16T02:34:30.158 INFO:teuthology.orchestra.run.smithi204.stdout:./install-sh -o root -g root -m 644 README /usr/share/doc/xfsprogs 2023-11-16T02:34:30.181 INFO:tasks.cephfs.test_fscrypt:client is kernel mounted 2023-11-16T02:34:30.182 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-11-16T02:34:30.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.316+0000 7f4db0a21640 1 Processor -- start 2023-11-16T02:34:30.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.316+0000 7f4db0a21640 1 -- start start 2023-11-16T02:34:30.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.316+0000 7f4db0a21640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f4dac0bc900 0x7f4dac0b82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:34:30.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.316+0000 7f4db0a21640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4dac148370 0x7f4dac141b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:34:30.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.316+0000 7f4db0a21640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dac0712b0 con 0x7f4dac1416d0 2023-11-16T02:34:30.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.316+0000 7f4db0a21640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dac071b50 con 0x7f4dac148370 2023-11-16T02:34:30.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.316+0000 7f4db0a21640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dac071590 con 0x7f4dac0bc900 2023-11-16T02:34:30.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.316+0000 7f4daad9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4dac148370 0x7f4dac141b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:34:30.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.316+0000 7f4da3fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f4dac1416d0 0x7f4dac147c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58390/0 (socket says 172.21.15.28:58390) 2023-11-16T02:34:30.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.316+0000 7f4da3fff640 1 -- 172.21.15.28:0/1698820359 learned_addr learned my addr 172.21.15.28:0/1698820359 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-16T02:34:30.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.316+0000 7f4daa59c640 1 --2- 172.21.15.28:0/1698820359 >> v2:172.21.15.70:3300/0 conn(0x7f4dac0bc900 0x7f4dac0b82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:34:30.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.316+0000 7f4da9d9b640 1 -- 172.21.15.28:0/1698820359 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693003976 0 0) 0x7f4dac0712b0 con 0x7f4dac1416d0 2023-11-16T02:34:30.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.316+0000 7f4da9d9b640 1 -- 172.21.15.28:0/1698820359 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d98003530 con 0x7f4dac1416d0 2023-11-16T02:34:30.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.316+0000 7f4daad9d640 1 -- 172.21.15.28:0/1698820359 >> v2:172.21.15.70:3300/0 conn(0x7f4dac0bc900 msgr2=0x7f4dac0b82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:34:30.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.316+0000 7f4daad9d640 1 --2- 172.21.15.28:0/1698820359 >> v2:172.21.15.70:3300/0 conn(0x7f4dac0bc900 0x7f4dac0b82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:34:30.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.316+0000 7f4daad9d640 1 -- 172.21.15.28:0/1698820359 >> v1:172.21.15.28:6789/0 conn(0x7f4dac1416d0 legacy=0x7f4dac147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:34:30.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.316+0000 7f4daad9d640 1 -- 172.21.15.28:0/1698820359 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac071870 con 0x7f4dac148370 2023-11-16T02:34:30.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4daad9d640 1 --2- 172.21.15.28:0/1698820359 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4dac148370 0x7f4dac141b40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4dac0bcff0 tx=0x7f4da401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e6cefb66a4475b server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:34:30.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4da9d9b640 1 -- 172.21.15.28:0/1698820359 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da40a58e0 con 0x7f4dac148370 2023-11-16T02:34:30.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4da9d9b640 1 -- 172.21.15.28:0/1698820359 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da40a5a40 con 0x7f4dac148370 2023-11-16T02:34:30.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4da9d9b640 1 -- 172.21.15.28:0/1698820359 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da40a5dd0 con 0x7f4dac148370 2023-11-16T02:34:30.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4db0a21640 1 -- 172.21.15.28:0/1698820359 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4dac148370 msgr2=0x7f4dac141b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:34:30.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4db0a21640 1 --2- 172.21.15.28:0/1698820359 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4dac148370 0x7f4dac141b40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4dac0bcff0 tx=0x7f4da401c910 comp rx=0 tx=0).stop 2023-11-16T02:34:30.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4db0a21640 1 -- 172.21.15.28:0/1698820359 shutdown_connections 2023-11-16T02:34:30.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4db0a21640 1 --2- 172.21.15.28:0/1698820359 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4dac148370 0x7f4dac141b40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:34:30.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4db0a21640 1 --2- 172.21.15.28:0/1698820359 >> v2:172.21.15.70:3300/0 conn(0x7f4dac0bc900 0x7f4dac0b82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:34:30.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4db0a21640 1 -- 172.21.15.28:0/1698820359 >> 172.21.15.28:0/1698820359 conn(0x7f4dac0b9050 msgr2=0x7f4dac0bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:34:30.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4db0a21640 1 -- 172.21.15.28:0/1698820359 shutdown_connections 2023-11-16T02:34:30.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4db0a21640 1 -- 172.21.15.28:0/1698820359 wait complete. 2023-11-16T02:34:30.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4db0a21640 1 Processor -- start 2023-11-16T02:34:30.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4db0a21640 1 -- start start 2023-11-16T02:34:30.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4db0a21640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dac0bc900 0x7f4dac1341d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:34:30.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4db0a21640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4dac1416d0 0x7f4dac13e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:34:30.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4db0a21640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4dac148370 0x7f4dac1325e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:34:30.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4db0a21640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac134710 con 0x7f4dac148370 2023-11-16T02:34:30.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4db0a21640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac13b7a0 con 0x7f4dac0bc900 2023-11-16T02:34:30.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4db0a21640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac13e650 con 0x7f4dac1416d0 2023-11-16T02:34:30.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4daad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4dac148370 0x7f4dac1325e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:34:30.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4daad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4dac148370 0x7f4dac1325e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60838/0 (socket says 172.21.15.28:60838) 2023-11-16T02:34:30.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4daad9d640 1 -- 172.21.15.28:0/2009293948 learned_addr learned my addr 172.21.15.28:0/2009293948 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:34:30.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4daa59c640 1 --2- 172.21.15.28:0/2009293948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dac0bc900 0x7f4dac1341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:34:30.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4da3fff640 1 --2- 172.21.15.28:0/2009293948 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4dac1416d0 0x7f4dac13e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:34:30.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4daad9d640 1 -- 172.21.15.28:0/2009293948 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4dac1416d0 msgr2=0x7f4dac13e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:34:30.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4daad9d640 1 --2- 172.21.15.28:0/2009293948 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4dac1416d0 0x7f4dac13e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:34:30.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4daad9d640 1 -- 172.21.15.28:0/2009293948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dac0bc900 msgr2=0x7f4dac1341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:34:30.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4daad9d640 1 --2- 172.21.15.28:0/2009293948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dac0bc900 0x7f4dac1341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:34:30.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4daad9d640 1 -- 172.21.15.28:0/2009293948 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da4009a70 con 0x7f4dac148370 2023-11-16T02:34:30.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4daad9d640 1 --2- 172.21.15.28:0/2009293948 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4dac148370 0x7f4dac1325e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4da4019520 tx=0x7f4da40196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:34:30.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4da2ffd640 1 -- 172.21.15.28:0/2009293948 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da40ad850 con 0x7f4dac148370 2023-11-16T02:34:30.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4da2ffd640 1 -- 172.21.15.28:0/2009293948 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da40ad9b0 con 0x7f4dac148370 2023-11-16T02:34:30.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4db0a21640 1 -- 172.21.15.28:0/2009293948 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dac13d9c0 con 0x7f4dac148370 2023-11-16T02:34:30.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4da2ffd640 1 -- 172.21.15.28:0/2009293948 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da40add60 con 0x7f4dac148370 2023-11-16T02:34:30.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.320+0000 7f4db0a21640 1 -- 172.21.15.28:0/2009293948 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dac0b6e40 con 0x7f4dac148370 2023-11-16T02:34:30.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.324+0000 7f4db0a21640 1 -- 172.21.15.28:0/2009293948 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dac04e8a0 con 0x7f4dac148370 2023-11-16T02:34:30.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.324+0000 7f4da2ffd640 1 -- 172.21.15.28:0/2009293948 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4da40b4050 con 0x7f4dac148370 2023-11-16T02:34:30.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.324+0000 7f4da2ffd640 1 --2- 172.21.15.28:0/2009293948 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4d8c065a90 0x7f4d8c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:34:30.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.324+0000 7f4daa59c640 1 --2- 172.21.15.28:0/2009293948 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4d8c065a90 0x7f4d8c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:34:30.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.324+0000 7f4da2ffd640 1 -- 172.21.15.28:0/2009293948 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4da411db80 con 0x7f4dac148370 2023-11-16T02:34:30.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.324+0000 7f4daa59c640 1 --2- 172.21.15.28:0/2009293948 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4d8c065a90 0x7f4d8c067f50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00b9d0 tx=0x7f4d9c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:34:30.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.328+0000 7f4da2ffd640 1 -- 172.21.15.28:0/2009293948 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f4da40eb5d0 con 0x7f4dac148370 2023-11-16T02:34:30.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.544+0000 7f4db0a21640 1 -- 172.21.15.28:0/2009293948 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4dac0bbcb0 con 0x7f4dac148370 2023-11-16T02:34:30.545 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.544+0000 7f4da2ffd640 1 -- 172.21.15.28:0/2009293948 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1268 (secure 0 0 0) 0x7f4da40eebf0 con 0x7f4dac148370 2023-11-16T02:34:30.545 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-16T02:34:30.545 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":1,"fsid":"1325a234-ab9e-4632-9a6e-98afbef8ae76","modified":"2023-11-16T02:28:36.164888Z","created":"2023-11-16T02:28:36.164888Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3300","nonce":0},{"type":"v1","addr":"172.21.15.28:6789","nonce":0}]},"addr":"172.21.15.28:6789/0","public_addr":"172.21.15.28:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3301","nonce":0},{"type":"v1","addr":"172.21.15.70:6790","nonce":0}]},"addr":"172.21.15.70:6790/0","public_addr":"172.21.15.70:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-11-16T02:34:30.545 INFO:teuthology.orchestra.run.smithi028.stderr:dumped monmap epoch 1 2023-11-16T02:34:30.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.544+0000 7f4db0a21640 1 -- 172.21.15.28:0/2009293948 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4d8c065a90 msgr2=0x7f4d8c067f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:34:30.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.544+0000 7f4db0a21640 1 --2- 172.21.15.28:0/2009293948 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4d8c065a90 0x7f4d8c067f50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00b9d0 tx=0x7f4d9c008040 comp rx=0 tx=0).stop 2023-11-16T02:34:30.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.544+0000 7f4db0a21640 1 -- 172.21.15.28:0/2009293948 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4dac148370 msgr2=0x7f4dac1325e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:34:30.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.544+0000 7f4db0a21640 1 --2- 172.21.15.28:0/2009293948 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4dac148370 0x7f4dac1325e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4da4019520 tx=0x7f4da40196b0 comp rx=0 tx=0).stop 2023-11-16T02:34:30.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.544+0000 7f4db0a21640 1 -- 172.21.15.28:0/2009293948 shutdown_connections 2023-11-16T02:34:30.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.544+0000 7f4db0a21640 1 --2- 172.21.15.28:0/2009293948 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4d8c065a90 0x7f4d8c067f50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:34:30.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.544+0000 7f4db0a21640 1 --2- 172.21.15.28:0/2009293948 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4dac148370 0x7f4dac1325e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:34:30.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.544+0000 7f4db0a21640 1 --2- 172.21.15.28:0/2009293948 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f4dac1416d0 0x7f4dac13e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:34:30.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.544+0000 7f4db0a21640 1 --2- 172.21.15.28:0/2009293948 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dac0bc900 0x7f4dac1341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:34:30.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.544+0000 7f4db0a21640 1 -- 172.21.15.28:0/2009293948 >> 172.21.15.28:0/2009293948 conn(0x7f4dac0b9050 msgr2=0x7f4dac13ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:34:30.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.544+0000 7f4db0a21640 1 -- 172.21.15.28:0/2009293948 shutdown_connections 2023-11-16T02:34:30.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.544+0000 7f4db0a21640 1 -- 172.21.15.28:0/2009293948 wait complete. 2023-11-16T02:34:30.563 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-11-16T02:34:30.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.692+0000 7f4029131640 1 Processor -- start 2023-11-16T02:34:30.693 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.692+0000 7f4029131640 1 -- start start 2023-11-16T02:34:30.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.692+0000 7f4029131640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f40240b8680 0x7f40240b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:34:30.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.692+0000 7f4029131640 1 --2- >> v2:172.21.15.70:3300/0 conn(0x7f402414ac00 0x7f402414b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:34:30.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.692+0000 7f4029131640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40240ba6b0 con 0x7f4024144410 2023-11-16T02:34:30.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.692+0000 7f4029131640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40240b9210 con 0x7f40240b8680 2023-11-16T02:34:30.694 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.692+0000 7f4029131640 1 -- --> v2:172.21.15.70:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f402406c260 con 0x7f402414ac00 2023-11-16T02:34:30.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.692+0000 7f4022d9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f40240b8680 0x7f40240b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:34:30.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.692+0000 7f4022d9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f40240b8680 0x7f40240b8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60842/0 (socket says 172.21.15.28:60842) 2023-11-16T02:34:30.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.692+0000 7f4022d9d640 1 -- 172.21.15.28:0/1438528136 learned_addr learned my addr 172.21.15.28:0/1438528136 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:34:30.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.692+0000 7f402259c640 1 --2- 172.21.15.28:0/1438528136 >> v2:172.21.15.70:3300/0 conn(0x7f402414ac00 0x7f402414b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:34:30.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.692+0000 7f4022d9d640 1 -- 172.21.15.28:0/1438528136 >> v2:172.21.15.70:3300/0 conn(0x7f402414ac00 msgr2=0x7f402414b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:34:30.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.692+0000 7f4022d9d640 1 --2- 172.21.15.28:0/1438528136 >> v2:172.21.15.70:3300/0 conn(0x7f402414ac00 0x7f402414b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:34:30.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.692+0000 7f4022d9d640 1 -- 172.21.15.28:0/1438528136 >> v1:172.21.15.70:6789/0 conn(0x7f4024144410 legacy=0x7f4024144860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-16T02:34:30.695 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.692+0000 7f4022d9d640 1 -- 172.21.15.28:0/1438528136 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40240b7800 con 0x7f40240b8680 2023-11-16T02:34:30.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.696+0000 7f4022d9d640 1 --2- 172.21.15.28:0/1438528136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f40240b8680 0x7f40240b8a60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4024148540 tx=0x7f401c01c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c889a34a67804b server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:34:30.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.696+0000 7f4021d9b640 1 -- 172.21.15.28:0/1438528136 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c0a5850 con 0x7f40240b8680 2023-11-16T02:34:30.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.696+0000 7f4021d9b640 1 -- 172.21.15.28:0/1438528136 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401c0a59b0 con 0x7f40240b8680 2023-11-16T02:34:30.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.696+0000 7f4021d9b640 1 -- 172.21.15.28:0/1438528136 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c0a5d40 con 0x7f40240b8680 2023-11-16T02:34:30.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.696+0000 7f4029131640 1 -- 172.21.15.28:0/1438528136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f40240b8680 msgr2=0x7f40240b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:34:30.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.696+0000 7f4029131640 1 --2- 172.21.15.28:0/1438528136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f40240b8680 0x7f40240b8a60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4024148540 tx=0x7f401c01c990 comp rx=0 tx=0).stop 2023-11-16T02:34:30.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.696+0000 7f4029131640 1 -- 172.21.15.28:0/1438528136 shutdown_connections 2023-11-16T02:34:30.697 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.696+0000 7f4029131640 1 --2- 172.21.15.28:0/1438528136 >> v2:172.21.15.70:3300/0 conn(0x7f402414ac00 0x7f402414b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:34:30.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.696+0000 7f4029131640 1 --2- 172.21.15.28:0/1438528136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f40240b8680 0x7f40240b8a60 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:34:30.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.696+0000 7f4029131640 1 -- 172.21.15.28:0/1438528136 >> 172.21.15.28:0/1438528136 conn(0x7f402406b770 msgr2=0x7f402406bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:34:30.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.696+0000 7f4029131640 1 -- 172.21.15.28:0/1438528136 shutdown_connections 2023-11-16T02:34:30.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.696+0000 7f4029131640 1 -- 172.21.15.28:0/1438528136 wait complete. 2023-11-16T02:34:30.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.696+0000 7f4029131640 1 Processor -- start 2023-11-16T02:34:30.698 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.696+0000 7f4029131640 1 -- start start 2023-11-16T02:34:30.700 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.696+0000 7f4029131640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40240b8680 0x7f40241385c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:34:30.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.696+0000 7f4029131640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4024144410 0x7f4024139420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:34:30.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.696+0000 7f4029131640 1 --2- >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f402414ac00 0x7f4024135bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:34:30.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.696+0000 7f4029131640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40241354a0 con 0x7f4024144410 2023-11-16T02:34:30.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.696+0000 7f4029131640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40241e6870 con 0x7f40240b8680 2023-11-16T02:34:30.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.696+0000 7f4029131640 1 -- --> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40241e6b50 con 0x7f402414ac00 2023-11-16T02:34:30.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.696+0000 7f402259c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4024144410 0x7f4024139420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:34:30.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.696+0000 7f402259c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4024144410 0x7f4024139420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60858/0 (socket says 172.21.15.28:60858) 2023-11-16T02:34:30.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.696+0000 7f402259c640 1 -- 172.21.15.28:0/2480920535 learned_addr learned my addr 172.21.15.28:0/2480920535 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-16T02:34:30.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.700+0000 7f402359e640 1 --2- 172.21.15.28:0/2480920535 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f402414ac00 0x7f4024135bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:34:30.701 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.700+0000 7f4022d9d640 1 --2- 172.21.15.28:0/2480920535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40240b8680 0x7f40241385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:34:30.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.700+0000 7f402259c640 1 -- 172.21.15.28:0/2480920535 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f402414ac00 msgr2=0x7f4024135bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:34:30.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.700+0000 7f402259c640 1 --2- 172.21.15.28:0/2480920535 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f402414ac00 0x7f4024135bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:34:30.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.700+0000 7f402259c640 1 -- 172.21.15.28:0/2480920535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40240b8680 msgr2=0x7f40241385c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:34:30.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.700+0000 7f402259c640 1 --2- 172.21.15.28:0/2480920535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40240b8680 0x7f40241385c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:34:30.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.700+0000 7f402259c640 1 -- 172.21.15.28:0/2480920535 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401c009b30 con 0x7f4024144410 2023-11-16T02:34:30.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.700+0000 7f4022d9d640 1 --2- 172.21.15.28:0/2480920535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40240b8680 0x7f40241385c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:34:30.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.700+0000 7f402359e640 1 --2- 172.21.15.28:0/2480920535 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f402414ac00 0x7f4024135bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-16T02:34:30.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.700+0000 7f402259c640 1 --2- 172.21.15.28:0/2480920535 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4024144410 0x7f4024139420 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f401800d5f0 tx=0x7f401800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:34:30.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.700+0000 7f400b7fe640 1 -- 172.21.15.28:0/2480920535 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40180125f0 con 0x7f4024144410 2023-11-16T02:34:30.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.700+0000 7f400b7fe640 1 -- 172.21.15.28:0/2480920535 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4018012750 con 0x7f4024144410 2023-11-16T02:34:30.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.700+0000 7f4029131640 1 -- 172.21.15.28:0/2480920535 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40241356b0 con 0x7f4024144410 2023-11-16T02:34:30.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.700+0000 7f400b7fe640 1 -- 172.21.15.28:0/2480920535 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4018012ae0 con 0x7f4024144410 2023-11-16T02:34:30.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.700+0000 7f4029131640 1 -- 172.21.15.28:0/2480920535 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4024139b30 con 0x7f4024144410 2023-11-16T02:34:30.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.700+0000 7f4029131640 1 -- 172.21.15.28:0/2480920535 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40241e69b0 con 0x7f4024144410 2023-11-16T02:34:30.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.700+0000 7f400b7fe640 1 -- 172.21.15.28:0/2480920535 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4018012c40 con 0x7f4024144410 2023-11-16T02:34:30.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.700+0000 7f400b7fe640 1 --2- 172.21.15.28:0/2480920535 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4010065a60 0x7f4010067f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-16T02:34:30.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.700+0000 7f400b7fe640 1 -- 172.21.15.28:0/2480920535 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40180835e0 con 0x7f4024144410 2023-11-16T02:34:30.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.700+0000 7f4022d9d640 1 --2- 172.21.15.28:0/2480920535 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4010065a60 0x7f4010067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-16T02:34:30.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.700+0000 7f4022d9d640 1 --2- 172.21.15.28:0/2480920535 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4010065a60 0x7f4010067f20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f401c0ae000 tx=0x7f401c0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-16T02:34:30.706 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.704+0000 7f400b7fe640 1 -- 172.21.15.28:0/2480920535 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172122 (secure 0 0 0) 0x7f40241e69b0 con 0x7f4024144410 2023-11-16T02:34:30.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.916+0000 7f4029131640 1 -- 172.21.15.28:0/2480920535 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f40241e69b0 con 0x7f4024144410 2023-11-16T02:34:30.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.916+0000 7f400b7fe640 1 -- 172.21.15.28:0/2480920535 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v13) v1 ==== 92+0+63 (secure 0 0 0) 0x7f40241e69b0 con 0x7f4024144410 2023-11-16T02:34:30.916 INFO:teuthology.orchestra.run.smithi028.stdout:[client.admin] 2023-11-16T02:34:30.916 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQBUflVlX9NKFxAA4p7Zp8Uf7upt8EYYFgRbcg== 2023-11-16T02:34:30.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.916+0000 7f4029131640 1 -- 172.21.15.28:0/2480920535 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4010065a60 msgr2=0x7f4010067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:34:30.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.916+0000 7f4029131640 1 --2- 172.21.15.28:0/2480920535 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4010065a60 0x7f4010067f20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f401c0ae000 tx=0x7f401c0a7070 comp rx=0 tx=0).stop 2023-11-16T02:34:30.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.916+0000 7f4029131640 1 -- 172.21.15.28:0/2480920535 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4024144410 msgr2=0x7f4024139420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-16T02:34:30.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.916+0000 7f4029131640 1 --2- 172.21.15.28:0/2480920535 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4024144410 0x7f4024139420 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f401800d5f0 tx=0x7f401800dab0 comp rx=0 tx=0).stop 2023-11-16T02:34:30.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.916+0000 7f4029131640 1 -- 172.21.15.28:0/2480920535 shutdown_connections 2023-11-16T02:34:30.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.916+0000 7f4029131640 1 --2- 172.21.15.28:0/2480920535 >> [v2:172.21.15.28:6832/38651,v1:172.21.15.28:6833/38651] conn(0x7f4010065a60 0x7f4010067f20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:34:30.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.916+0000 7f4029131640 1 --2- 172.21.15.28:0/2480920535 >> [v2:172.21.15.70:3301/0,v1:172.21.15.70:6790/0] conn(0x7f402414ac00 0x7f4024135bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:34:30.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.916+0000 7f4029131640 1 --2- 172.21.15.28:0/2480920535 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4024144410 0x7f4024139420 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:34:30.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.916+0000 7f4029131640 1 --2- 172.21.15.28:0/2480920535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40240b8680 0x7f40241385c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-16T02:34:30.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.916+0000 7f4029131640 1 -- 172.21.15.28:0/2480920535 >> 172.21.15.28:0/2480920535 conn(0x7f402406b770 msgr2=0x7f402413c460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-16T02:34:30.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.916+0000 7f4029131640 1 -- 172.21.15.28:0/2480920535 shutdown_connections 2023-11-16T02:34:30.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-16T02:34:30.916+0000 7f4029131640 1 -- 172.21.15.28:0/2480920535 wait complete. 2023-11-16T02:34:30.933 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2023-11-16T02:34:30.933 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/tmp/tmp.aa1AheDDlixfstests-dev/local.config 2023-11-16T02:34:30.955 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.28:6789:/test export TEST_DIR=/tmp/tmp.EmIut5Gdirtest export SCRATCH_DEV=172.21.15.28:6789:/scratch export SCRATCH_MNT=/tmp/tmp.IyzH09SmRgscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQBUflVlX9NKFxAA4p7Zp8Uf7upt8EYYFgRbcg==,test_dummy_encryption" 2023-11-16T02:34:30.956 INFO:teuthology.orchestra.run:Running command with timeout 10800 2023-11-16T02:34:30.956 DEBUG:teuthology.orchestra.run.smithi204:running tests for dummy_encryption from xfstests-dev> (cd /tmp/tmp.aa1AheDDlixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check -g quick -E ./ceph.exclude) 2023-11-16T02:34:32.715 INFO:teuthology.orchestra.run.smithi204.stdout:FSTYP -- ceph 2023-11-16T02:34:32.725 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM -- Linux/x86_64 smithi204 6.6.0-rc5-g3b796cfe2969 #1 SMP PREEMPT_DYNAMIC Tue Nov 7 03:27:20 UTC 2023 2023-11-16T02:34:32.726 INFO:teuthology.orchestra.run.smithi204.stdout:MKFS_OPTIONS -- 172.21.15.28:6789:/scratch 2023-11-16T02:34:32.730 INFO:teuthology.orchestra.run.smithi204.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBUflVlX9NKFxAA4p7Zp8Uf7upt8EYYFgRbcg==,test_dummy_encryption 172.21.15.28:6789:/scratch /tmp/tmp.IyzH09SmRgscratch 2023-11-16T02:34:32.730 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-11-16T02:34:32.861 INFO:teuthology.orchestra.run.smithi204.stdout:ceph/001 [expunged] 2023-11-16T02:34:33.259 INFO:teuthology.orchestra.run.smithi204.stdout:ceph/002 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-11-16T02:34:33.607 INFO:teuthology.orchestra.run.smithi204.stdout:ceph/003 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-11-16T02:34:34.057 INFO:teuthology.orchestra.run.smithi204.stdout:ceph/004 1s 2023-11-16T02:34:34.352 INFO:teuthology.orchestra.run.smithi204.stdout:ceph/005 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-11-16T02:34:35.445 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:34:35.448 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:34:35.450 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:34:44.744 INFO:teuthology.orchestra.run.smithi204.stdout:generic/001 10s 2023-11-16T02:34:45.442 INFO:teuthology.orchestra.run.smithi204.stdout:generic/002 1s 2023-11-16T02:34:45.743 INFO:teuthology.orchestra.run.smithi204.stdout:generic/003 [not run] atime not maintained by ceph 2023-11-16T02:34:46.051 INFO:teuthology.orchestra.run.smithi204.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-11-16T02:34:46.767 INFO:teuthology.orchestra.run.smithi204.stdout:generic/005 0s 2023-11-16T02:35:05.618 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:35:05.621 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:35:05.624 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:35:27.156 INFO:teuthology.orchestra.run.smithi204.stdout:generic/006 41s 2023-11-16T02:35:35.680 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:35:35.682 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:35:35.685 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:36:05.758 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:36:05.761 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:36:05.764 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:36:36.038 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:36:36.041 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:36:36.043 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:36:59.175 INFO:teuthology.orchestra.run.smithi204.stdout:generic/007 92s 2023-11-16T02:37:03.239 INFO:teuthology.orchestra.run.smithi204.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-16T02:37:03.239 INFO:teuthology.orchestra.run.smithi204.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-16T02:37:06.106 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:37:06.109 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:37:06.112 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:37:36.368 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:37:36.371 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:37:36.374 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:37:55.906 INFO:teuthology.orchestra.run.smithi204.stdout:generic/011 52s 2023-11-16T02:37:58.878 INFO:teuthology.orchestra.run.smithi204.stdout:generic/012 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-16T02:38:06.630 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:38:06.632 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:38:06.635 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:38:36.739 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:38:36.742 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:38:36.745 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:38:51.202 INFO:teuthology.orchestra.run.smithi204.stdout:generic/013 53s 2023-11-16T02:39:07.013 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:39:07.016 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:39:07.018 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:39:37.191 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:39:37.193 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:39:37.195 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:40:07.245 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:40:07.248 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:40:07.250 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:40:37.630 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:40:37.632 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:40:37.635 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:41:07.690 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:41:07.693 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:41:07.695 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:41:17.571 INFO:teuthology.orchestra.run.smithi204.stdout:generic/014 146s 2023-11-16T02:41:17.902 INFO:teuthology.orchestra.run.smithi204.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-16T02:41:20.603 INFO:teuthology.orchestra.run.smithi204.stdout:generic/016 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-16T02:41:21.008 INFO:teuthology.orchestra.run.smithi204.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-11-16T02:41:32.571 INFO:teuthology.orchestra.run.smithi204.stdout:generic/020 11s 2023-11-16T02:41:37.233 INFO:teuthology.orchestra.run.smithi204.stdout:generic/021 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-16T02:41:37.762 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:41:37.764 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:41:37.766 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:41:42.295 INFO:teuthology.orchestra.run.smithi204.stdout:generic/022 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-16T02:41:44.163 INFO:teuthology.orchestra.run.smithi204.stdout:generic/023 2s 2023-11-16T02:41:44.505 INFO:teuthology.orchestra.run.smithi204.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-11-16T02:41:44.854 INFO:teuthology.orchestra.run.smithi204.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-11-16T02:41:45.212 INFO:teuthology.orchestra.run.smithi204.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-11-16T02:41:50.531 INFO:teuthology.orchestra.run.smithi204.stdout:generic/028 5s 2023-11-16T02:41:51.847 INFO:teuthology.orchestra.run.smithi204.stdout:generic/029 1s 2023-11-16T02:41:58.906 INFO:teuthology.orchestra.run.smithi204.stdout:generic/030 7s 2023-11-16T02:42:04.448 INFO:teuthology.orchestra.run.smithi204.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-11-16T02:42:07.407 INFO:teuthology.orchestra.run.smithi204.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-16T02:42:07.826 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:42:07.828 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:42:07.830 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:42:07.850 INFO:tasks.ceph.mds.c.smithi028.stderr:2023-11-16T02:42:07.853+0000 7faaf87a7640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47090) UID: 0 2023-11-16T02:42:07.850 INFO:tasks.ceph.mds.a.smithi028.stderr:2023-11-16T02:42:07.853+0000 7f57bedfc640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47090) UID: 0 2023-11-16T02:42:11.502 INFO:teuthology.orchestra.run.smithi204.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-16T02:42:11.813 INFO:teuthology.orchestra.run.smithi204.stdout:generic/034 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-16T02:42:12.220 INFO:teuthology.orchestra.run.smithi204.stdout:generic/035 1s 2023-11-16T02:42:19.392 INFO:teuthology.orchestra.run.smithi204.stdout:generic/037 7s 2023-11-16T02:42:19.786 INFO:teuthology.orchestra.run.smithi204.stdout:generic/039 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-16T02:42:20.125 INFO:teuthology.orchestra.run.smithi204.stdout:generic/040 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-16T02:42:20.485 INFO:teuthology.orchestra.run.smithi204.stdout:generic/041 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-16T02:42:20.897 INFO:teuthology.orchestra.run.smithi204.stdout:generic/042 [not run] ceph does not support shutdown 2023-11-16T02:42:21.321 INFO:teuthology.orchestra.run.smithi204.stdout:generic/050 [not run] ceph does not support shutdown 2023-11-16T02:42:21.751 INFO:teuthology.orchestra.run.smithi204.stdout:generic/052 [not run] ceph does not support shutdown 2023-11-16T02:42:22.720 INFO:teuthology.orchestra.run.smithi204.stdout:generic/053 1s 2023-11-16T02:42:23.123 INFO:teuthology.orchestra.run.smithi204.stdout:generic/056 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-16T02:42:23.479 INFO:teuthology.orchestra.run.smithi204.stdout:generic/057 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-16T02:42:28.265 INFO:teuthology.orchestra.run.smithi204.stdout:generic/058 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-16T02:42:28.590 INFO:teuthology.orchestra.run.smithi204.stdout:generic/059 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-16T02:42:32.399 INFO:teuthology.orchestra.run.smithi204.stdout:generic/060 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-16T02:42:39.135 INFO:teuthology.orchestra.run.smithi204.stdout:generic/061 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-16T02:42:41.750 INFO:teuthology.orchestra.run.smithi204.stdout:generic/062 2s 2023-11-16T02:42:48.481 INFO:teuthology.orchestra.run.smithi204.stdout:generic/063 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-16T02:42:48.826 INFO:teuthology.orchestra.run.smithi204.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-16T02:42:49.144 INFO:teuthology.orchestra.run.smithi204.stdout:generic/065 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-16T02:42:49.462 INFO:teuthology.orchestra.run.smithi204.stdout:generic/066 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-16T02:42:49.797 INFO:teuthology.orchestra.run.smithi204.stdout:generic/067 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-16T02:43:15.150 INFO:teuthology.orchestra.run.smithi204.stdout:generic/069 26s 2023-11-16T02:43:35.692 INFO:teuthology.orchestra.run.smithi204.stdout:generic/070 20s 2023-11-16T02:43:35.989 INFO:teuthology.orchestra.run.smithi204.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-16T02:43:36.312 INFO:teuthology.orchestra.run.smithi204.stdout:generic/073 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-16T02:44:28.258 INFO:teuthology.orchestra.run.smithi204.stdout:generic/075 52s 2023-11-16T02:44:35.047 INFO:teuthology.orchestra.run.smithi204.stdout:generic/076 [not run] require 172.21.15.28:6789:/scratch to be local device 2023-11-16T02:44:35.047 INFO:teuthology.orchestra.run.smithi204.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-11-16T02:44:35.047 INFO:teuthology.orchestra.run.smithi204.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-11-16T02:44:35.047 INFO:teuthology.orchestra.run.smithi204.stdout:generic/080 2s 2023-11-16T02:44:35.047 INFO:teuthology.orchestra.run.smithi204.stdout:generic/081 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-16T02:44:35.047 INFO:teuthology.orchestra.run.smithi204.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-16T02:44:38.375 INFO:teuthology.orchestra.run.smithi204.stdout:generic/084 6s 2023-11-16T02:44:38.728 INFO:teuthology.orchestra.run.smithi204.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-16T02:44:39.128 INFO:teuthology.orchestra.run.smithi204.stdout:generic/087 1s 2023-11-16T02:44:39.472 INFO:teuthology.orchestra.run.smithi204.stdout:generic/088 0s 2023-11-16T02:44:39.818 INFO:teuthology.orchestra.run.smithi204.stdout:generic/090 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-16T02:44:48.141 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:44:48.144 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:44:48.146 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:45:18.218 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:45:18.227 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:45:18.230 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:45:48.281 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:45:48.284 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:45:48.287 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:46:18.336 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:46:18.339 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:46:18.342 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:46:48.451 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:46:48.454 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:46:48.457 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:47:06.394 INFO:teuthology.orchestra.run.smithi204.stdout:generic/091 147s 2023-11-16T02:47:07.986 INFO:teuthology.orchestra.run.smithi204.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-16T02:47:07.987 INFO:teuthology.orchestra.run.smithi204.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-16T02:47:14.748 INFO:teuthology.orchestra.run.smithi204.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-16T02:47:15.509 INFO:teuthology.orchestra.run.smithi204.stdout:generic/097 1s 2023-11-16T02:47:16.689 INFO:teuthology.orchestra.run.smithi204.stdout:generic/098 1s 2023-11-16T02:47:18.516 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:47:18.519 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:47:18.522 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:47:18.526 INFO:teuthology.orchestra.run.smithi204.stdout:generic/099 2s 2023-11-16T02:47:18.851 INFO:teuthology.orchestra.run.smithi204.stdout:generic/101 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-16T02:47:19.177 INFO:teuthology.orchestra.run.smithi204.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-16T02:47:19.527 INFO:teuthology.orchestra.run.smithi204.stdout:generic/104 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-16T02:47:20.473 INFO:teuthology.orchestra.run.smithi204.stdout:generic/105 1s 2023-11-16T02:47:20.872 INFO:teuthology.orchestra.run.smithi204.stdout:generic/106 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-16T02:47:21.219 INFO:teuthology.orchestra.run.smithi204.stdout:generic/107 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-16T02:47:21.767 INFO:teuthology.orchestra.run.smithi204.stdout:generic/108 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-16T02:47:22.105 INFO:teuthology.orchestra.run.smithi204.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-11-16T02:47:22.439 INFO:teuthology.orchestra.run.smithi204.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-11-16T02:47:48.670 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:47:48.673 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:47:48.676 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:48:18.983 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:48:18.987 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:48:18.989 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:48:21.098 INFO:teuthology.orchestra.run.smithi204.stdout:generic/112 59s 2023-11-16T02:48:49.058 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:48:49.061 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:48:49.062 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:49:19.265 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:49:19.267 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:49:19.269 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:49:49.376 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:49:49.379 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:49:49.381 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:50:19.672 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:50:19.675 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:50:19.677 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:50:49.731 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:50:49.735 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:50:49.737 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:51:19.805 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:51:19.808 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:51:19.810 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:51:49.969 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:51:49.972 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:51:49.974 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:52:20.033 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:52:20.036 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:52:20.039 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:52:50.089 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:52:50.092 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:52:50.095 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:53:20.145 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:53:20.148 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:53:20.154 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:53:50.365 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:53:50.368 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:53:50.370 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:54:20.494 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:54:20.498 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:54:20.501 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:54:50.565 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:54:50.569 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:54:50.571 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:55:20.645 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:55:20.649 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:55:20.652 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:55:50.747 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:55:50.750 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:55:50.752 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:56:20.817 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:56:20.821 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:56:20.823 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:56:50.905 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:56:50.908 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:56:50.911 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:57:20.987 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:57:20.990 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:57:20.993 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:57:51.079 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:57:51.082 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:57:51.085 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:58:21.150 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:58:21.153 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:58:21.157 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:58:51.215 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:58:51.218 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:58:51.221 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:59:21.280 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:59:21.283 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:59:21.286 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:59:51.386 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:59:51.389 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T02:59:51.392 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:00:21.459 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:00:21.463 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:00:21.466 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:00:51.575 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:00:51.579 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:00:51.581 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:01:21.631 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:01:21.634 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:01:21.637 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:01:51.702 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:01:51.705 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:01:51.708 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:02:21.761 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:02:21.765 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:02:21.768 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:02:51.834 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:02:51.837 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:02:51.839 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:03:21.890 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:03:21.894 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:03:21.897 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:03:51.956 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:03:51.960 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:03:51.962 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:04:22.046 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:04:22.049 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:04:22.052 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:04:52.114 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:04:52.123 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:04:52.126 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:05:22.406 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:05:22.409 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:05:22.412 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:05:52.459 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:05:52.463 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:05:52.466 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:06:22.523 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:06:22.526 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:06:22.528 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:06:52.605 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:06:52.612 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:06:52.615 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:07:22.662 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:07:22.666 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:07:22.669 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:07:52.739 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:07:52.742 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:07:52.745 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:08:22.792 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:08:22.795 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:08:22.802 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:08:52.856 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:08:52.859 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:08:52.861 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:09:22.917 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:09:22.923 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:09:22.925 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:09:53.028 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:09:53.031 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:09:53.033 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:10:23.134 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:10:23.137 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:10:23.140 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:10:53.227 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:10:53.231 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:10:53.234 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:11:23.520 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:11:23.524 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:11:23.527 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:11:23.562 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T03:11:23.560+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44094) UID: 0 2023-11-16T03:11:23.562 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T03:11:23.560+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44094) UID: 0 2023-11-16T03:11:23.563 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T03:11:23.560+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44094) UID: 0 2023-11-16T03:11:23.563 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T03:11:23.560+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44094) UID: 0 2023-11-16T03:13:26.965 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:13:26.969 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:13:26.971 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:13:57.027 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:13:57.030 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:13:57.034 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:14:27.171 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:14:27.174 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:14:27.177 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:14:57.245 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:14:57.248 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:14:57.254 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:15:27.329 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:15:27.333 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:15:27.336 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:15:57.382 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:16:01.556 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:16:01.559 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:16:31.762 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:16:31.765 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:16:31.767 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:17:01.840 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:17:01.847 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:17:01.849 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:17:31.914 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:17:31.918 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:17:31.920 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:18:02.080 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:18:02.084 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:18:02.087 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:18:32.668 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:18:32.671 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:18:32.673 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:19:02.784 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:19:02.788 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:19:02.790 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:19:32.950 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:19:32.954 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:19:32.957 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:20:03.044 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:20:03.048 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:20:03.050 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:20:33.123 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:20:33.126 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:20:33.129 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:21:03.187 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:21:03.190 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:21:03.192 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:21:33.309 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:21:33.312 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:21:33.318 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:22:03.449 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:22:03.452 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:22:03.455 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:22:33.514 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:22:33.518 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:22:33.520 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:23:03.570 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:23:03.573 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:23:03.576 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:23:33.685 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:23:34.106 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:23:34.109 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:24:04.158 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:24:04.162 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:24:04.166 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:24:34.287 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:24:34.292 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:24:34.295 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:25:04.352 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:25:04.355 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:25:04.358 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:25:34.754 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:25:34.757 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:25:34.760 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:26:04.832 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:26:04.835 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:26:04.839 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:26:34.939 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:26:34.942 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:26:34.947 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:27:05.263 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:27:05.271 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:27:05.274 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:27:35.319 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:27:35.322 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:27:35.325 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:28:05.378 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:28:05.381 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:28:05.384 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:28:35.441 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:28:35.445 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:28:35.447 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:29:05.578 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:29:05.582 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:29:05.584 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:29:35.636 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:29:35.640 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:29:35.643 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:30:05.751 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:30:05.754 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:30:05.758 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:30:36.024 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:30:36.027 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:30:36.030 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:31:06.110 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:31:06.114 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:31:06.117 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:31:36.161 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:31:36.164 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:31:36.166 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:32:06.318 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:32:06.325 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:32:06.327 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:32:36.406 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:32:36.410 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:32:36.412 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:33:06.540 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:33:06.543 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:33:06.546 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:33:36.688 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:33:36.691 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:33:36.694 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:34:06.961 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:34:06.964 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:34:06.967 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:34:37.093 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:34:37.096 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:34:37.100 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:35:07.165 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:35:33.898 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:35:33.914 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:36:04.056 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:36:04.059 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:36:04.062 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:36:04.078 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T03:36:04.082+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44237) UID: 0 2023-11-16T03:36:04.079 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T03:36:04.082+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44237) UID: 0 2023-11-16T03:36:04.080 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T03:36:04.082+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44237) UID: 0 2023-11-16T03:36:04.080 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T03:36:04.082+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44237) UID: 0 2023-11-16T03:38:07.573 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:38:07.576 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:38:07.579 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:38:37.657 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:38:37.661 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:38:37.663 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:39:07.772 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:39:07.776 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:39:07.804 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:39:37.913 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:39:37.916 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:39:37.918 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:40:08.044 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:40:08.048 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:40:08.050 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:40:38.383 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:40:38.386 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:40:38.388 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:41:08.560 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:41:08.564 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:41:08.567 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:41:38.623 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:41:38.626 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:41:38.628 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:42:08.711 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:42:08.715 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:42:08.717 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:42:38.946 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:42:38.949 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:42:38.952 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:43:09.041 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:43:09.045 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:43:09.047 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:43:39.139 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:43:39.171 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:43:39.174 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:44:09.223 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:44:09.232 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:44:09.235 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:44:39.678 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:44:39.682 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:44:39.686 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:45:09.751 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:45:09.755 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:45:09.757 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:45:40.019 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:45:40.022 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:45:40.026 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:46:10.190 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:46:12.889 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:46:12.893 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:46:42.945 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:46:42.948 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:46:42.952 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:47:13.080 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:47:13.082 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:47:13.085 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:47:43.142 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:47:43.145 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:47:43.147 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:48:13.197 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:48:13.201 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:48:13.204 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:48:43.294 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:48:43.297 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:48:43.300 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:49:13.434 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:49:13.437 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:49:13.439 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:49:43.582 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:49:43.585 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:49:43.587 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:50:13.769 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:50:13.772 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:50:13.775 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:50:43.861 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:50:43.864 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:50:43.867 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:51:14.059 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:51:20.474 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:51:20.476 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:51:50.737 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:51:50.740 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:51:50.742 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:52:20.905 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:52:20.908 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:52:20.911 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:52:51.028 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:52:51.031 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:52:51.034 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:53:21.093 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:53:21.096 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:53:21.098 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:53:51.226 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:53:51.229 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:53:51.232 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:54:21.363 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:54:21.367 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:54:21.369 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:54:51.461 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:54:51.464 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:54:51.467 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:55:21.738 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:55:21.740 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:55:21.743 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:55:51.796 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:55:51.799 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:55:51.801 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:56:21.861 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:56:21.865 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:56:21.867 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:56:51.945 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:56:51.949 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:56:51.951 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:57:22.000 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:57:22.004 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:57:22.006 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:57:52.114 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:57:52.118 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:57:52.120 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:58:22.167 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:58:22.175 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:58:22.181 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:58:52.473 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:58:52.477 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:58:52.487 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:59:22.735 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:59:22.738 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:59:22.741 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:59:52.873 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:59:52.876 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T03:59:52.879 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:00:23.008 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:00:23.012 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:00:23.015 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:00:23.031 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T04:00:23.028+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44373) UID: 0 2023-11-16T04:00:23.032 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T04:00:23.028+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44373) UID: 0 2023-11-16T04:00:23.033 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T04:00:23.028+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44373) UID: 0 2023-11-16T04:00:23.034 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T04:00:23.028+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44373) UID: 0 2023-11-16T04:02:25.383 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:02:25.386 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:02:25.388 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:02:55.545 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:02:55.548 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:02:55.551 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:03:25.744 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:03:25.748 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:03:25.751 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:03:55.817 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:03:55.821 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:03:55.824 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:04:26.090 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:04:26.093 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:04:26.096 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:04:56.169 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:04:56.172 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:04:56.174 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:05:26.285 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:05:26.289 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:05:26.291 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:05:56.426 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:05:56.429 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:05:56.431 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:06:26.489 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:06:26.492 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:06:26.494 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:06:56.646 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:06:56.649 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:06:56.652 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:07:26.719 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:07:26.723 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:07:26.726 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:07:56.784 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:07:56.787 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:07:56.790 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:08:26.985 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:08:26.989 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:08:26.991 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:08:57.046 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:08:57.050 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:08:57.053 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:09:27.459 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:09:27.462 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:09:27.465 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:09:57.647 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:09:57.650 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:09:57.653 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:10:27.775 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:10:27.777 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:10:27.780 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:10:57.863 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:10:57.867 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:10:57.869 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:11:27.922 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:11:27.925 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:11:27.928 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:11:58.084 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:11:58.087 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:11:58.090 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:12:28.232 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:12:28.237 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:12:28.240 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:12:58.296 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:12:58.299 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:12:58.301 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:13:28.379 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:13:28.382 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:13:28.385 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:13:58.435 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:13:58.439 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:13:58.442 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:14:28.493 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:14:28.496 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:14:28.499 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:14:58.815 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:14:58.818 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:14:58.820 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:15:28.944 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:15:28.947 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:15:28.949 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:15:59.053 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:15:59.057 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:15:59.059 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:16:29.192 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:16:29.195 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:16:29.199 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:16:59.264 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:16:59.269 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:16:59.272 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:17:29.984 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:17:29.987 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:17:29.990 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:18:00.035 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:18:00.040 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:18:00.042 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:18:30.407 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:18:30.411 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:18:30.413 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:19:00.457 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:19:00.460 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:19:00.462 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:19:30.571 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:19:30.574 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:19:30.577 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:20:00.685 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:20:00.689 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:20:00.692 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:20:30.808 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:20:30.812 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:20:30.814 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:21:00.900 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:21:00.903 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:21:00.905 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:21:31.154 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:21:31.157 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:21:31.160 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:22:01.236 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:22:01.239 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:22:01.242 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:22:31.569 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:22:31.573 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:22:31.575 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:23:01.641 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:23:01.644 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:23:01.647 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:23:31.726 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:23:31.729 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:23:31.731 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:24:01.781 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:24:01.786 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:24:01.789 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:24:32.275 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:24:32.278 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:24:32.280 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:24:32.297 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T04:24:32.292+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44512) UID: 0 2023-11-16T04:24:32.298 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T04:24:32.292+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44512) UID: 0 2023-11-16T04:24:32.298 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T04:24:32.292+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44512) UID: 0 2023-11-16T04:24:32.298 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T04:24:32.292+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44512) UID: 0 2023-11-16T04:26:34.116 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:26:34.119 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:26:34.122 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:27:04.198 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:27:04.201 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:27:04.203 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:27:34.322 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:27:34.326 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:27:34.329 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:28:04.381 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:28:04.384 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:28:04.386 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:28:34.536 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:28:34.541 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:28:34.543 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:29:04.733 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:29:04.736 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:29:04.739 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:29:34.855 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:29:34.858 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:29:34.861 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:30:04.941 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:30:04.944 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:30:04.946 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:30:35.047 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:30:37.382 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:30:37.386 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:31:07.522 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:31:07.525 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:31:07.527 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:31:37.575 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:31:37.579 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:31:37.582 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:32:07.937 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:32:07.940 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:32:07.943 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:32:38.014 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:32:38.017 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:32:38.020 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:33:08.245 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:33:08.248 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:33:08.251 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:33:38.385 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:33:38.392 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:33:38.395 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:34:08.458 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:34:08.461 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:34:08.463 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:34:38.513 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:34:38.516 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:34:38.519 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:35:08.571 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:35:08.575 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:35:08.577 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:35:38.920 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:35:38.923 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:35:38.925 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:36:08.982 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:36:08.985 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:36:08.987 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:36:39.031 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:36:39.034 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:36:39.038 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:37:09.179 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:37:09.182 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:37:09.185 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:37:39.320 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:37:39.323 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:37:39.325 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:38:09.516 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:38:09.519 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:38:09.522 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:38:39.573 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:38:39.577 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:38:39.579 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:39:09.680 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:39:09.684 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:39:09.687 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:39:39.881 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:39:44.585 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:39:44.588 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:40:15.175 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:40:15.179 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:40:15.181 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:40:45.306 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:40:45.309 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:40:45.312 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:41:15.454 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:41:15.457 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:41:15.460 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:41:45.779 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:41:45.782 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:41:45.785 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:42:15.942 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:42:15.946 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:42:15.949 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:42:46.057 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:42:46.060 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:42:46.063 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:43:16.114 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:43:16.119 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:43:16.121 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:43:46.211 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:43:46.217 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:43:46.220 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:44:16.277 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:44:20.760 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:44:20.767 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:44:51.065 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:44:51.068 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:44:51.071 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:45:21.127 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:45:21.130 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:45:21.132 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:45:51.254 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:45:51.258 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:45:51.261 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:46:21.394 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:46:21.397 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:46:21.400 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:46:51.637 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:46:51.641 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:46:51.644 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:47:21.698 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:47:21.701 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:47:21.704 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:47:51.814 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:47:51.818 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:47:51.821 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:48:22.085 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:48:22.088 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:48:22.090 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:48:52.177 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:48:52.180 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:48:52.182 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:48:52.201 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T04:48:52.197+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44650) UID: 0 2023-11-16T04:48:52.201 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T04:48:52.197+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44650) UID: 0 2023-11-16T04:48:52.201 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T04:48:52.197+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44650) UID: 0 2023-11-16T04:48:52.202 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T04:48:52.197+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44650) UID: 0 2023-11-16T04:50:54.902 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:50:54.905 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:50:54.908 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:51:24.972 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:51:24.975 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:51:24.978 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:51:55.158 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:51:55.167 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:51:55.173 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:52:25.511 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:52:25.514 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:52:25.517 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:52:55.622 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:52:55.626 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:52:55.631 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:53:25.868 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:53:25.871 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:53:25.873 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:53:56.021 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:53:56.024 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:53:56.026 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:54:26.074 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:54:26.077 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:54:26.081 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:54:56.127 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:54:56.131 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:54:56.133 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:55:26.282 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:55:26.286 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:55:26.288 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:55:56.397 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:55:56.400 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:55:56.403 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:56:26.520 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:56:26.523 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:56:26.526 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:56:56.685 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:56:56.690 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:56:56.692 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:57:26.801 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:57:26.804 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:57:26.807 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:57:56.882 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:57:56.888 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:57:56.891 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:58:26.939 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:58:26.942 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:58:26.945 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:58:57.054 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:58:57.057 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:58:57.060 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:59:27.469 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:59:27.472 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:59:27.474 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:59:57.529 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:59:57.532 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T04:59:57.535 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:00:27.663 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:00:27.668 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:00:27.671 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:00:57.736 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:00:57.997 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:00:58.000 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:01:28.141 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:01:28.144 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:01:28.147 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:01:58.216 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:01:58.221 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:01:58.223 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:02:28.280 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:02:28.283 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:02:28.286 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:02:58.426 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:02:58.429 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:02:58.432 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:03:28.501 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:03:28.505 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:03:28.508 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:03:58.566 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:03:58.569 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:03:58.572 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:04:28.633 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:04:28.636 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:04:28.639 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:04:58.756 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:04:58.760 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:04:58.762 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:05:28.894 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:05:28.897 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:05:28.900 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:05:58.954 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:05:58.957 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:05:58.960 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:06:29.024 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:06:29.027 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:06:29.030 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:06:59.146 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:06:59.150 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:06:59.153 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:07:29.574 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:07:29.577 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:07:29.580 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:07:59.661 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:07:59.665 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:07:59.668 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:08:29.723 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:08:29.726 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:08:29.728 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:08:59.787 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:08:59.790 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:08:59.793 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:09:29.894 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:09:29.898 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:09:29.900 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:09:59.983 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:09:59.986 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:09:59.989 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:10:30.047 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:10:30.050 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:10:30.053 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:11:00.103 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:11:00.106 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:11:00.109 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:11:30.174 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:11:30.177 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:11:30.179 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:12:00.359 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:12:00.363 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:12:00.365 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:12:30.432 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:12:30.437 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:12:30.440 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:13:00.572 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:13:00.575 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:13:00.578 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:13:00.596 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T05:13:00.594+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44788) UID: 0 2023-11-16T05:13:00.596 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T05:13:00.594+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44788) UID: 0 2023-11-16T05:13:00.596 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T05:13:00.594+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44788) UID: 0 2023-11-16T05:13:00.597 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T05:13:00.594+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44788) UID: 0 2023-11-16T05:15:02.348 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:15:02.351 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:15:02.354 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:15:32.409 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:15:32.413 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:15:32.416 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:16:02.655 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:16:02.658 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:16:02.661 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:16:32.731 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:16:32.734 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:16:32.737 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:17:02.888 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:17:02.891 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:17:02.894 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:17:33.219 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:17:33.222 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:17:33.225 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:18:03.343 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:18:03.346 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:18:03.349 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:18:33.522 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:18:33.525 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:18:33.528 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:19:03.709 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:19:03.712 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:19:03.714 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:19:33.761 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:19:33.766 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:19:33.769 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:20:03.900 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:20:08.989 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:20:08.994 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:20:39.048 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:20:39.051 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:20:39.054 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:21:09.355 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:21:09.359 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:21:09.361 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:21:39.517 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:21:39.520 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:21:39.522 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:22:09.583 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:22:09.586 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:22:09.589 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:22:39.731 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:22:39.734 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:22:39.737 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:23:09.853 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:23:09.856 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:23:09.858 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:23:39.905 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:23:39.909 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:23:39.911 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:24:10.016 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:24:10.020 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:24:10.023 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:24:40.347 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:24:40.351 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:24:40.353 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:25:10.817 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:25:10.820 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:25:10.822 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:25:40.870 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:25:40.873 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:25:40.876 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:26:10.966 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:26:10.969 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:26:10.971 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:26:41.104 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:26:41.107 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:26:41.110 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:27:11.206 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:27:11.209 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:27:11.212 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:27:41.321 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:27:41.324 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:27:41.326 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:28:11.488 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:28:11.491 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:28:11.493 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:28:41.616 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:28:41.620 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:28:41.623 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:29:11.764 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:29:11.767 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:29:11.770 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:29:42.004 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:29:42.008 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:29:42.010 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:30:12.077 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:30:12.080 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:30:12.082 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:30:42.225 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:30:42.229 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:30:42.233 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:31:12.365 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:31:15.321 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:31:15.324 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:31:45.464 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:31:45.467 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:31:45.469 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:32:15.546 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:32:15.550 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:32:15.552 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:32:45.727 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:32:45.731 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:32:45.733 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:33:15.807 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:33:15.810 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:33:15.813 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:33:45.932 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:33:50.119 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:33:50.130 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:34:20.337 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:34:20.341 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:34:20.344 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:34:31.205 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2023-11-16T05:34:50.425 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:34:50.428 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:34:50.431 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:35:20.478 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:35:20.482 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:35:20.484 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:35:50.539 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:35:50.542 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:35:50.545 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:36:20.702 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:36:20.705 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:36:20.708 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:36:50.812 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:36:50.815 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:36:50.817 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:37:20.884 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:37:20.887 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:37:20.890 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:37:20.908 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T05:37:20.905+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44930) UID: 0 2023-11-16T05:37:20.909 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T05:37:20.905+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44930) UID: 0 2023-11-16T05:37:20.909 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T05:37:20.905+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44930) UID: 0 2023-11-16T05:37:20.909 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T05:37:20.905+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44930) UID: 0 2023-11-16T05:39:23.875 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:39:23.879 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:39:23.881 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:39:53.949 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:39:53.952 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:39:53.955 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:40:24.056 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:40:24.059 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:40:24.062 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:40:54.152 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:40:54.156 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:40:54.159 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:41:24.210 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:41:24.213 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:41:24.215 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:41:54.302 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:41:54.310 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:41:54.313 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:42:24.380 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:42:24.384 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:42:24.386 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:42:54.476 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:42:54.480 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:42:54.482 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:43:24.620 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:43:24.623 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:43:24.626 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:43:54.681 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:43:54.723 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:43:54.727 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:44:24.792 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:44:24.796 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:44:24.800 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:44:54.913 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:44:54.916 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:44:54.919 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:45:25.091 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:45:25.094 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:45:25.096 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:45:55.147 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:45:55.150 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:45:55.153 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:46:25.214 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:46:25.218 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:46:25.220 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:46:55.502 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:46:55.505 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:46:55.508 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:47:25.640 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:47:25.643 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:47:25.645 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:47:55.735 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:47:55.738 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:47:55.740 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:48:21.107 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2023-11-16T05:48:26.000 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:48:26.003 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:48:26.005 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:48:56.154 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:48:56.157 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:48:56.160 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:49:26.438 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:49:26.441 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:49:26.443 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:49:56.609 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:49:56.612 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:49:56.614 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:50:26.707 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:50:26.710 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:50:26.713 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:50:57.056 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:50:57.060 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:50:57.062 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:51:27.103 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:51:27.106 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:51:27.108 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:51:57.176 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:51:57.179 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:51:57.181 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:52:27.240 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:52:27.243 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:52:27.245 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:52:57.380 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:52:57.383 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:52:57.386 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:53:27.511 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:53:27.514 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:53:27.517 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:53:57.583 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:53:57.586 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:53:57.589 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:54:27.655 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:54:27.658 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:54:27.660 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:54:57.756 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:54:57.759 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:54:57.761 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:55:27.812 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:55:27.816 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:55:27.818 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:55:58.041 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:55:58.044 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:55:58.047 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:56:28.099 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:56:28.102 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:56:28.105 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:56:58.240 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:56:58.243 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:56:58.246 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:57:28.442 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:57:28.445 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:57:28.448 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:57:58.580 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:57:58.583 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:57:58.585 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:58:28.667 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:58:28.670 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:58:28.672 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:58:59.046 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:58:59.049 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:58:59.051 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:59:29.206 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:59:29.209 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:59:29.211 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:59:59.268 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:59:59.271 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T05:59:59.273 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:00:29.371 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:00:29.373 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:00:29.376 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:00:59.500 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:00:59.503 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:00:59.506 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:01:29.586 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:01:29.590 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:01:29.593 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:01:29.610 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T06:01:29.605+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45069) UID: 0 2023-11-16T06:01:29.610 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T06:01:29.605+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45069) UID: 0 2023-11-16T06:01:29.610 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T06:01:29.605+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45069) UID: 0 2023-11-16T06:01:29.611 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T06:01:29.605+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45069) UID: 0 2023-11-16T06:03:31.811 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:03:31.814 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:03:31.817 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:04:01.875 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:04:01.879 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:04:01.881 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:04:31.949 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:04:31.952 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:04:31.955 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:05:02.022 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:05:02.025 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:05:02.027 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:05:32.095 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:05:32.097 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:05:32.100 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:06:02.176 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:06:02.180 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:06:02.182 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:06:32.262 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:06:32.265 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:06:32.268 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:07:02.347 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:07:02.350 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:07:02.353 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:07:32.477 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:07:32.480 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:07:32.483 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:08:02.618 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:08:02.622 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:08:02.624 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:08:32.667 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:08:32.671 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:08:32.674 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:09:02.790 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:09:02.793 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:09:02.795 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:09:33.045 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:09:33.048 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:09:33.051 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:10:03.278 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:10:03.281 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:10:03.283 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:10:33.341 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:10:33.345 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:10:33.347 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:11:03.444 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:11:03.447 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:11:03.449 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:11:33.546 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:11:33.549 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:11:33.552 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:12:03.686 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:12:03.691 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:12:03.693 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:12:33.842 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:12:33.845 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:12:33.848 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:13:03.956 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:13:03.959 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:13:03.962 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:13:34.029 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:13:34.032 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:13:34.035 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:14:04.111 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:14:04.113 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:14:04.116 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:14:34.184 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:14:34.187 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:14:34.189 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:15:04.306 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:15:04.309 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:15:04.312 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:15:34.429 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:15:34.432 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:15:34.435 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:16:04.561 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:16:04.564 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:16:04.566 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:16:34.626 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:16:34.630 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:16:34.633 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:17:04.716 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:17:04.719 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:17:04.722 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:17:34.822 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:17:34.826 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:17:34.829 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:18:04.878 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:18:04.882 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:18:04.884 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:18:35.286 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:18:35.290 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:18:35.292 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:19:05.341 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:19:05.344 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:19:05.347 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:19:35.420 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:19:35.423 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:19:35.425 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:20:05.529 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:20:05.532 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:20:05.535 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:20:35.595 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:20:35.600 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:20:35.604 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:21:05.763 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:21:05.767 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:21:05.769 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:21:35.859 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:21:35.862 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:21:35.865 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:22:05.954 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:22:05.960 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:22:05.962 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:22:36.082 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:22:36.085 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:22:36.088 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:23:06.202 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:23:06.205 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:23:06.207 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:23:36.306 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:23:36.309 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:23:36.311 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:24:06.414 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:24:06.417 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:24:06.419 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:24:36.570 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:24:36.573 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:24:36.576 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:25:06.693 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:25:06.697 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:25:06.699 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:25:36.858 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:25:36.862 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:25:36.865 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:25:36.882 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T06:25:36.877+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45233) UID: 0 2023-11-16T06:25:36.882 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T06:25:36.877+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45233) UID: 0 2023-11-16T06:25:36.882 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T06:25:36.877+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45233) UID: 0 2023-11-16T06:25:36.882 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T06:25:36.877+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45233) UID: 0 2023-11-16T06:27:39.346 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:27:39.350 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:27:39.352 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:28:09.489 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:28:09.493 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:28:09.495 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:28:39.538 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:28:39.541 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:28:39.544 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:29:09.621 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:29:09.624 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:29:09.627 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:29:39.775 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:29:39.778 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:29:39.781 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:30:09.861 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:30:09.864 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:30:09.867 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:30:39.931 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:30:39.934 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:30:39.936 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:31:10.060 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:31:10.063 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:31:10.065 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:31:40.186 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:31:40.189 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:31:40.192 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:32:10.333 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:32:10.336 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:32:10.339 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:32:40.649 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:32:40.653 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:32:40.655 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:33:10.723 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:33:10.726 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:33:10.729 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:33:41.085 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:33:41.088 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:33:41.091 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:34:11.143 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:34:11.146 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:34:11.149 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:34:41.293 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:34:41.296 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:34:41.299 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:35:11.404 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:35:11.408 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:35:11.410 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:35:41.458 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:35:41.811 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:35:41.813 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:36:11.871 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:36:11.878 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:36:11.880 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:36:41.948 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:36:41.951 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:36:41.953 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:37:12.142 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:37:12.145 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:37:12.148 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:37:42.216 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:37:42.220 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:37:42.223 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:38:12.280 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:38:12.284 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:38:12.286 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:38:42.572 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:38:51.587 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:38:51.589 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:39:21.711 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:39:21.714 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:39:21.716 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:39:51.783 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:39:51.786 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:39:51.788 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:40:21.879 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:40:21.882 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:40:21.884 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:40:51.973 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:40:51.976 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:40:51.979 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:41:22.028 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:41:22.032 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:41:22.035 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:41:52.122 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:41:52.125 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:41:52.128 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:42:22.226 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:42:22.229 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:42:22.232 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:42:52.356 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:42:52.361 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:42:52.365 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:43:22.471 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:43:22.474 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:43:22.477 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:43:52.986 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:43:52.989 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:43:52.992 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:44:23.041 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:44:23.045 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:44:23.047 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:44:53.117 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:44:53.120 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:44:53.123 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:45:23.212 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:45:23.215 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:45:23.218 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:45:53.382 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:45:53.386 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:45:53.388 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:46:23.437 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:46:33.717 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:46:33.720 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:47:03.799 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:47:03.802 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:47:03.805 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:47:33.930 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:47:33.933 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:47:33.936 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:48:03.986 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:48:03.990 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:48:03.992 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:48:34.168 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:48:34.171 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:48:34.173 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:49:04.217 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:49:04.220 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:49:04.222 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:49:34.288 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:49:34.291 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:49:34.293 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:50:04.642 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:50:04.645 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:50:04.648 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:50:04.667 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T06:50:04.664+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45422) UID: 0 2023-11-16T06:50:04.668 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T06:50:04.664+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45422) UID: 0 2023-11-16T06:50:04.668 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T06:50:04.664+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45422) UID: 0 2023-11-16T06:50:04.669 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T06:50:04.664+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45422) UID: 0 2023-11-16T06:52:07.804 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:52:07.808 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:52:07.811 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:52:37.950 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:52:37.954 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:52:37.956 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:53:08.055 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:53:08.058 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:53:08.060 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:53:38.183 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:53:38.186 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:53:38.188 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:54:08.328 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:54:08.331 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:54:08.334 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:54:38.381 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:54:38.384 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:54:38.387 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:55:08.514 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:55:08.518 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:55:08.522 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:55:38.621 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:55:38.625 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:55:38.627 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:56:08.683 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:56:08.687 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:56:08.689 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:56:38.740 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:56:38.743 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:56:38.746 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:57:08.831 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:57:08.834 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:57:08.836 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:57:38.954 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:57:38.957 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:57:38.959 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:58:09.062 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:58:09.066 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:58:09.069 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:58:39.191 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:58:39.195 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:58:39.197 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:59:09.294 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:59:09.297 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:59:09.299 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:59:39.415 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:59:39.419 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T06:59:39.421 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:00:09.502 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:00:09.507 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:00:09.509 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:00:39.559 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:00:39.563 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:00:39.565 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:01:09.617 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:01:09.620 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:01:09.623 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:01:39.731 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:01:39.735 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:01:39.738 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:02:09.806 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:02:09.809 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:02:09.812 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:02:39.945 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:02:39.950 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:02:39.952 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:03:10.926 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:03:10.930 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:03:10.933 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:03:41.383 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:03:41.386 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:03:41.388 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:04:11.431 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:04:11.433 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:04:11.436 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:04:41.539 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:04:41.543 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:04:41.545 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:05:11.710 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:05:11.713 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:05:11.715 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:05:41.796 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:05:41.799 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:05:41.802 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:06:11.908 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:06:11.911 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:06:11.913 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:06:41.965 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:06:41.968 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:06:41.970 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:07:12.048 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:07:12.052 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:07:12.054 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:07:42.136 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:07:42.139 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:07:42.141 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:08:12.241 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:08:12.244 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:08:12.247 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:08:42.359 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:08:42.362 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:08:42.365 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:09:12.479 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:09:12.482 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:09:12.485 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:09:42.582 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:09:42.585 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:09:42.588 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:10:12.653 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:10:12.656 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:10:12.659 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:10:42.809 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:10:42.813 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:10:42.816 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:11:12.884 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:11:12.887 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:11:12.890 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:11:42.939 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:11:42.942 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:11:42.944 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:12:13.080 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:12:13.083 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:12:13.085 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:12:43.161 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:12:43.164 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:12:43.166 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:13:13.256 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:13:13.259 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:13:13.261 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:13:43.359 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:13:43.363 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:13:43.365 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:14:13.479 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:14:13.483 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:14:13.485 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:14:13.504 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T07:14:13.500+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45581) UID: 0 2023-11-16T07:14:13.505 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T07:14:13.500+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45581) UID: 0 2023-11-16T07:14:13.505 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T07:14:13.500+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45581) UID: 0 2023-11-16T07:14:13.505 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T07:14:13.500+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45581) UID: 0 2023-11-16T07:16:15.602 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:16:15.606 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:16:15.609 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:16:45.789 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:16:45.792 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:16:45.795 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:17:15.859 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:17:15.864 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:17:15.867 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:17:46.000 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:17:46.004 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:17:46.006 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:18:16.205 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:18:16.208 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:18:16.211 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:18:46.267 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:18:46.270 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:18:46.273 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:19:16.557 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:19:16.561 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:19:16.563 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:19:46.643 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:19:46.646 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:19:46.648 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:20:16.747 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:20:16.750 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:20:16.753 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:20:46.817 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:20:46.820 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:20:46.823 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:21:16.962 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:21:16.965 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:21:16.968 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:21:47.057 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:21:47.060 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:21:47.063 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:22:17.126 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:22:17.130 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:22:17.134 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:22:47.414 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:22:47.417 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:22:47.420 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:23:17.467 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:23:17.470 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:23:17.472 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:23:47.580 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:23:47.583 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:23:47.586 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:24:17.699 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:24:17.702 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:24:17.705 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:24:47.819 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:24:47.823 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:24:47.826 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:25:17.873 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:25:17.876 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:25:17.879 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:25:47.952 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:25:47.954 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:25:47.957 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:26:18.007 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:26:18.010 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:26:18.013 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:26:48.059 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:26:48.062 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:26:48.065 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:27:18.216 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:27:18.219 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:27:18.222 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:27:48.339 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:27:48.342 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:27:48.345 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:28:18.395 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:28:18.399 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:28:18.402 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:28:48.480 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:28:48.484 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:28:48.486 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:29:18.601 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:29:18.604 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:29:18.606 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:29:49.123 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:29:49.126 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:29:49.128 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:30:19.174 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:30:19.178 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:30:19.180 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:30:49.245 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:30:49.251 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:30:49.253 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:31:19.952 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:31:19.955 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:31:19.958 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:31:50.071 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:31:50.075 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:31:50.077 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:32:20.123 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:32:20.126 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:32:20.129 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:32:50.193 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:32:50.197 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:32:50.200 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:33:20.313 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:33:20.316 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:33:20.319 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:33:50.400 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:33:50.403 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:33:50.406 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:34:20.496 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:34:20.499 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:34:20.501 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:34:50.590 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:34:50.594 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:34:50.596 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:35:20.753 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:35:20.756 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:35:20.758 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:35:50.831 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:35:50.834 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:35:50.837 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:36:20.908 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:36:20.912 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:36:20.915 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:36:51.003 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:36:51.006 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:36:51.009 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:37:21.125 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:37:21.128 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:37:21.130 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:37:51.228 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:37:51.231 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:37:51.234 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:38:21.357 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:38:21.360 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:38:21.362 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:38:21.381 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T07:38:21.377+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45728) UID: 0 2023-11-16T07:38:21.381 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T07:38:21.377+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45728) UID: 0 2023-11-16T07:38:21.382 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T07:38:21.377+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45728) UID: 0 2023-11-16T07:38:21.382 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T07:38:21.377+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45728) UID: 0 2023-11-16T07:40:23.723 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:40:23.726 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:40:23.729 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:40:53.816 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:40:53.822 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:40:53.824 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:41:23.915 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:41:23.919 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:41:23.922 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:41:53.997 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:41:54.001 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:41:54.004 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:42:24.075 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:42:24.078 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:42:24.081 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:42:54.358 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:42:54.361 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:42:54.364 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:43:24.417 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:43:24.420 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:43:24.422 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:43:54.485 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:43:54.488 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:43:54.491 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:44:24.589 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:44:24.592 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:44:24.594 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:44:54.717 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:44:54.721 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:44:54.723 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:45:24.770 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:45:24.773 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:45:24.776 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:45:54.850 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:45:54.853 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:45:54.855 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:46:24.937 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:46:24.940 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:46:24.943 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:46:55.066 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:46:55.069 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:46:55.072 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:47:25.177 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:47:25.180 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:47:25.183 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:47:55.280 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:47:55.283 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:47:55.286 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:48:25.384 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:48:25.388 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:48:25.391 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:48:55.472 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:48:55.474 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:48:55.477 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:49:25.611 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:49:25.615 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:49:25.618 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:49:55.753 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:49:55.756 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:49:55.760 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:50:25.857 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:50:25.861 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:50:25.863 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:50:55.988 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:50:55.991 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:50:55.993 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:51:26.198 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:51:26.201 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:51:26.204 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:51:56.276 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:51:56.280 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:51:56.283 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:52:26.360 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:52:26.363 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:52:26.366 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:52:56.772 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:52:56.775 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:52:56.778 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:53:26.829 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:53:26.832 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:53:26.834 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:53:56.985 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:53:56.989 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:53:56.992 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:54:27.125 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:54:27.129 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:54:27.132 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:54:57.194 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:54:57.197 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:54:57.200 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:55:27.279 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:55:27.283 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:55:27.285 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:55:57.636 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:55:57.640 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:55:57.642 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:56:27.751 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:56:27.754 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:56:27.757 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:56:57.900 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:56:57.903 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:56:57.906 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:57:28.038 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:57:28.042 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:57:28.045 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:57:58.462 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:57:58.465 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:57:58.468 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:58:28.519 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:58:28.523 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:58:28.525 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:58:58.612 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:58:58.616 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:58:58.618 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:59:28.767 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:59:28.770 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:59:28.773 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:59:59.294 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:59:59.298 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T07:59:59.300 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:00:29.346 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:00:29.349 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:00:29.351 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:00:59.459 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:00:59.462 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:00:59.465 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:01:29.546 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:01:29.549 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:01:29.552 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:01:59.649 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:01:59.652 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:01:59.654 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:02:29.744 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:02:29.748 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:02:29.750 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:02:29.766 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T08:02:29.760+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45916) UID: 0 2023-11-16T08:02:29.766 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T08:02:29.760+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45916) UID: 0 2023-11-16T08:02:29.767 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T08:02:29.760+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45916) UID: 0 2023-11-16T08:02:29.767 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T08:02:29.760+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45916) UID: 0 2023-11-16T08:04:31.693 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:04:31.697 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:04:31.700 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:05:01.769 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:05:01.772 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:05:01.774 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:05:31.890 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:05:31.893 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:05:31.896 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:06:01.976 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:06:01.979 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:06:01.982 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:06:32.079 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:06:32.082 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:06:32.084 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:07:02.266 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:07:02.269 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:07:02.271 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:07:32.403 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:07:32.406 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:07:32.409 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:08:02.490 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:08:02.494 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:08:02.496 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:08:33.036 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:08:33.039 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:08:33.042 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:09:03.094 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:09:03.097 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:09:03.100 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:09:33.183 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:09:33.187 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:09:33.189 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:10:03.312 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:10:03.315 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:10:03.318 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:10:33.405 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:10:33.408 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:10:33.411 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:11:03.535 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:11:03.538 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:11:03.540 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:11:33.584 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:11:33.590 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:11:33.592 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:12:03.693 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:12:03.696 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:12:03.698 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:12:33.847 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:12:33.850 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:12:33.853 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:13:03.941 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:13:03.944 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:13:03.947 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:13:34.676 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:13:34.680 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:13:34.683 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:14:04.732 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:14:04.736 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:14:04.746 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:14:34.865 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:14:34.868 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:14:34.871 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:15:04.929 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:15:04.933 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:15:04.936 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:15:35.015 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:15:35.019 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:15:35.024 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:16:05.153 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:16:05.157 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:16:05.159 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:16:35.207 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:16:35.211 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:16:35.213 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:17:05.301 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:17:05.305 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:17:05.308 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:17:35.417 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:17:36.645 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:17:36.648 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:18:06.851 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:18:06.855 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:18:06.857 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:18:36.911 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:18:36.915 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:18:36.919 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:19:07.032 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:19:07.035 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:19:07.038 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:19:37.188 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:19:37.191 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:19:37.193 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:20:07.318 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:20:07.322 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:20:07.324 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:20:37.375 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:20:37.377 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:20:37.380 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:21:07.587 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:21:07.590 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:21:07.593 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:21:37.690 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:21:37.693 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:21:37.695 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:22:07.753 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:22:07.756 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:22:07.758 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:22:38.203 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:22:38.206 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:22:38.209 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:23:08.258 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:23:08.261 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:23:08.264 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:23:38.372 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:23:38.375 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:23:38.378 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:24:08.512 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:24:08.515 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:24:08.517 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:24:38.644 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:24:38.647 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:24:38.650 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:25:08.750 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:25:08.753 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:25:08.755 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:25:38.814 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:25:38.817 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:25:38.820 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:26:09.005 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:26:09.008 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:26:09.011 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:26:39.060 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:26:39.063 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:26:39.066 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:26:39.081 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T08:26:39.076+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46060) UID: 0 2023-11-16T08:26:39.082 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T08:26:39.076+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46060) UID: 0 2023-11-16T08:26:39.082 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T08:26:39.076+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46060) UID: 0 2023-11-16T08:26:39.082 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T08:26:39.076+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46060) UID: 0 2023-11-16T08:28:40.849 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:28:40.852 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:28:40.855 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:29:10.983 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:29:10.986 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:29:10.988 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:29:41.079 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:29:41.083 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:29:41.085 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:30:11.198 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:30:11.202 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:30:11.204 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:30:41.261 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:30:41.264 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:30:41.266 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:31:11.397 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:31:11.400 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:31:11.402 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:31:41.449 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:31:41.452 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:31:41.454 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:32:11.562 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:32:11.565 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:32:11.567 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:32:41.629 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:32:41.632 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:32:41.635 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:33:12.129 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:33:12.131 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:33:12.134 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:33:42.188 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:33:42.191 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:33:42.194 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:34:12.247 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:34:12.250 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:34:12.253 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:34:42.337 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:34:42.340 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:34:42.342 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:35:12.457 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:35:12.460 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:35:12.462 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:35:42.660 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:35:42.663 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:35:42.666 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:36:12.731 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:36:12.734 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:36:12.736 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:36:42.867 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:36:42.872 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:36:42.875 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:37:12.952 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:37:12.956 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:37:12.958 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:37:43.024 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:37:43.028 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:37:43.031 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:38:13.078 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:38:13.081 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:38:13.083 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:38:43.148 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:38:43.181 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:38:43.184 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:39:13.232 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:39:13.236 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:39:13.238 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:39:43.346 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:39:43.349 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:39:43.352 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:40:13.460 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:40:13.463 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:40:13.466 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:40:43.514 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:40:43.517 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:40:43.519 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:41:13.703 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:41:13.706 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:41:13.709 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:41:43.863 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:41:43.866 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:41:43.869 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:42:13.940 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:42:13.943 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:42:13.945 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:42:44.011 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:42:44.014 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:42:44.016 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:43:14.097 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:43:14.100 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:43:14.103 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:43:44.210 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:43:44.213 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:43:44.216 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:44:14.338 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:44:14.342 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:44:14.344 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:44:44.392 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:44:44.395 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:44:44.397 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:45:14.640 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:45:14.644 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:45:14.646 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:45:44.699 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:45:44.702 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:45:44.705 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:46:15.446 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:46:15.449 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:46:15.451 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:46:45.508 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:46:45.511 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:46:45.513 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:47:15.590 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:47:15.594 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:47:15.597 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:47:45.730 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:47:45.734 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:47:45.736 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:48:15.795 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:48:15.798 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:48:15.802 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:48:45.854 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:48:45.858 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:48:45.861 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:49:15.990 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:49:15.994 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:49:15.997 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:49:46.147 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:49:46.150 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:49:46.153 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:50:16.222 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:50:16.225 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:50:16.227 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:50:46.292 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:50:46.296 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:50:46.298 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:50:46.316 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T08:50:46.313+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46196) UID: 0 2023-11-16T08:50:46.316 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T08:50:46.313+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46196) UID: 0 2023-11-16T08:50:46.316 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T08:50:46.313+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46196) UID: 0 2023-11-16T08:50:46.317 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T08:50:46.313+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46196) UID: 0 2023-11-16T08:52:48.910 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:52:48.914 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:52:48.917 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:53:19.010 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:53:19.014 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:53:19.017 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:53:49.162 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:53:49.165 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:53:49.167 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:54:19.225 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:54:19.228 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:54:19.231 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:54:49.330 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:54:49.334 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:54:49.338 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:55:19.418 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:55:19.422 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:55:19.425 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:55:49.521 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:55:49.525 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:55:49.528 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:56:19.674 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:56:19.678 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:56:19.681 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:56:49.778 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:56:49.782 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:56:49.784 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:57:20.082 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:57:20.085 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:57:20.087 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:57:50.570 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:57:50.574 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:57:50.577 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:58:20.679 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:58:20.683 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:58:20.687 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:58:50.735 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:58:50.738 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:58:50.741 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:59:20.863 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:59:20.866 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:59:20.869 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:59:51.066 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:59:51.070 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T08:59:51.072 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:00:21.203 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:00:21.206 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:00:21.210 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:00:51.260 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:00:51.265 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:00:51.267 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:01:21.419 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:01:21.421 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:01:21.424 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:01:51.565 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:01:51.568 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:01:51.570 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:02:21.713 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:02:21.717 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:02:21.720 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:02:51.868 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:02:51.872 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:02:51.874 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:03:21.942 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:03:21.945 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:03:21.948 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:03:52.027 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:03:52.030 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:03:52.033 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:04:22.658 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:04:22.662 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:04:22.664 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:04:52.711 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:04:52.714 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:04:52.716 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:05:22.805 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:05:22.809 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:05:22.812 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:05:52.927 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:05:52.931 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:05:52.934 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:06:23.080 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:06:23.083 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:06:23.086 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:06:53.158 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:06:53.160 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:06:53.163 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:07:23.219 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:07:23.222 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:07:23.224 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:07:53.275 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:07:53.278 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:07:53.281 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:08:23.368 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:08:23.371 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:08:23.374 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:08:53.480 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:08:53.484 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:08:53.487 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:09:23.627 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:09:23.630 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:09:23.634 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:09:53.687 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:09:53.691 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:09:53.694 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:10:23.791 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:10:23.794 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:10:23.797 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:10:53.846 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:10:53.849 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:10:53.852 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:11:24.341 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:11:24.344 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:11:24.347 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:11:54.420 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:11:54.424 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:11:54.427 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:12:24.476 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:12:24.479 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:12:24.481 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:12:54.551 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:12:54.554 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:12:54.556 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:13:24.604 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:13:24.607 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:13:24.610 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:13:54.745 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:13:54.748 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:13:54.751 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:14:24.904 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:14:24.908 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:14:24.910 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:14:54.957 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:14:54.960 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:14:54.963 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:14:54.981 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T09:14:54.977+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46338) UID: 0 2023-11-16T09:14:54.981 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T09:14:54.977+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46338) UID: 0 2023-11-16T09:14:54.981 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T09:14:54.977+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46338) UID: 0 2023-11-16T09:14:54.982 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T09:14:54.977+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46338) UID: 0 2023-11-16T09:16:57.383 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:16:57.387 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:16:57.390 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:17:27.536 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:17:27.540 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:17:27.543 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:17:57.679 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:17:57.683 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:17:57.686 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:18:27.733 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:18:27.736 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:18:27.738 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:18:57.897 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:18:57.900 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:18:57.903 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:19:28.007 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:19:28.010 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:19:28.013 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:19:58.135 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:19:59.579 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:19:59.582 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:20:29.723 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:20:29.726 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:20:29.728 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:20:59.775 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:21:00.024 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:21:00.027 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:21:30.071 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:21:30.074 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:21:30.076 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:22:00.158 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:22:00.161 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:22:00.163 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:22:30.596 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:22:30.599 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:22:30.601 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:23:00.647 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:23:00.650 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:23:00.653 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:23:30.744 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:23:30.747 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:23:30.749 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:24:00.864 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:24:00.867 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:24:00.870 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:24:30.933 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:24:30.937 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:24:30.940 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:25:01.039 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:25:01.043 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:25:01.046 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:25:31.179 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:25:31.182 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:25:31.185 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:26:01.287 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:26:01.291 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:26:01.294 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:26:31.344 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:26:31.347 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:26:31.349 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:27:01.652 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:27:01.655 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:27:01.659 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:27:31.707 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:27:31.711 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:27:31.714 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:28:01.802 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:28:01.805 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:28:01.808 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:28:31.930 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:28:31.934 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:28:31.936 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:29:02.449 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:29:02.453 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:29:02.455 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:29:32.494 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:29:32.497 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:29:32.500 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:30:02.630 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:30:02.635 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:30:02.638 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:30:32.768 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:30:32.771 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:30:32.774 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:31:02.916 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:31:02.919 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:31:02.921 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:31:33.073 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:31:33.078 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:31:33.081 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:32:03.222 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:32:03.226 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:32:03.229 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:32:33.517 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:32:33.520 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:32:33.523 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:33:03.576 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:33:03.579 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:33:03.581 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:33:33.690 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:33:33.694 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:33:33.696 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:34:03.746 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:34:03.749 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:34:03.751 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:34:33.797 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:34:33.800 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:34:33.802 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:35:03.967 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:35:03.970 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:35:03.973 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:35:34.096 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:35:34.099 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:35:34.101 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:36:04.163 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:36:04.166 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:36:04.168 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:36:34.286 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:36:34.289 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:36:34.292 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:37:04.366 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:37:04.370 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:37:04.373 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:37:34.945 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:37:34.948 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:37:34.951 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:38:05.004 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:38:05.007 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:38:05.010 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:38:35.128 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:38:35.133 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:38:35.135 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:39:05.187 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:39:05.191 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:39:05.193 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:39:05.210 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T09:39:05.205+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46483) UID: 0 2023-11-16T09:39:05.211 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T09:39:05.205+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46483) UID: 0 2023-11-16T09:39:05.211 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T09:39:05.205+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46483) UID: 0 2023-11-16T09:39:05.212 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T09:39:05.205+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46483) UID: 0 2023-11-16T09:41:07.621 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:41:07.624 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:41:07.626 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:41:37.747 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:41:37.751 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:41:37.755 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:42:07.903 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:42:07.906 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:42:07.909 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:42:38.010 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:42:38.014 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:42:38.017 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:43:08.126 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:43:08.129 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:43:08.132 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:43:38.229 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:43:38.233 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:43:38.237 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:44:08.333 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:44:08.337 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:44:08.341 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:44:38.480 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:44:38.483 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:44:38.487 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:45:08.592 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:45:08.597 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:45:08.600 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:45:38.680 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:45:38.684 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:45:38.686 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:46:08.789 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:46:08.794 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:46:08.797 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:46:39.044 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:46:39.049 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:46:39.052 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:47:09.249 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:47:09.252 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:47:09.255 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:47:39.298 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:47:39.301 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:47:39.304 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:48:09.414 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:48:09.418 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:48:09.421 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:48:39.537 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:48:39.545 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:48:39.549 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:49:09.654 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:49:09.658 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:49:09.660 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:49:39.824 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:49:39.828 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:49:39.831 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:50:09.919 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:50:09.923 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:50:09.925 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:50:40.090 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:50:40.092 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:50:40.095 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:51:10.177 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:51:10.181 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:51:10.184 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:51:40.297 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:51:40.301 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:51:40.303 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:52:10.667 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:52:10.671 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:52:10.673 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:52:40.721 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:52:40.725 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:52:40.728 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:53:11.340 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:53:11.343 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:53:11.345 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:53:41.419 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:53:41.423 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:53:41.425 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:54:11.474 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:54:11.477 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:54:11.479 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:54:41.885 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:54:41.888 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:54:41.891 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:55:11.946 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:55:11.949 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:55:11.951 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:55:42.086 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:55:42.090 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:55:42.092 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:56:12.145 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:56:12.148 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:56:12.150 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:56:42.206 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:56:42.209 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:56:42.212 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:57:12.345 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:57:12.349 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:57:12.351 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:57:42.590 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:57:42.594 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:57:42.596 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:58:12.701 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:58:12.704 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:58:12.707 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:58:43.039 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:58:43.043 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:58:43.045 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:59:13.099 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:59:13.103 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:59:13.105 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:59:43.204 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:59:43.207 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T09:59:43.210 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:00:13.299 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:00:13.303 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:00:13.306 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:00:43.419 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:00:43.422 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:00:43.425 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:01:13.472 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:01:13.476 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:01:13.478 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:01:43.539 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:01:43.543 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:01:43.546 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:02:13.617 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:02:13.620 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:02:13.623 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:02:43.672 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:02:43.676 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:02:43.678 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:03:13.787 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:03:13.790 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:03:13.792 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:03:13.810 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T10:03:13.805+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46618) UID: 0 2023-11-16T10:03:13.810 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T10:03:13.805+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46618) UID: 0 2023-11-16T10:03:13.811 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T10:03:13.805+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46618) UID: 0 2023-11-16T10:03:13.811 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T10:03:13.805+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46618) UID: 0 2023-11-16T10:05:15.946 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:05:15.949 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:05:15.952 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:05:46.064 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:05:46.067 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:05:46.069 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:06:16.185 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:06:16.188 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:06:16.191 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:06:46.321 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:06:46.325 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:06:46.327 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:07:16.476 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:07:16.481 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:07:16.484 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:07:46.746 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:07:46.750 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:07:46.752 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:08:16.875 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:08:16.878 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:08:16.880 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:08:46.923 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:08:46.926 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:08:46.928 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:09:17.424 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:09:17.427 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:09:17.429 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:09:47.477 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:09:47.480 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:09:47.482 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:10:17.542 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:10:17.545 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:10:17.548 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:10:47.649 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:10:47.652 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:10:47.654 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:11:17.705 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:11:17.708 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:11:17.710 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:11:47.821 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:11:47.824 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:11:47.827 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:12:17.952 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:12:17.955 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:12:17.958 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:12:48.209 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:12:48.212 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:12:48.215 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:13:18.573 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:13:18.577 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:13:18.579 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:13:48.629 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:13:48.632 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:13:48.637 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:14:18.752 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:14:18.755 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:14:18.757 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:14:48.808 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:14:48.812 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:14:48.815 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:15:18.872 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:15:18.875 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:15:18.878 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:15:49.212 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:15:49.216 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:15:49.218 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:16:19.264 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:16:19.267 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:16:19.270 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:16:49.568 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:16:49.571 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:16:49.574 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:17:19.638 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:17:19.642 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:17:19.645 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:17:49.768 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:17:49.771 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:17:49.774 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:18:19.880 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:18:19.883 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:18:19.886 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:18:50.000 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:18:50.003 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:18:50.006 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:19:20.095 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:19:20.098 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:19:20.101 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:19:50.206 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:19:50.209 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:19:50.212 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:20:20.327 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:20:20.330 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:20:20.332 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:20:50.467 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:20:50.470 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:20:50.473 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:21:20.541 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:21:20.544 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:21:20.546 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:21:50.628 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:21:50.632 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:21:50.634 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:22:20.707 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:22:20.710 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:22:20.713 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:22:50.761 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:22:50.764 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:22:50.766 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:23:20.864 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:23:20.868 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:23:20.871 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:23:50.982 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:23:50.987 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:23:50.990 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:24:21.038 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:24:21.042 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:24:21.045 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:24:51.112 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:24:51.116 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:24:51.119 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:25:21.260 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:25:21.263 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:25:21.266 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:25:51.391 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:25:51.395 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:25:51.397 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:26:21.456 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:26:21.459 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:26:21.461 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:26:51.621 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:26:51.625 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:26:51.627 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:27:21.752 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:27:21.755 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:27:21.757 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:27:21.774 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T10:27:21.769+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46762) UID: 0 2023-11-16T10:27:21.774 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T10:27:21.769+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46762) UID: 0 2023-11-16T10:27:21.774 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T10:27:21.769+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46762) UID: 0 2023-11-16T10:27:21.775 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T10:27:21.769+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46762) UID: 0 2023-11-16T10:29:23.984 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:29:23.989 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:29:23.992 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:29:54.044 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:29:54.047 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:29:54.050 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:30:24.190 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:30:24.194 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:30:24.196 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:30:54.245 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:30:54.249 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:30:54.252 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:31:24.364 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:31:24.367 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:31:24.370 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:31:54.499 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:31:54.503 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:31:54.506 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:32:24.671 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:32:24.674 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:32:24.677 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:32:54.799 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:32:54.802 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:32:54.805 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:33:24.945 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:33:24.948 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:33:24.950 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:33:55.001 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:33:55.005 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:33:55.007 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:34:25.494 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:34:25.497 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:34:25.500 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:34:55.546 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:34:55.550 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:34:55.554 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:35:25.678 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:35:25.682 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:35:25.684 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:35:55.751 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:35:55.755 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:35:55.757 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:36:25.807 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:36:25.811 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:36:25.813 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:36:55.881 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:36:55.885 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:36:55.888 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:37:25.965 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:37:25.970 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:37:25.972 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:37:56.029 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:37:56.032 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:37:56.034 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:38:26.084 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:38:26.088 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:38:26.090 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:38:56.149 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:38:56.153 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:38:56.155 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:39:26.263 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:39:26.267 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:39:26.269 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:39:56.420 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:39:56.423 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:39:56.426 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:40:26.476 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:40:26.479 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:40:26.482 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:40:56.999 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:40:57.003 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:40:57.005 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:41:27.095 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:41:27.098 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:41:27.101 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:41:57.254 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:41:57.257 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:41:57.261 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:42:27.401 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:42:27.404 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:42:27.407 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:42:57.462 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:42:57.465 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:42:57.468 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:43:27.618 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:43:27.622 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:43:27.624 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:43:57.929 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:43:57.932 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:43:57.936 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:44:28.057 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:44:28.061 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:44:28.063 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:44:58.176 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:44:58.179 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:44:58.181 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:45:28.280 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:45:28.284 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:45:28.286 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:45:58.392 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:45:58.396 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:45:58.399 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:46:28.445 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:46:28.449 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:46:28.452 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:46:58.535 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:46:58.538 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:46:58.540 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:47:29.228 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:47:33.502 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:47:33.506 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:48:03.556 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:48:03.560 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:48:03.562 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:48:34.067 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:48:34.071 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:48:34.073 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:49:04.119 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:49:04.121 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:49:04.124 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:49:34.218 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:49:37.519 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:49:37.522 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:50:07.638 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:50:07.641 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:50:07.645 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:50:37.698 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:50:37.701 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:50:37.703 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:51:07.977 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:51:07.980 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:51:07.982 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:51:38.089 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:51:44.335 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:51:44.338 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:51:44.357 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T10:51:44.353+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46899) UID: 0 2023-11-16T10:51:44.358 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T10:51:44.353+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46899) UID: 0 2023-11-16T10:51:44.358 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T10:51:44.353+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46899) UID: 0 2023-11-16T10:51:44.358 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T10:51:44.353+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46899) UID: 0 2023-11-16T10:53:47.178 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:53:47.182 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:53:47.185 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:54:17.297 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:54:17.302 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:54:17.305 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:54:47.417 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:54:47.421 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:54:47.424 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:55:17.546 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:55:17.549 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:55:17.551 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:55:47.832 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:55:47.836 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:55:47.838 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:56:17.894 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:56:17.897 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:56:17.900 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:56:48.056 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:56:48.059 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:56:48.062 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:57:18.134 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:57:18.139 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:57:18.142 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:57:48.689 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:57:48.692 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:57:48.694 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:58:18.742 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:58:18.746 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:58:18.750 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:58:49.029 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:58:49.033 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:58:49.035 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:59:19.148 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:59:19.151 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:59:19.154 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:59:49.218 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:59:49.222 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T10:59:49.225 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:00:19.344 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:00:19.351 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:00:19.354 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:00:49.465 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:00:49.479 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:00:49.483 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:01:19.578 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:01:19.582 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:01:19.585 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:01:49.787 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:01:49.791 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:01:49.794 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:02:19.861 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:02:19.870 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:02:19.874 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:02:49.924 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:02:49.930 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:02:49.934 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:03:20.052 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:03:20.057 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:03:20.059 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:03:50.362 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:03:50.365 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:03:50.367 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:04:20.890 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:04:20.894 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:04:20.897 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:04:50.959 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:04:50.962 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:04:50.965 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:05:21.080 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:05:21.083 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:05:21.086 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:05:51.213 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:05:51.216 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:05:51.218 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:06:21.377 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:06:21.380 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:06:21.383 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:06:51.525 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:06:51.528 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:06:51.531 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:07:21.765 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:07:21.768 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:07:21.771 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:07:51.822 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:07:51.825 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:07:51.828 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:08:21.958 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:08:21.961 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:08:21.963 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:08:52.120 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:08:52.124 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:08:52.126 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:09:22.173 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:09:22.176 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:09:22.179 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:09:52.287 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:09:52.290 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:09:52.293 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:10:22.428 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:10:22.431 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:10:22.433 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:10:52.584 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:10:52.587 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:10:52.590 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:11:22.657 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:11:22.660 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:11:22.663 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:11:52.739 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:11:52.742 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:11:52.745 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:12:22.824 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:12:22.827 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:12:22.830 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:12:52.871 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:12:52.883 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:12:52.886 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:13:23.224 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:13:23.228 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:13:23.231 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:13:53.295 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:13:53.299 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:13:53.302 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:14:23.390 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:14:23.393 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:14:23.395 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:14:53.552 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:14:53.557 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:14:53.560 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:15:23.616 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:15:23.620 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:15:23.622 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:15:53.680 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:15:53.683 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:15:53.685 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:15:53.702 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T11:15:53.697+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47037) UID: 0 2023-11-16T11:15:53.702 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T11:15:53.697+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47037) UID: 0 2023-11-16T11:15:53.702 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T11:15:53.697+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47037) UID: 0 2023-11-16T11:15:53.703 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T11:15:53.697+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47037) UID: 0 2023-11-16T11:17:56.425 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:17:56.428 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:17:56.431 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:18:26.668 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:18:26.671 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:18:26.674 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:18:56.829 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:18:56.833 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:18:56.835 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:19:26.958 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:19:26.961 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:19:26.964 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:19:57.077 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:19:57.080 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:19:57.083 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:20:27.161 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:20:27.164 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:20:27.166 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:20:57.309 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:20:57.313 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:20:57.317 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:21:27.397 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:21:27.400 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:21:27.403 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:21:57.908 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:21:57.912 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:21:57.914 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:22:27.961 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:22:27.964 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:22:27.967 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:22:58.056 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:22:58.061 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:22:58.065 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:23:28.416 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:23:28.419 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:23:28.421 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:23:58.663 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:23:58.667 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:23:58.669 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:24:28.869 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:24:28.873 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:24:28.877 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:24:58.925 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:24:58.928 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:24:58.931 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:25:28.983 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:25:28.987 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:25:28.989 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:25:59.122 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:25:59.126 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:25:59.128 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:26:29.199 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:26:29.208 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:26:29.213 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:26:59.317 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:26:59.321 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:26:59.324 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:27:29.403 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:27:29.407 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:27:29.410 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:27:59.480 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:27:59.483 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:27:59.486 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:28:29.560 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:28:29.563 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:28:29.566 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:28:59.923 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:28:59.926 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:28:59.929 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:29:30.034 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:29:30.038 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:29:30.042 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:30:00.129 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:30:00.132 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:30:00.134 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:30:30.257 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:30:30.260 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:30:30.262 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:31:00.349 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:31:00.352 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:31:00.355 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:31:30.430 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:31:30.433 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:31:30.436 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:32:00.526 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:32:00.529 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:32:00.531 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:32:30.612 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:32:30.615 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:32:30.617 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:33:00.740 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:33:00.743 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:33:00.745 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:33:30.877 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:33:30.881 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:33:30.883 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:34:01.081 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:34:01.085 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:34:01.088 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:34:31.734 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:34:31.737 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:34:31.740 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:35:01.833 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:35:01.837 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:35:01.839 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:35:31.894 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:35:31.897 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:35:31.900 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:36:02.003 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:36:02.006 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:36:02.008 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:36:32.056 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:36:32.059 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:36:32.062 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:37:02.192 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:37:02.196 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:37:02.198 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:37:32.323 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:37:32.326 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:37:32.329 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:38:02.391 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:38:02.394 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:38:02.397 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:38:32.528 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:38:32.531 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:38:32.533 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:39:02.650 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:39:02.653 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:39:02.656 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:39:32.799 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:39:32.802 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:39:32.805 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:40:02.854 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:40:02.857 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:40:02.860 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:40:02.880 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T11:40:02.877+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47175) UID: 0 2023-11-16T11:40:02.881 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T11:40:02.877+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47175) UID: 0 2023-11-16T11:40:02.881 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T11:40:02.877+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47175) UID: 0 2023-11-16T11:40:02.881 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T11:40:02.877+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47175) UID: 0 2023-11-16T11:42:05.921 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:42:05.925 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:42:05.927 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:42:35.992 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:42:35.997 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:42:36.000 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:43:06.098 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:43:06.102 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:43:06.105 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:43:36.155 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:43:36.158 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:43:36.161 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:44:06.299 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:44:06.307 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:44:06.310 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:44:36.402 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:44:36.409 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:44:36.413 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:45:06.522 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:45:06.526 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:45:06.528 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:45:36.587 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:45:36.590 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:45:36.593 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:46:06.654 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:46:06.658 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:46:06.660 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:46:36.710 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:46:36.714 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:46:36.717 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:47:06.791 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:47:06.794 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:47:06.797 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:47:36.892 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:47:36.895 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:47:36.898 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:48:07.013 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:48:07.018 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:48:07.028 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:48:37.130 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:48:37.133 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:48:37.135 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:49:07.191 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:49:07.194 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:49:07.196 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:49:37.257 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:49:37.261 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:49:37.265 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:50:07.348 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:50:07.352 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:50:07.355 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:50:37.444 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:50:37.452 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:50:37.455 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:51:07.558 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:51:07.562 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:51:07.564 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:51:37.667 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:51:37.670 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:51:37.672 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:52:07.779 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:52:07.782 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:52:07.784 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:52:37.890 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:52:37.893 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:52:37.896 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:53:08.043 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:53:08.048 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:53:08.051 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:53:38.105 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:53:38.108 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:53:38.112 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:54:08.229 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:54:08.233 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:54:08.243 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:54:38.295 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:54:38.299 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:54:38.302 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:55:08.416 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:55:08.419 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:55:08.423 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:55:38.473 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:55:38.476 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:55:38.479 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:56:08.564 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:56:08.567 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:56:08.570 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:56:38.611 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:56:38.614 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:56:38.617 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:57:08.730 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:57:08.733 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:57:08.736 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:57:38.858 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:57:38.861 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:57:38.864 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:58:09.496 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:58:09.499 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:58:09.502 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:58:39.557 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:58:39.560 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:58:39.563 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:59:09.620 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:59:09.623 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:59:09.625 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:59:39.682 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:59:39.684 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T11:59:39.687 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:00:10.285 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:00:10.288 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:00:10.291 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:00:40.338 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:00:40.341 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:00:40.344 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:01:10.392 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:01:13.241 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:01:13.252 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:01:43.306 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:02:13.045 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:02:13.050 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:02:43.159 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:02:43.162 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:02:43.165 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:03:13.224 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:03:13.227 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:03:13.230 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:03:43.349 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:03:43.352 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:03:43.354 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:04:13.486 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:04:28.849 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:04:28.860 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:04:28.874 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T12:04:28.868+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47309) UID: 0 2023-11-16T12:04:28.875 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T12:04:28.868+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47309) UID: 0 2023-11-16T12:04:28.875 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T12:04:28.868+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47309) UID: 0 2023-11-16T12:04:28.876 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T12:04:28.868+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47309) UID: 0 2023-11-16T12:06:33.500 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:06:33.503 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:06:33.506 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:07:03.634 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:07:03.638 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:07:03.640 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:07:33.713 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:07:33.716 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:07:33.718 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:08:03.800 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:08:11.408 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:08:11.442 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:08:41.593 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:08:41.597 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:08:41.600 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:09:11.664 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:09:11.668 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:09:11.671 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:09:41.817 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:09:41.820 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:09:41.823 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:10:11.912 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:10:12.024 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:10:12.050 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:10:42.116 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:10:42.119 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:10:42.121 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:11:12.259 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:11:12.263 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:11:12.266 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:11:42.623 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:11:42.627 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:11:42.629 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:12:12.704 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:12:12.707 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:12:12.710 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:12:42.770 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:12:48.139 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:12:48.141 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:13:18.334 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:13:18.337 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:13:18.340 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:13:48.389 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:13:48.393 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:13:48.396 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:14:18.446 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:14:18.449 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:14:18.452 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:14:48.594 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:14:48.598 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:14:48.601 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:15:18.690 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:15:19.166 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:15:19.171 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:15:49.371 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:15:49.376 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:15:49.385 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:16:19.422 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:16:19.426 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:16:19.431 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:16:49.514 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:16:49.519 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:16:49.522 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:17:19.626 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:17:19.629 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:17:19.631 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:17:49.775 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:17:49.778 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:17:49.780 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:18:19.922 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:18:19.928 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:18:19.931 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:18:50.054 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:18:50.060 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:18:50.068 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:19:20.121 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:19:20.126 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:19:20.128 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:19:50.637 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:19:50.641 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:19:50.643 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:20:20.704 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:20:20.708 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:20:20.720 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:20:51.208 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:20:51.211 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:20:51.214 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:21:21.261 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:21:21.265 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:21:21.267 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:21:51.348 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:21:51.352 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:21:51.354 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:22:21.460 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:22:21.463 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:22:21.467 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:22:51.555 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:22:51.561 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:22:51.564 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:23:21.660 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:23:21.664 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:23:21.666 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:23:51.795 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:23:51.799 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:23:51.801 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:24:21.915 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:24:21.918 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:24:21.921 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:24:52.052 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:24:52.055 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:24:52.058 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:25:22.461 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:25:22.465 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:25:22.467 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:25:52.518 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:25:52.521 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:25:52.523 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:26:22.684 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:26:28.270 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:26:28.272 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:26:58.346 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:26:58.349 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:26:58.352 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:27:28.427 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:27:28.430 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:27:28.433 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:27:58.546 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:27:58.550 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:27:58.552 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:28:29.093 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:28:29.096 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:28:29.098 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:28:59.169 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:28:59.173 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:28:59.175 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:28:59.209 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T12:28:59.203+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47450) UID: 0 2023-11-16T12:28:59.209 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T12:28:59.203+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47450) UID: 0 2023-11-16T12:28:59.209 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T12:28:59.203+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47450) UID: 0 2023-11-16T12:28:59.210 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T12:28:59.203+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47450) UID: 0 2023-11-16T12:31:02.819 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:31:02.823 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:31:02.826 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:31:32.954 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:31:32.958 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:31:32.960 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:32:03.091 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:32:03.094 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:32:03.097 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:32:33.382 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:32:33.385 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:32:33.387 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:33:03.431 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:33:03.434 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:33:03.437 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:33:33.552 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:33:33.555 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:33:33.558 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:34:03.688 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:34:03.691 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:34:03.693 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:34:33.849 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:34:33.856 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:34:33.858 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:35:03.995 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:35:03.998 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:35:04.001 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:35:34.048 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:35:34.051 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:35:34.054 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:36:04.619 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:36:04.623 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:36:04.625 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:36:34.674 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:36:34.677 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:36:34.679 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:37:04.814 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:37:04.817 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:37:04.819 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:37:34.862 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:37:34.866 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:37:34.868 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:38:05.093 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:38:05.097 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:38:05.099 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:38:35.149 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:38:35.152 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:38:35.155 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:39:05.314 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:39:05.318 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:39:05.320 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:39:35.370 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:39:35.374 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:39:35.377 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:40:05.494 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:40:05.497 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:40:05.500 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:40:35.585 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:40:35.589 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:40:35.591 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:41:05.753 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:41:05.756 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:41:05.759 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:41:35.873 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:41:35.876 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:41:35.879 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:42:06.519 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:42:06.522 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:42:06.525 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:42:36.566 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:42:36.571 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:42:36.577 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:43:06.623 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:43:06.627 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:43:06.630 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:43:36.728 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:43:36.731 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:43:36.734 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:44:06.882 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:44:06.885 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:44:06.887 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:44:36.959 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:44:36.962 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:44:36.965 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:45:07.074 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:45:07.078 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:45:07.081 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:45:37.197 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:45:37.200 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:45:37.203 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:46:07.345 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:46:07.350 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:46:07.352 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:46:37.510 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:46:37.514 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:46:37.516 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:47:07.584 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:47:07.589 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:47:07.593 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:47:37.672 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:47:42.643 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:47:42.649 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:48:12.757 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:48:12.763 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:48:12.767 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:48:42.852 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:48:42.855 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:48:42.857 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:49:13.065 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:49:13.068 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:49:13.070 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:49:43.173 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:49:43.176 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:49:43.179 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:50:13.313 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:50:13.316 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:50:13.318 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:50:43.374 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:50:43.377 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:50:43.380 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:51:13.460 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:51:13.464 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:51:13.467 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:51:43.515 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:51:43.518 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:51:43.522 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:52:13.635 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:52:13.638 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:52:13.641 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:52:43.754 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:52:43.757 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:52:43.760 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:53:13.858 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:53:13.862 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:53:13.865 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:53:13.882 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T12:53:13.875+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47588) UID: 0 2023-11-16T12:53:13.883 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T12:53:13.875+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47588) UID: 0 2023-11-16T12:53:13.883 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T12:53:13.875+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47588) UID: 0 2023-11-16T12:53:13.884 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T12:53:13.875+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47588) UID: 0 2023-11-16T12:55:16.808 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:55:16.812 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:55:16.814 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:55:46.875 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:55:46.878 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:55:46.881 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:56:16.954 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:56:18.835 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:56:18.839 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:56:48.895 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:56:48.899 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:56:48.902 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:57:18.974 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:57:18.978 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:57:18.980 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:57:49.034 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:57:49.037 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:57:49.039 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:58:19.088 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:58:19.092 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:58:19.095 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:58:49.147 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:58:49.151 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:58:49.153 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:59:19.208 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:59:25.440 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:59:25.452 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:59:55.506 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:59:55.509 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T12:59:55.512 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:00:25.572 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:00:25.575 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:00:25.578 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:00:55.632 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:00:55.636 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:00:55.638 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:01:25.972 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:01:25.975 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:01:25.978 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:01:56.149 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:01:56.153 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:01:56.156 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:02:26.280 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:02:26.283 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:02:26.286 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:02:56.437 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:02:56.440 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:02:56.443 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:03:26.560 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:03:26.563 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:03:26.565 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:03:56.655 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:03:56.658 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:03:56.660 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:04:26.715 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:04:26.719 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:04:26.721 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:04:56.794 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:04:56.797 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:04:56.800 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:05:26.850 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:05:26.854 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:05:26.856 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:05:56.924 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:05:56.928 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:05:56.930 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:06:27.089 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:06:27.318 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:06:27.321 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:06:57.478 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:06:57.482 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:06:57.484 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:07:27.592 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:07:27.596 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:07:27.598 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:07:58.152 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:07:58.156 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:07:58.158 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:08:28.221 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:08:28.225 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:08:28.227 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:08:58.296 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:08:58.300 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:08:58.303 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:09:28.426 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:09:28.430 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:09:28.433 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:09:59.015 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:09:59.019 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:09:59.021 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:10:29.072 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:10:32.839 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:10:32.894 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:11:03.012 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:11:03.017 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:11:03.020 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:11:33.091 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:11:33.094 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:11:33.097 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:12:03.352 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:12:03.355 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:12:03.358 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:12:33.408 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:12:33.412 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:12:33.414 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:13:03.472 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:13:06.190 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:13:06.287 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:13:36.596 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:13:36.599 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:13:36.602 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:14:06.653 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:14:06.656 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:14:06.659 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:14:36.735 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:14:36.738 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:14:36.741 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:15:06.789 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:15:08.401 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:15:08.407 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:15:38.510 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:15:38.514 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:15:38.517 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:16:08.571 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:16:08.575 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:16:08.577 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:16:38.648 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:16:38.653 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:16:38.656 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:17:08.718 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:17:09.987 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:17:09.989 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:17:40.055 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:17:40.059 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:17:40.061 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:17:40.079 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T13:17:40.071+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47750) UID: 0 2023-11-16T13:17:40.080 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T13:17:40.071+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47750) UID: 0 2023-11-16T13:17:40.080 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T13:17:40.071+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47750) UID: 0 2023-11-16T13:17:40.080 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T13:17:40.071+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47750) UID: 0 2023-11-16T13:19:43.155 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:19:43.159 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:19:43.161 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:20:13.223 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:20:13.227 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:20:13.229 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:20:43.410 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:20:43.413 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:20:43.416 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:21:13.464 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:21:13.468 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:21:13.471 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:21:43.620 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:21:43.625 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:21:43.628 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:22:14.043 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:22:14.046 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:22:14.049 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:22:44.100 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:22:44.104 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:22:44.106 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:23:14.155 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:23:14.159 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:23:14.162 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:23:44.630 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:23:44.634 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:23:44.636 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:24:14.692 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:24:14.696 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:24:14.698 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:24:44.749 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:24:44.752 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:24:44.754 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:25:14.839 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:25:14.844 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:25:14.847 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:25:44.979 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:25:44.982 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:25:44.985 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:26:15.095 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:26:15.098 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:26:15.101 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:26:45.234 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:26:45.238 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:26:45.241 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:27:15.318 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:27:15.322 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:27:15.328 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:27:45.539 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:27:45.543 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:27:45.546 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:28:15.587 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:28:15.591 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:28:15.594 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:28:45.761 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:28:45.764 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:28:45.766 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:29:15.877 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:29:15.880 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:29:15.882 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:29:45.997 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:29:46.001 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:29:46.003 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:30:16.575 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:30:16.578 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:30:16.581 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:30:46.627 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:30:46.632 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:30:46.635 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:31:16.751 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:31:16.754 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:31:16.757 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:31:46.932 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:31:46.935 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:31:46.937 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:32:17.232 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:32:17.236 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:32:17.239 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:32:47.286 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:32:47.289 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:32:47.291 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:33:17.361 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:33:17.365 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:33:17.368 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:33:47.508 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:33:47.511 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:33:47.514 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:34:17.558 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:34:17.561 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:34:17.563 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:34:47.673 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:34:47.677 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:34:47.680 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:35:17.809 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:35:17.811 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:35:17.814 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:35:48.064 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:35:48.068 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:35:48.071 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:36:18.126 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:36:18.130 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:36:18.133 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:36:48.870 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:36:48.873 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:36:48.876 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:37:19.640 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:37:19.644 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:37:19.653 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:37:49.703 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:37:49.706 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:37:49.709 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:38:19.768 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:38:19.772 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:38:19.774 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:38:50.153 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:38:50.156 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:38:50.158 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:39:20.206 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:39:20.210 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:39:20.212 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:39:50.271 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:39:50.274 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:39:50.276 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:40:20.334 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:40:20.338 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:40:20.340 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:40:50.456 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:40:50.459 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:40:50.462 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:41:20.575 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:41:20.579 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:41:20.581 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:41:50.949 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:41:50.952 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:41:50.955 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:41:50.971 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T13:41:50.963+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47888) UID: 0 2023-11-16T13:41:50.972 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T13:41:50.963+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47888) UID: 0 2023-11-16T13:41:50.972 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T13:41:50.963+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47888) UID: 0 2023-11-16T13:41:50.972 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T13:41:50.963+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47888) UID: 0 2023-11-16T13:43:53.578 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:43:53.581 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:43:53.584 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:44:23.912 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:44:23.916 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:44:23.919 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:44:53.969 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:44:53.973 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:44:53.976 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:45:24.070 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:45:29.398 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:45:29.401 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:45:59.524 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:45:59.529 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:45:59.531 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:46:29.587 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:46:29.591 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:46:29.593 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:46:59.814 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:46:59.817 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:46:59.820 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:47:30.101 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:47:30.104 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:47:30.106 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:48:00.158 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:48:00.161 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:48:00.164 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:48:30.273 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:48:30.276 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:48:30.279 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:49:00.328 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:49:00.332 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:49:00.337 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:49:30.440 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:49:30.443 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:49:30.446 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:50:00.525 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:50:00.528 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:50:00.531 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:50:30.972 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:50:30.977 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:50:30.980 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:51:01.029 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:51:01.033 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:51:01.035 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:51:31.169 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:51:31.172 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:51:31.175 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:52:01.407 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:52:01.411 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:52:01.413 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:52:31.457 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:52:31.460 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:52:31.463 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:53:01.589 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:53:01.592 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:53:01.595 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:53:31.765 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:53:31.769 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:53:31.774 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:54:01.888 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:54:03.629 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:54:03.632 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:54:33.767 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:54:33.771 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:54:33.775 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:55:03.828 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:55:03.831 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:55:03.836 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:55:33.965 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:55:33.970 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:55:33.973 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:56:04.062 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:56:04.066 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:56:04.068 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:56:34.132 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:56:34.135 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:56:34.138 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:57:04.276 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:57:04.279 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:57:04.282 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:57:34.694 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:57:34.697 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:57:34.700 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:58:04.747 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:58:04.751 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:58:04.753 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:58:34.896 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:58:34.900 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:58:34.903 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:59:04.967 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:59:04.970 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:59:04.973 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:59:35.323 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:59:35.327 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T13:59:35.335 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:00:05.380 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:00:05.384 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:00:05.387 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:00:35.699 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:00:35.702 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:00:35.704 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:01:05.835 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:01:05.838 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:01:05.841 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:01:35.930 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:01:35.933 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:01:35.935 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:02:06.066 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:02:06.074 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:02:06.077 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:02:36.188 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:02:36.192 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:02:36.195 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:03:06.662 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:03:06.665 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:03:06.667 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:03:36.718 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:03:36.722 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:03:36.726 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:04:06.982 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:04:06.986 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:04:06.990 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:04:37.096 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:04:37.099 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:04:37.102 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:05:07.171 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:05:23.876 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:05:23.911 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:05:53.968 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:05:53.971 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:05:53.974 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:06:24.082 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:06:24.085 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:06:24.088 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:06:24.106 INFO:tasks.ceph.osd.4.smithi070.stderr:2023-11-16T14:06:24.103+0000 7fb4dea75640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48026) UID: 0 2023-11-16T14:06:24.107 INFO:tasks.ceph.osd.6.smithi070.stderr:2023-11-16T14:06:24.103+0000 7fec48668640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48026) UID: 0 2023-11-16T14:06:24.107 INFO:tasks.ceph.osd.5.smithi070.stderr:2023-11-16T14:06:24.103+0000 7f04ab47c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48026) UID: 0 2023-11-16T14:06:24.108 INFO:tasks.ceph.osd.7.smithi070.stderr:2023-11-16T14:06:24.103+0000 7f8a9f314640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48026) UID: 0 2023-11-16T14:08:27.857 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:08:27.861 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:08:27.863 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:08:57.985 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:08:57.989 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:08:57.992 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:09:28.121 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:09:28.125 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:09:28.127 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:09:58.208 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:10:02.615 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:10:02.618 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:10:32.726 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:10:32.729 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:10:32.732 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:11:02.784 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:11:02.787 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:11:02.790 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:11:32.848 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:11:32.851 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:11:32.853 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:12:02.921 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:12:02.924 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:12:02.927 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:12:33.041 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:12:40.086 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:12:40.090 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:13:10.210 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:13:10.213 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:13:10.215 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:13:40.297 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:13:40.300 DEBUG:teuthology.orchestra.run.smithi070:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:13:40.303 DEBUG:teuthology.orchestra.run.smithi204:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-16T14:13:47.055 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-11-16T14:13:47.055 DEBUG:teuthology.task.console_log:Killing console logger for smithi028 2023-11-16T14:13:47.056 DEBUG:teuthology.task.console_log:Killing console logger for smithi070 2023-11-16T14:13:47.056 DEBUG:teuthology.task.console_log:Killing console logger for smithi204 2023-11-16T14:13:47.057 DEBUG:teuthology.exit:Finished running handlers